2019-11-29T10:54:29.614 INFO:root:teuthology version: 1.0.0-e749e7b 2019-11-29T10:54:29.615 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.GvidCk.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi --block --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891 2019-11-29T10:54:29.672 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T10:54:29.740 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891 branch: wip-yuval-master description: rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: yuvalif@yahoo.com first_in_suite: false job_id: '4552891' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-yuval-master ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: notcmalloc sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 rgw: compression type: random ec-data-pool: false frontend: civetweb storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-master sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 suite: rgw:verify suite_branch: wip-yuval-master suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9215 2019-11-29T10:54:29.740 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa; will attempt to use it 2019-11-29T10:54:29.741 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks 2019-11-29T10:54:29.741 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-29T10:54:29.744 INFO:teuthology.task.internal:Checking packages... 2019-11-29T10:54:29.770 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '656c8e8049c2c1acd363143c842c2edf1fe09b64' 2019-11-29T10:54:29.771 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-29T10:54:29.771 INFO:teuthology.packaging:ref: None 2019-11-29T10:54:29.771 INFO:teuthology.packaging:tag: None 2019-11-29T10:54:29.771 INFO:teuthology.packaging:branch: wip-yuval-master 2019-11-29T10:54:29.771 INFO:teuthology.packaging:sha1: 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T10:54:29.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-yuval-master 2019-11-29T10:54:29.959 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7809.g656c8e8 2019-11-29T10:54:29.959 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-29T10:54:29.967 INFO:teuthology.task.internal:no buildpackages task found 2019-11-29T10:54:29.967 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-29T10:54:29.984 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-29T10:54:29.985 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T10:54:30.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:54:40.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:54:50.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:00.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:10.114 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:20.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:30.147 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:40.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:55:50.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:00.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:10.286 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:20.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:30.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:40.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:56:50.364 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:00.381 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:10.399 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:20.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:30.432 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:40.450 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:57:50.482 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:58:00.497 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:58:10.514 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:58:20.530 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-29T10:58:30.544 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_yuvalif@teuthology', 'description': '/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891', 'machine_type': 'smithi'} 2019-11-29T10:58:30.581 DEBUG:teuthology.lock.ops:locked ubuntu@smithi114.front.sepia.ceph.com, ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T10:58:30.742 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-29T10:58:30.944 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of centos 7.6 2019-11-29T10:58:30.947 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 7.6 2019-11-29T10:58:31.318 INFO:teuthology.orchestra.console:Power off smithi182 2019-11-29T10:58:31.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-29T10:58:31.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:31.429 INFO:teuthology.orchestra.console:Power off smithi114 2019-11-29T10:58:31.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-29T10:58:31.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:35.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:35.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:39.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:39.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:39.888 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2019-11-29T10:58:39.989 INFO:teuthology.orchestra.console:Power on smithi114 2019-11-29T10:58:39.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-29T10:58:40.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:43.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:43.982 INFO:teuthology.orchestra.console:Power off for smithi182 completed 2019-11-29T10:58:44.083 INFO:teuthology.orchestra.console:Power on smithi182 2019-11-29T10:58:44.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-29T10:58:44.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:44.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:48.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:48.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-29T10:58:48.455 INFO:teuthology.orchestra.console:Power on for smithi182 completed 2019-11-29T10:58:48.553 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2019-11-29T10:58:48.556 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish 2019-11-29T10:58:48.655 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2019-11-29T11:01:35.148 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:01:44.206 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:01:50.225 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:01:53.262 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:01:59.306 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:02.315 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:08.361 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:11.371 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:17.418 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:20.432 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:26.474 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:29.514 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:35.532 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:38.572 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:44.590 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:47.626 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:02:53.645 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:03:19.550 INFO:teuthology.orchestra.run.smithi114:> hostname 2019-11-29T11:03:20.120 INFO:teuthology.orchestra.run.smithi114.stdout:smithi068 2019-11-29T11:03:20.121 INFO:teuthology.orchestra.run.smithi114:> grep smithi068 /etc/hosts 2019-11-29T11:03:20.179 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-11-29T11:03:20.179 INFO:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2019-11-29T11:03:20.312 INFO:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi068/smithi114/g' /etc/hosts 2019-11-29T11:03:20.387 INFO:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.68/172.21.15.114/g' /etc/hosts 2019-11-29T11:03:20.454 INFO:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi068/smithi114/g' /etc/hostname 2019-11-29T11:03:20.512 INFO:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2019-11-29T11:03:20.566 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2019-11-29T11:03:20.568 DEBUG:teuthology.parallel:result is None 2019-11-29T11:03:59.678 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:03:59.913 INFO:teuthology.orchestra.run.smithi182:> hostname 2019-11-29T11:04:00.500 INFO:teuthology.orchestra.run.smithi182.stdout:smithi182.front.sepia.ceph.com 2019-11-29T11:04:00.501 INFO:teuthology.orchestra.run.smithi182:> grep smithi182.front.sepia.ceph.com /etc/hosts 2019-11-29T11:04:00.574 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.182 smithi182.front.sepia.ceph.com smithi182 2019-11-29T11:04:00.575 INFO:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2019-11-29T11:04:00.720 INFO:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hosts 2019-11-29T11:04:00.831 INFO:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/172.21.15.182/172.21.15.182/g' /etc/hosts 2019-11-29T11:04:00.908 INFO:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hostname 2019-11-29T11:04:00.982 INFO:teuthology.orchestra.run.smithi182:> sudo hostname smithi182 2019-11-29T11:04:01.043 INFO:teuthology.provision.fog.smithi182:Deploy complete! 2019-11-29T11:04:01.045 DEBUG:teuthology.parallel:result is None 2019-11-29T11:04:01.246 INFO:teuthology.lock.ops:Checking smithi182.front.sepia.ceph.com 2019-11-29T11:04:01.246 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-29T11:04:01.267 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2019-11-29T11:04:01.267 INFO:teuthology.lock.ops:New key found. Updating... 2019-11-29T11:04:01.286 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: set os type and version on server 2019-11-29T11:04:01.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:04:01.287 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:04:01.377 INFO:teuthology.orchestra.run.smithi182:> true 2019-11-29T11:04:01.803 INFO:teuthology.orchestra.run.smithi182:> uname -m 2019-11-29T11:04:01.871 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2019-11-29T11:04:01.871 INFO:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2019-11-29T11:04:01.947 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Linux" 2019-11-29T11:04:01.947 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="7 (Core)" 2019-11-29T11:04:01.947 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2019-11-29T11:04:01.947 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2019-11-29T11:04:01.947 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="7" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:01.948 INFO:teuthology.orchestra.run.smithi182.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T11:04:01.949 INFO:teuthology.orchestra.run.smithi182.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T11:04:01.949 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T11:04:01.949 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T11:04:01.949 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:01.951 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2019-11-29T11:04:01.969 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2019-11-29T11:04:01.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:04:01.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:04:02.070 INFO:teuthology.orchestra.run.smithi114:> true 2019-11-29T11:04:02.470 INFO:teuthology.orchestra.run.smithi114:> uname -m 2019-11-29T11:04:02.531 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2019-11-29T11:04:02.531 INFO:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2019-11-29T11:04:02.589 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Linux" 2019-11-29T11:04:02.589 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="7 (Core)" 2019-11-29T11:04:02.589 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2019-11-29T11:04:02.589 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="7" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T11:04:02.590 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:04:02.591 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T11:04:02.591 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T11:04:02.591 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T11:04:02.591 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T11:04:02.591 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:04:02.592 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2019-11-29T11:04:02.605 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-29T11:04:02.638 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvIcp0CMiKrd60yCdHzQNxCx+pP0sM+l8lSpOGoZTQVqcQpfs2dkxGKwesi/gOUvLghpKBQnbsc8Jyvzbb+4ZcxitWoiflF/6XvMWvudv3TM2lyZV9c0aCPCuMZngxREVND8D9Niy4mLD2rLBNLwHndUxprYTuwuqs9j6DuEnYu7KZli5Q8Zy+QRC5rQNzNd6KgOwnGHzz6/YNBp5hXb0bW7fattH5WwPTezs8Duzxo7MoMFaNyM0rg+EGrsCFfAr+eUVNu8Kqzam+UhqEJJi04/zOldYi2ftp5v6xXDWvtNLf4mnfMuIPALeoIOq/4MXiOtQume3LpW86kpk+cwU1 smithi182.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/syInzK708BlfSRmwCWFsQqFmr2r1wLIx3yspbpGwj52q/sfvtpE5sRVvP+EKA8l+ihjGIcWywYcuYO3M4+H+PZ7DamgLTprnLN9bB5KBgRgGoBA4mlEDFyoISxlPsad9UircWf4rd0eVwjJmnuZQ6cDeQhdplEm2t3t8Kv0Zx5zakoRw9qLuBwfhHyaKGz9kddjPtAbFW2ENp8P2Uxuvi3acNL48kzPIQUexxq9UDNSNSpBujqIJcaieaOQjgP6EiQdCj3625xXX8njxkV1M2UyMj91P4txjwcLdQ5/WqprwDsDmbzuMhtst5DIiXbUBNUBVITPtx1I5HW9WNXcL 2019-11-29T11:04:02.639 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-29T11:04:02.688 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-29T11:04:02.693 INFO:teuthology.task.internal:Saving configuration 2019-11-29T11:04:02.719 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-29T11:04:02.777 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-29T11:04:02.795 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-29 10:58:30.549786', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi182.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMJc8yIhkrBVZ08wuqpy9P/063PBFEKfc8EN0LZqsbvwE+5+ROm+ZzdzVj+HgOKNbaLC/42hXaqMwfiSEU9WJk=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891'} 2019-11-29T11:04:02.818 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-29 10:58:30.549805', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi114.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENyGr+iHASZHp0CCStUNRciRrUHwQYLgPtxSqPTJ1OoGWH6J7YjDbTqd6EELQ/t65Lz6dulPWgJa0uvVpBNAv4=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891'} 2019-11-29T11:04:02.819 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-29T11:04:02.827 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-29T11:04:02.827 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-29T11:04:02.827 INFO:teuthology.run_tasks:Running task console_log... 2019-11-29T11:04:02.972 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-29T11:04:02.973 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-29T11:04:02.987 INFO:teuthology.task.internal:Opening connections... 2019-11-29T11:04:02.987 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:04:02.988 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:04:03.110 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:04:03.111 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:04:03.210 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-29T11:04:03.222 INFO:teuthology.orchestra.run.smithi182:> uname -m 2019-11-29T11:04:03.404 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2019-11-29T11:04:03.404 INFO:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Linux" 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="7 (Core)" 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="7" 2019-11-29T11:04:03.459 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T11:04:03.460 INFO:teuthology.orchestra.run.smithi182.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T11:04:03.461 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T11:04:03.461 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T11:04:03.461 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:03.461 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2019-11-29T11:04:03.475 INFO:teuthology.orchestra.run.smithi114:> uname -m 2019-11-29T11:04:03.576 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2019-11-29T11:04:03.577 INFO:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2019-11-29T11:04:03.638 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Linux" 2019-11-29T11:04:03.639 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="7 (Core)" 2019-11-29T11:04:03.639 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2019-11-29T11:04:03.639 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2019-11-29T11:04:03.639 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="7" 2019-11-29T11:04:03.640 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-29T11:04:03.640 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2019-11-29T11:04:03.640 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-29T11:04:03.640 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.centos.org/" 2019-11-29T11:04:03.641 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-29T11:04:03.641 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:04:03.641 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-29T11:04:03.641 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-29T11:04:03.642 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-29T11:04:03.642 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-29T11:04:03.642 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:04:03.643 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2019-11-29T11:04:03.654 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-29T11:04:03.680 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-29T11:04:03.690 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-29T11:04:03.691 INFO:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2019-11-29T11:04:03.695 INFO:teuthology.orchestra.run.smithi182:> test '!' -e /home/ubuntu/cephtest 2019-11-29T11:04:03.769 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-29T11:04:03.780 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-29T11:04:03.780 INFO:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2019-11-29T11:04:03.788 INFO:teuthology.orchestra.run.smithi182:> test -z $(ls -A /var/lib/ceph) 2019-11-29T11:04:03.882 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-29T11:04:03.951 INFO:teuthology.run_tasks:Running task kernel... 2019-11-29T11:04:03.970 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-11-29T11:04:03.970 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-29T11:04:03.970 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:04:03.970 INFO:teuthology.orchestra.run.smithi182:> sudo package-cleanup -y --oldkernels 2019-11-29T11:04:04.929 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:04:06.971 INFO:teuthology.orchestra.run.smithi182.stdout:No old kernels to remove 2019-11-29T11:04:06.991 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:04:06.991 INFO:teuthology.orchestra.run.smithi114:> sudo package-cleanup -y --oldkernels 2019-11-29T11:04:07.907 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:04:10.019 INFO:teuthology.orchestra.run.smithi114.stdout:No old kernels to remove 2019-11-29T11:04:10.041 INFO:teuthology.orchestra.run.smithi182:> uname -r 2019-11-29T11:04:10.135 INFO:teuthology.orchestra.run.smithi182.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:04:10.135 INFO:teuthology.task.kernel:Running kernel on smithi182: 3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:04:10.135 INFO:teuthology.orchestra.run.smithi182:> sudo yum install -y kernel 2019-11-29T11:04:10.410 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:04:10.453 INFO:teuthology.orchestra.run.smithi182.stdout:Determining fastest mirrors 2019-11-29T11:04:13.534 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.facebook.net 2019-11-29T11:04:13.535 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: ftp.linux.ncsu.edu 2019-11-29T11:04:13.536 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:04:13.536 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.facebook.net 2019-11-29T11:04:15.416 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:04:15.416 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:04:15.416 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-29T11:04:16.756 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:04:17.661 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:17.661 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:04:17.673 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:17.673 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:04:17.673 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:04:17.673 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T11:04:17.674 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:17.675 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 50 M 2019-11-29T11:04:17.675 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 64 M 2019-11-29T11:04:17.675 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:04:17.676 INFO:teuthology.orchestra.run.smithi182.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T11:04:18.956 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:04:19.164 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:04:20.098 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:04:20.098 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:04:55.509 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T11:04:56.067 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T11:04:56.068 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:56.068 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:04:56.068 INFO:teuthology.orchestra.run.smithi182.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-29T11:04:56.068 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:04:56.068 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:04:56.117 INFO:teuthology.orchestra.run.smithi182:> rpm -q kernel --last | head -n 1 2019-11-29T11:04:56.522 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 11:04:22 AM UTC 2019-11-29T11:04:56.525 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:04:56.525 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:04:56.525 INFO:teuthology.orchestra.run.smithi114:> uname -r 2019-11-29T11:04:56.643 INFO:teuthology.orchestra.run.smithi114.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:04:56.643 INFO:teuthology.task.kernel:Running kernel on smithi114: 3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:04:56.643 INFO:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2019-11-29T11:04:56.900 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:04:56.942 INFO:teuthology.orchestra.run.smithi114.stdout:Determining fastest mirrors 2019-11-29T11:05:00.023 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.facebook.net 2019-11-29T11:05:00.024 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: ftp.linux.ncsu.edu 2019-11-29T11:05:00.024 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:05:00.025 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.facebook.net 2019-11-29T11:05:02.166 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:05:02.166 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:05:02.167 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-29T11:05:03.486 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:05:04.306 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:04.307 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:05:04.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:04.308 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:05:04.308 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:05:04.308 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:05:04.308 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:05:04.308 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-29T11:05:04.309 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:04.309 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:05:04.309 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:05:04.309 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2019-11-29T11:05:04.310 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:04.310 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 50 M 2019-11-29T11:05:04.310 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 64 M 2019-11-29T11:05:04.311 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:05:04.319 INFO:teuthology.orchestra.run.smithi114.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T11:05:06.107 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:05:06.295 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:05:07.236 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:05:07.237 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:05:42.428 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T11:05:42.924 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-29T11:05:42.924 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:42.924 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:05:42.924 INFO:teuthology.orchestra.run.smithi114.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-29T11:05:42.924 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:42.925 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:05:42.958 INFO:teuthology.orchestra.run.smithi114:> rpm -q kernel --last | head -n 1 2019-11-29T11:05:43.425 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 11:05:10 AM UTC 2019-11-29T11:05:43.427 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:43.427 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:43.428 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-29T11:05:43.428 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-29T11:05:43.428 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-29T11:05:43.428 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-29T11:05:43.429 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi182.front.sepia.ceph.com, path=None, version=distro) 2019-11-29T11:05:43.429 INFO:teuthology.orchestra.run.smithi182:> rpm -q kernel --last | head -n 1 2019-11-29T11:05:43.796 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 11:04:22 AM UTC 2019-11-29T11:05:43.798 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:43.798 INFO:teuthology.orchestra.run.smithi182:> sudo rpm -qi grub2 2019-11-29T11:05:43.950 INFO:teuthology.orchestra.run.smithi182.stdout:Name : grub2 2019-11-29T11:05:43.950 INFO:teuthology.orchestra.run.smithi182.stdout:Epoch : 1 2019-11-29T11:05:43.950 INFO:teuthology.orchestra.run.smithi182.stdout:Version : 2.02 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Release : 0.76.el7.centos 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Architecture: x86_64 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Group : System Environment/Base 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Size : 0 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:License : GPLv3+ 2019-11-29T11:05:43.951 INFO:teuthology.orchestra.run.smithi182.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Relocations : (not relocatable) 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Packager : CentOS BuildSystem 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:Vendor : CentOS 2019-11-29T11:05:43.952 INFO:teuthology.orchestra.run.smithi182.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:Description : 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-29T11:05:43.953 INFO:teuthology.orchestra.run.smithi182.stdout:hardware devices. 2019-11-29T11:05:43.954 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-29T11:05:43.954 INFO:teuthology.task.kernel:Updating grub on smithi182 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:43.955 INFO:teuthology.orchestra.run.smithi182:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-29T11:05:44.428 INFO:teuthology.orchestra.run.smithi182.stderr:Generating grub configuration file ... 2019-11-29T11:05:44.569 INFO:teuthology.orchestra.run.smithi182.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:44.582 INFO:teuthology.orchestra.run.smithi182.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-29T11:05:44.822 INFO:teuthology.orchestra.run.smithi182.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:05:44.844 INFO:teuthology.orchestra.run.smithi182.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-29T11:05:44.877 INFO:teuthology.orchestra.run.smithi182.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-29T11:05:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-29T11:05:44.921 INFO:teuthology.orchestra.run.smithi182.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-29T11:05:44.930 INFO:teuthology.orchestra.run.smithi182.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-29T11:05:46.026 INFO:teuthology.orchestra.run.smithi182.stderr:done 2019-11-29T11:05:46.028 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:05:46.082 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.Rl997Ju09f 2019-11-29T11:05:46.083 INFO:teuthology.orchestra.run.smithi182:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Rl997Ju09f 2019-11-29T11:05:46.157 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.Rl997Ju09f 2019-11-29T11:05:46.322 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.Rl997Ju09f is 6KB 2019-11-29T11:05:46.394 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.Rl997Ju09f 2019-11-29T11:05:46.461 INFO:teuthology.orchestra.run.smithi182:> sudo grub2-set-default 0 2019-11-29T11:05:46.635 INFO:teuthology.orchestra.run.smithi182:> sudo shutdown -r now 2019-11-29T11:05:46.643 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-29T11:05:46.643 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2019-11-29T11:05:46.644 INFO:teuthology.orchestra.run.smithi114:> rpm -q kernel --last | head -n 1 2019-11-29T11:05:47.001 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Fri 29 Nov 2019 11:05:10 AM UTC 2019-11-29T11:05:47.003 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:47.003 INFO:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2 2019-11-29T11:05:47.136 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2 2019-11-29T11:05:47.136 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2019-11-29T11:05:47.136 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.02 2019-11-29T11:05:47.136 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 0.76.el7.centos 2019-11-29T11:05:47.136 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Group : System Environment/Base 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 0 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-29T11:05:47.137 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Relocations : (not relocatable) 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : CentOS BuildSystem 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-29T11:05:47.138 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2019-11-29T11:05:47.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:05:47.139 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-29T11:05:47.139 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-29T11:05:47.139 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-29T11:05:47.139 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2019-11-29T11:05:47.140 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-29T11:05:47.140 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:47.140 INFO:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-29T11:05:47.637 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2019-11-29T11:05:47.771 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:05:47.786 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-29T11:05:48.030 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-29T11:05:48.067 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-29T11:05:48.111 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-29T11:05:48.151 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-29T11:05:48.192 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-29T11:05:48.204 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-29T11:05:49.371 INFO:teuthology.orchestra.run.smithi114.stderr:done 2019-11-29T11:05:49.373 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:05:49.430 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.9pm58jmQAS 2019-11-29T11:05:49.431 INFO:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9pm58jmQAS 2019-11-29T11:05:49.498 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.9pm58jmQAS 2019-11-29T11:05:49.640 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.9pm58jmQAS is 6KB 2019-11-29T11:05:49.713 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.9pm58jmQAS 2019-11-29T11:05:49.779 INFO:teuthology.orchestra.run.smithi114:> sudo grub2-set-default 0 2019-11-29T11:05:49.942 INFO:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2019-11-29T11:05:49.952 INFO:teuthology.misc:Re-opening connections... 2019-11-29T11:05:49.953 INFO:teuthology.misc:trying to connect to ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:05:49.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:05:49.953 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:06:49.954 DEBUG:teuthology.orchestra.remote:timed out 2019-11-29T11:06:49.955 INFO:teuthology.misc:trying to connect to ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:06:49.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:06:49.956 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:07:49.958 DEBUG:teuthology.orchestra.remote:timed out 2019-11-29T11:07:49.958 DEBUG:teuthology.misc:waited 120.005175114 2019-11-29T11:07:50.958 INFO:teuthology.misc:trying to connect to ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:07:50.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:07:50.959 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:07:51.142 INFO:teuthology.orchestra.run.smithi182:> true 2019-11-29T11:07:51.331 DEBUG:teuthology.misc:waited 121.378777981 2019-11-29T11:07:52.332 INFO:teuthology.misc:trying to connect to ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:07:52.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:07:52.333 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:07:52.422 INFO:teuthology.orchestra.run.smithi114:> true 2019-11-29T11:07:52.763 DEBUG:teuthology.misc:waited 122.810447931 2019-11-29T11:07:53.764 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-29T11:07:53.764 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-29T11:07:53.765 INFO:teuthology.orchestra.run.smithi182:> uname -r 2019-11-29T11:07:53.860 INFO:teuthology.orchestra.run.smithi182.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:07:53.860 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:07:53.860 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-29T11:07:53.861 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-29T11:07:53.861 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-29T11:07:53.861 INFO:teuthology.orchestra.run.smithi114:> uname -r 2019-11-29T11:07:53.947 INFO:teuthology.orchestra.run.smithi114.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:07:53.948 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-29T11:07:53.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-29T11:07:54.952 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-29T11:07:54.953 INFO:teuthology.orchestra.run.smithi182:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-29T11:07:55.073 INFO:teuthology.orchestra.run.smithi182.stdout:ttyS1 2019-11-29T11:07:55.085 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-29T11:07:55.085 INFO:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-29T11:07:55.214 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2019-11-29T11:07:55.225 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-29T11:07:55.235 INFO:teuthology.task.internal:Creating test directory... 2019-11-29T11:07:55.235 INFO:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-29T11:07:55.239 INFO:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-29T11:07:55.327 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-29T11:07:55.393 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-29T11:07:55.432 INFO:teuthology.task.internal:Creating archive directory... 2019-11-29T11:07:55.432 INFO:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-29T11:07:55.437 INFO:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-29T11:07:55.533 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-29T11:07:55.594 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-29T11:07:55.594 INFO:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T11:07:55.599 INFO:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T11:07:55.665 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T11:07:55.700 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-29T11:07:55.703 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-29T11:07:55.746 INFO:teuthology.task.internal:Configuring sudo... 2019-11-29T11:07:55.746 INFO:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-29T11:07:55.750 INFO:teuthology.orchestra.run.smithi182:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-29T11:07:55.841 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-29T11:07:55.891 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-29T11:07:55.891 INFO:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-29T11:07:55.895 INFO:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-29T11:07:55.962 INFO:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T11:07:56.034 INFO:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T11:07:56.100 INFO:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T11:07:56.172 INFO:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T11:07:56.270 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-29T11:07:56.330 INFO:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T11:07:56.438 INFO:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-29T11:07:56.517 INFO:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T11:07:56.584 INFO:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-29T11:07:56.645 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-29T11:07:56.701 INFO:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2019-11-29T11:07:56.743 INFO:teuthology.orchestra.run.smithi182:> sudo service rsyslog restart 2019-11-29T11:07:56.821 INFO:teuthology.orchestra.run.smithi182.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-29T11:07:56.834 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-29T11:07:56.852 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-29T11:07:56.941 INFO:teuthology.task.internal:Starting timer... 2019-11-29T11:07:56.941 INFO:teuthology.run_tasks:Running task pcp... 2019-11-29T11:07:57.042 INFO:teuthology.run_tasks:Running task selinux... 2019-11-29T11:07:57.090 INFO:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2019-11-29T11:07:57.220 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: [ OK ] 2019-11-29T11:07:57.222 INFO:teuthology.orchestra.run.smithi182:> sudo service auditd rotate 2019-11-29T11:07:57.329 INFO:teuthology.orchestra.run.smithi182.stdout:Rotating logs: [ OK ] 2019-11-29T11:07:57.331 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-29T11:07:57.331 INFO:teuthology.orchestra.run.smithi182:> /usr/sbin/getenforce 2019-11-29T11:07:57.386 INFO:teuthology.orchestra.run.smithi182.stdout:Permissive 2019-11-29T11:07:57.387 INFO:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2019-11-29T11:07:57.448 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2019-11-29T11:07:57.448 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi182.front.sepia.ceph.com': 'permissive'} 2019-11-29T11:07:57.449 INFO:teuthology.orchestra.run.smithi182:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-29T11:07:57.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T11:07:57.533 INFO:teuthology.orchestra.run.smithi114:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-29T11:07:57.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T11:07:57.591 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-29T11:07:57.591 INFO:teuthology.orchestra.run.smithi182:> sudo /usr/sbin/setenforce permissive 2019-11-29T11:07:57.700 INFO:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2019-11-29T11:07:57.761 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-29T11:07:57.809 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-11-29T11:07:57.810 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-29T11:07:57.845 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-29T11:07:57.848 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi182.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-29T11:07:58.233 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-29T11:08:02.238 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-29T11:08:02.262 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:02 +0000 (0:00:00.066) 0:00:00.066 ******* 2019-11-29T11:08:02.275 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:02 +0000 (0:00:00.012) 0:00:00.079 ******* 2019-11-29T11:08:05.557 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi182.front.sepia.ceph.com] 2019-11-29T11:08:05.637 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:05 +0000 (0:00:03.357) 0:00:03.436 ******* 2019-11-29T11:08:05.652 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] 2019-11-29T11:08:05.726 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:05 +0000 (0:00:00.094) 0:00:03.531 ******* 2019-11-29T11:08:06.114 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-29T11:08:06.115 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T11:08:06.154 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.425) 0:00:03.957 ******* 2019-11-29T11:08:06.185 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.033) 0:00:03.990 ******* 2019-11-29T11:08:06.742 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi114.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-29T11:08:06.772 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.587) 0:00:04.577 ******* 2019-11-29T11:08:06.781 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-29T11:08:06.818 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.045) 0:00:04.623 ******* 2019-11-29T11:08:06.823 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-29T11:08:06.828 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:06.862 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.043) 0:00:04.666 ******* 2019-11-29T11:08:06.871 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:06.906 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:06 +0000 (0:00:00.044) 0:00:04.711 ******* 2019-11-29T11:08:07.294 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:08:07.340 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:07 +0000 (0:00:00.431) 0:00:05.142 ******* 2019-11-29T11:08:07.356 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:08:07.396 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:07 +0000 (0:00:00.055) 0:00:05.198 ******* 2019-11-29T11:08:08.976 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-29T11:08:08.978 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025687.41-26195808958301/source", "state": "file", "uid": 0} 2019-11-29T11:08:09.017 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:09 +0000 (0:00:01.624) 0:00:06.822 ******* 2019-11-29T11:08:09.027 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025687.35-52782362980796/source", "state": "file", "uid": 0} 2019-11-29T11:08:09.068 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:09 +0000 (0:00:00.049) 0:00:06.872 ******* 2019-11-29T11:08:09.567 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-11-29T11:08:09.569 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:09.601 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:09.899 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => 2019-11-29T11:08:09.900 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.209 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.231 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.553 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.568 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.834 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:10.887 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:11.131 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:11.241 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:11.463 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:11.566 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-29T11:08:11.673 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-29T11:08:11.679 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-29T11:08:11.862 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:11 +0000 (0:00:02.794) 0:00:09.667 ******* 2019-11-29T11:08:11.894 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:11 +0000 (0:00:00.031) 0:00:09.699 ******* 2019-11-29T11:08:12.798 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi114.front.sepia.ceph.com] 2019-11-29T11:08:12.857 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] 2019-11-29T11:08:12.899 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-11-29T11:08:12.901 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:12 +0000 (0:00:01.005) 0:00:10.705 ******* 2019-11-29T11:08:12.978 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:12 +0000 (0:00:00.074) 0:00:10.779 ******* 2019-11-29T11:08:13.444 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi114.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.225828", "end": "2019-11-29 11:08:13.388217", "rc": 0, "start": "2019-11-29 11:08:13.162389", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-29T11:08:13.445 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.238576", "end": "2019-11-29 11:08:13.400859", "rc": 0, "start": "2019-11-29 11:08:13.162283", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-29T11:08:13.482 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.507) 0:00:11.287 ******* 2019-11-29T11:08:13.514 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.032) 0:00:11.319 ******* 2019-11-29T11:08:13.777 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-29T11:08:13.778 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009808", "end": "2019-11-29 11:08:13.756989", "failed_when_result": false, "rc": 0, "start": "2019-11-29 11:08:13.747181", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-29T11:08:13.816 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.301) 0:00:11.621 ******* 2019-11-29T11:08:13.824 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007500", "end": "2019-11-29 11:08:13.784009", "failed_when_result": false, "rc": 0, "start": "2019-11-29 11:08:13.776509", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-29T11:08:13.863 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.047) 0:00:11.668 ******* 2019-11-29T11:08:13.869 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-29T11:08:13.869 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:13.908 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.042) 0:00:11.711 ******* 2019-11-29T11:08:13.917 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:13.952 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.045) 0:00:11.757 ******* 2019-11-29T11:08:13.958 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-29T11:08:13.959 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.017 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:13 +0000 (0:00:00.045) 0:00:11.803 ******* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.048 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.045) 0:00:11.849 ******* 2019-11-29T11:08:14.049 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-29T11:08:14.051 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.092 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.048) 0:00:11.897 ******* 2019-11-29T11:08:14.098 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.135 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.043) 0:00:11.940 ******* 2019-11-29T11:08:14.146 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-11-29T11:08:14.147 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.182 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.047) 0:00:11.987 ******* 2019-11-29T11:08:14.189 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.226 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.043) 0:00:12.031 ******* 2019-11-29T11:08:14.244 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.271 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.044) 0:00:12.076 ******* 2019-11-29T11:08:14.285 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:14.317 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.045) 0:00:12.121 ******* 2019-11-29T11:08:14.582 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-11-29T11:08:14.583 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:08:14.628 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.312) 0:00:12.433 ******* 2019-11-29T11:08:14.635 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:08:14.697 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:14 +0000 (0:00:00.068) 0:00:12.502 ******* 2019-11-29T11:08:15.001 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-29T11:08:15.006 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-29T11:08:15.082 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-29T11:08:15.347 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-29T11:08:15.418 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-29T11:08:15.633 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-29T11:08:15.744 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-29T11:08:15.911 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-29T11:08:16.102 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-29T11:08:16.248 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-29T11:08:16.399 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-29T11:08:16.596 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-29T11:08:16.760 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-29T11:08:16.938 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-29T11:08:17.120 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-29T11:08:17.289 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-29T11:08:17.465 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-29T11:08:17.613 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-29T11:08:17.804 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-29T11:08:17.930 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-29T11:08:18.130 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-29T11:08:18.257 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-29T11:08:18.473 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-29T11:08:18.614 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-29T11:08:18.812 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-29T11:08:18.929 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-29T11:08:19.139 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-29T11:08:19.274 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-29T11:08:19.395 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-29T11:08:19.583 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-29T11:08:19.733 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-29T11:08:19.915 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-29T11:08:20.109 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-29T11:08:20.225 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-29T11:08:20.425 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-29T11:08:20.543 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-29T11:08:20.707 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-29T11:08:20.866 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-29T11:08:21.056 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-29T11:08:21.173 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-29T11:08:21.400 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-29T11:08:21.498 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-29T11:08:21.750 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-29T11:08:21.797 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-29T11:08:22.097 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-29T11:08:22.121 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-29T11:08:22.435 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-29T11:08:22.487 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-29T11:08:22.741 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-29T11:08:22.785 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-29T11:08:23.107 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-29T11:08:23.122 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-29T11:08:23.395 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-29T11:08:23.474 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-29T11:08:23.675 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-29T11:08:23.780 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-29T11:08:23.965 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-29T11:08:24.104 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-29T11:08:24.270 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-29T11:08:24.426 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-29T11:08:24.561 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-29T11:08:24.767 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-29T11:08:24.870 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-29T11:08:25.102 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-29T11:08:25.176 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-29T11:08:25.430 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-29T11:08:25.526 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-29T11:08:25.772 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-29T11:08:25.860 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-29T11:08:26.104 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-29T11:08:26.215 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-29T11:08:26.408 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-29T11:08:26.553 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-29T11:08:26.703 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-29T11:08:26.860 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-29T11:08:27.038 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-29T11:08:27.175 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-29T11:08:27.365 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-29T11:08:27.531 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-29T11:08:27.711 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-29T11:08:27.848 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-29T11:08:28.039 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-29T11:08:28.140 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T11:08:28.352 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-29T11:08:28.456 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-29T11:08:28.703 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T11:08:28.799 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-29T11:08:29.065 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-29T11:08:29.073 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-29T11:08:29.393 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-29T11:08:29.735 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-29T11:08:29.747 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-29T11:08:30.052 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-29T11:08:30.104 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-29T11:08:30.402 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-29T11:08:30.460 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-29T11:08:30.671 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-29T11:08:30.786 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-29T11:08:31.004 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-29T11:08:31.104 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-29T11:08:31.309 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-29T11:08:31.437 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-29T11:08:31.650 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-29T11:08:31.785 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-29T11:08:32.015 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-29T11:08:32.150 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-29T11:08:32.356 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-29T11:08:32.476 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T11:08:32.652 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-29T11:08:32.810 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-29T11:08:32.999 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T11:08:33.138 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-29T11:08:33.336 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-29T11:08:33.493 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-29T11:08:33.707 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-29T11:08:33.859 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-29T11:08:34.022 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-29T11:08:34.170 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-29T11:08:34.315 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-29T11:08:34.520 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-29T11:08:34.645 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-29T11:08:34.847 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-29T11:08:34.979 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-29T11:08:35.173 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-29T11:08:35.346 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-29T11:08:35.522 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-29T11:08:35.685 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-29T11:08:35.849 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-29T11:08:36.066 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-29T11:08:36.204 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-29T11:08:36.442 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-29T11:08:36.560 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-29T11:08:36.788 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-29T11:08:36.902 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-29T11:08:37.184 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-29T11:08:37.252 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-29T11:08:37.520 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-29T11:08:37.597 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-29T11:08:37.832 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-29T11:08:37.932 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-29T11:08:38.129 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-29T11:08:38.270 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-29T11:08:38.459 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-29T11:08:38.618 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-29T11:08:38.791 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-29T11:08:38.949 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-29T11:08:39.149 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-29T11:08:39.274 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-29T11:08:39.474 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-29T11:08:39.620 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T11:08:39.794 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-29T11:08:39.930 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-29T11:08:40.131 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-29T11:08:40.310 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-29T11:08:40.493 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-29T11:08:40.668 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-29T11:08:40.828 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-29T11:08:40.986 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-29T11:08:41.162 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-29T11:08:41.360 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-29T11:08:41.521 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-29T11:08:41.703 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-29T11:08:41.845 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-29T11:08:42.016 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-29T11:08:42.174 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-29T11:08:42.336 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-29T11:08:42.504 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-29T11:08:42.638 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-29T11:08:42.827 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-29T11:08:43.002 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-29T11:08:43.148 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-29T11:08:43.297 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-29T11:08:43.486 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-29T11:08:43.644 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-29T11:08:43.822 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-29T11:08:43.959 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-29T11:08:44.184 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-29T11:08:44.282 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-29T11:08:44.544 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-29T11:08:44.597 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-29T11:08:44.889 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-29T11:08:44.941 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-29T11:08:45.236 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-29T11:08:45.259 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-29T11:08:45.596 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-29T11:08:45.598 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-29T11:08:45.926 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-29T11:08:45.950 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-29T11:08:46.278 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-29T11:08:46.289 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-29T11:08:46.590 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-29T11:08:46.602 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-29T11:08:46.877 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-29T11:08:46.930 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-29T11:08:47.195 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-29T11:08:47.248 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-29T11:08:47.591 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-29T11:08:47.769 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-29T11:08:47.930 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-29T11:08:48.086 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-29T11:08:48.263 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-29T11:08:48.437 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-29T11:08:48.607 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-29T11:08:48.753 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-29T11:08:48.962 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-29T11:08:49.088 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-29T11:08:49.277 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-29T11:08:49.414 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-29T11:08:49.606 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-29T11:08:49.774 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-29T11:08:49.921 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-29T11:08:50.120 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-29T11:08:50.264 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-29T11:08:50.469 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-29T11:08:50.617 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-29T11:08:50.794 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-29T11:08:50.931 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-29T11:08:51.129 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-29T11:08:51.271 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-29T11:08:51.461 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-29T11:08:51.607 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-29T11:08:51.786 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-29T11:08:51.959 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-29T11:08:52.126 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-29T11:08:52.283 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-29T11:08:52.462 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-29T11:08:52.648 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-29T11:08:52.788 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-29T11:08:52.999 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T11:08:53.101 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-29T11:08:53.348 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-29T11:08:53.433 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-29T11:08:53.788 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-29T11:08:53.965 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-29T11:08:54.121 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:54 +0000 (0:00:39.423) 0:00:51.925 ******* 2019-11-29T11:08:54.139 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-29T11:08:54.140 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-29T11:08:54.177 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:54 +0000 (0:00:00.056) 0:00:51.982 ******* 2019-11-29T11:08:54.252 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-29T11:08:54.257 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-29T11:08:54.258 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-29T11:08:54.260 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-29T11:08:54.261 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-29T11:08:54.263 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-29T11:08:54.264 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-29T11:08:54.266 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-29T11:08:54.267 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-29T11:08:54.269 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-29T11:08:54.270 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-29T11:08:54.281 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189 2019-11-29T11:08:54.282 INFO:teuthology.task.ansible.out:"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-29T11:08:54.326 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:54 +0000 (0:00:00.147) 0:00:52.130 ******* 2019-11-29T11:08:54.850 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-29T11:08:54.851 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-29T11:08:54.992 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:54 +0000 (0:00:00.663) 0:00:52.794 ******* 2019-11-29T11:08:55.025 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-29T11:08:55.060 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:55 +0000 (0:00:00.069) 0:00:52.863 ******* 2019-11-29T11:08:55.116 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-11-29T11:08:55.121 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-29T11:08:55.123 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-29T11:08:55.124 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-29T11:08:55.126 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jo 2019-11-29T11:08:55.128 INFO:teuthology.task.ansible.out:wilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f 2019-11-29T11:08:55.129 INFO:teuthology.task.ansible.out:966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h 2019-11-29T11:08:55.130 INFO:teuthology.task.ansible.out:7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-29T11:08:55.132 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-29T11:08:55.133 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-29T11:08:55.135 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-29T11:08:55.136 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f 2019-11-29T11:08:55.137 INFO:teuthology.task.ansible.out:57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-29T11:08:55.178 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:55 +0000 (0:00:00.119) 0:00:52.983 ******* 2019-11-29T11:08:55.325 INFO:teuthology.task.ansible.out: 2019-11-29T11:08:55.328 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* ok: [smithi114.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-29T11:08:55.367 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:55 +0000 (0:00:00.187) 0:00:53.170 ******* 2019-11-29T11:08:55.745 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-29T11:08:55.747 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-29T11:08:55.889 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi182.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-29T11:08:55.952 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:08:55 +0000 (0:00:00.583) 0:00:53.754 ******* 2019-11-29T11:08:56.082 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-29T11:08:56.347 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-29T11:08:56.450 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-29T11:08:56.710 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-29T11:08:56.795 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-29T11:08:57.060 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-29T11:08:57.152 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-29T11:08:57.154 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-29T11:08:57.394 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-29T11:08:57.520 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-29T11:08:57.754 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-29T11:08:57.756 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-29T11:08:57.860 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-29T11:08:57.861 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-29T11:08:58.083 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-29T11:08:58.189 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-29T11:08:58.456 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-29T11:08:58.457 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-29T11:08:58.520 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-29T11:08:58.531 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:58.787 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-29T11:08:58.888 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-29T11:08:58.890 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-29T11:08:58.900 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:58.911 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:58.923 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:58.936 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:59.124 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-29T11:08:59.138 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:59.289 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-29T11:08:59.492 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-29T11:08:59.493 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-29T11:08:59.522 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/W 2019-11-29T11:08:59.523 INFO:teuthology.task.ansible.out:ZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:59.529 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:59.540 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:08:59.646 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-29T11:08:59.650 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-29T11:08:59.907 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-29T11:08:59.973 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-29T11:09:00.285 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-29T11:09:00.287 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-29T11:09:00.320 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-29T11:09:00.578 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-29T11:09:00.671 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-29T11:09:00.924 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-29T11:09:00.998 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-29T11:09:01.270 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-29T11:09:01.345 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-29T11:09:01.610 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-29T11:09:01.684 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-29T11:09:01.930 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-29T11:09:02.024 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-29T11:09:02.025 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-29T11:09:02.279 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-29T11:09:02.383 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-29T11:09:02.384 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-29T11:09:02.635 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-29T11:09:02.636 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-29T11:09:02.739 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-29T11:09:02.991 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-29T11:09:02.992 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-29T11:09:03.086 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-29T11:09:03.328 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-29T11:09:03.428 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-29T11:09:03.433 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-29T11:09:03.649 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-29T11:09:03.783 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-29T11:09:03.987 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-29T11:09:03.988 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-29T11:09:04.092 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-29T11:09:04.331 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-29T11:09:04.408 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-29T11:09:04.677 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-29T11:09:04.730 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-29T11:09:05.023 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-29T11:09:05.040 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-29T11:09:05.329 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-29T11:09:05.361 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-29T11:09:05.363 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-29T11:09:05.664 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-29T11:09:05.706 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-29T11:09:05.709 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-29T11:09:05.997 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-29T11:09:06.028 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-29T11:09:06.030 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-29T11:09:06.345 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-29T11:09:06.379 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-29T11:09:06.380 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-29T11:09:06.674 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-29T11:09:06.707 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-29T11:09:07.018 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h 2019-11-29T11:09:07.019 INFO:teuthology.task.ansible.out:aomaiwang", "validate_certs": true} 2019-11-29T11:09:07.296 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-29T11:09:07.392 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-29T11:09:07.624 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-29T11:09:07.745 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-29T11:09:07.947 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-29T11:09:08.068 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T11:09:08.288 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-29T11:09:08.414 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-29T11:09:08.632 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T11:09:08.746 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-29T11:09:08.978 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-29T11:09:09.094 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-29T11:09:09.332 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-29T11:09:09.410 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-29T11:09:09.417 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-29T11:09:09.705 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-29T11:09:09.717 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-29T11:09:09.720 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-29T11:09:10.041 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-29T11:09:10.043 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-29T11:09:10.075 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-29T11:09:10.389 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-29T11:09:10.391 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-29T11:09:10.450 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-29T11:09:10.773 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-29T11:09:10.830 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-29T11:09:11.153 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-29T11:09:11.169 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-29T11:09:11.496 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-29T11:09:11.543 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-29T11:09:11.832 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-29T11:09:11.886 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-29T11:09:12.163 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-29T11:09:12.184 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-29T11:09:12.484 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-29T11:09:12.506 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-29T11:09:12.507 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T11:09:12.830 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-29T11:09:12.884 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-29T11:09:12.885 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-29T11:09:12.887 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-29T11:09:13.216 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-29T11:09:13.218 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T11:09:13.228 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-29T11:09:13.565 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-29T11:09:13.570 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-29T11:09:13.572 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-29T11:09:13.622 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-29T11:09:13.880 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-29T11:09:13.982 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-29T11:09:14.229 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-29T11:09:14.323 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-29T11:09:14.325 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-29T11:09:14.567 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-29T11:09:14.677 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-29T11:09:14.933 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-29T11:09:14.935 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-29T11:09:15.065 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-29T11:09:15.295 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-29T11:09:15.405 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-29T11:09:15.645 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-29T11:09:15.740 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-29T11:09:15.963 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-29T11:09:16.072 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-29T11:09:16.326 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-29T11:09:16.421 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-29T11:09:16.680 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-29T11:09:16.764 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-29T11:09:16.765 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-29T11:09:17.028 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-29T11:09:17.102 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-29T11:09:17.348 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-29T11:09:17.350 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-29T11:09:17.412 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-29T11:09:17.680 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-29T11:09:17.765 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-29T11:09:17.767 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-29T11:09:17.983 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-29T11:09:18.099 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-29T11:09:18.336 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-29T11:09:18.338 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-29T11:09:18.433 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-29T11:09:18.662 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-29T11:09:18.779 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-29T11:09:19.015 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-29T11:09:19.122 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-29T11:09:19.377 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-29T11:09:19.484 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-29T11:09:19.704 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-29T11:09:19.841 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T11:09:20.072 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-29T11:09:20.170 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-29T11:09:20.422 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-29T11:09:20.576 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-29T11:09:20.794 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-29T11:09:20.892 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-29T11:09:21.143 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-29T11:09:21.246 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-29T11:09:21.490 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-29T11:09:21.605 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-29T11:09:21.862 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-29T11:09:21.985 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-29T11:09:22.179 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-29T11:09:22.305 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-29T11:09:22.468 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-29T11:09:22.679 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-29T11:09:22.827 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-29T11:09:23.029 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-29T11:09:23.205 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-29T11:09:23.374 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-29T11:09:23.561 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-29T11:09:23.682 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-29T11:09:23.898 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-29T11:09:24.016 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-29T11:09:24.221 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-29T11:09:24.355 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-29T11:09:24.581 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-29T11:09:24.680 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-29T11:09:24.905 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-29T11:09:25.043 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-29T11:09:25.235 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-29T11:09:25.392 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-29T11:09:25.574 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-29T11:09:25.726 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-29T11:09:25.913 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-29T11:09:26.060 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-29T11:09:26.247 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-29T11:09:26.403 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-29T11:09:26.610 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-29T11:09:26.737 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-29T11:09:26.959 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-29T11:09:27.069 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-29T11:09:27.289 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-29T11:09:27.409 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-29T11:09:27.612 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-29T11:09:27.770 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-29T11:09:27.965 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-29T11:09:28.122 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-29T11:09:28.124 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-29T11:09:28.310 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-29T11:09:28.458 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-29T11:09:28.460 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-29T11:09:28.643 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-29T11:09:28.645 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-29T11:09:28.836 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-29T11:09:28.986 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-29T11:09:28.988 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-29T11:09:29.197 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-29T11:09:29.318 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-29T11:09:29.558 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-29T11:09:29.677 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-29T11:09:29.918 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-29T11:09:30.059 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-29T11:09:30.251 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-29T11:09:30.419 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-29T11:09:30.576 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-29T11:09:30.767 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-29T11:09:30.935 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-29T11:09:31.081 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-29T11:09:31.277 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-29T11:09:31.456 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-29T11:09:31.634 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-29T11:09:31.805 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-29T11:09:31.953 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-29T11:09:32.163 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-29T11:09:32.298 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-29T11:09:32.502 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-29T11:09:32.648 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-29T11:09:32.859 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-29T11:09:33.004 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-29T11:09:33.214 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-29T11:09:33.324 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-29T11:09:33.556 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-29T11:09:33.677 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-29T11:09:33.679 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T11:09:33.910 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-29T11:09:34.018 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-29T11:09:34.232 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-29T11:09:34.234 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-29T11:09:34.362 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-29T11:09:34.463 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:34 +0000 (0:00:38.513) 0:01:32.268 ******* 2019-11-29T11:09:34.513 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.524 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.537 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.549 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.567 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-29T11:09:34.570 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-29T11:09:34.590 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T11:09:34.591 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.592 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.597 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.598 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.600 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:34.916 INFO:teuthology.task.ansible.out: 2019-11-29T11:09:34.918 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-29T11:09:35.018 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T11:09:35.019 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf59 2019-11-29T11:09:35.021 INFO:teuthology.task.ansible.out:2607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.077 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:35 +0000 (0:00:00.596) 0:01:32.865 ******* 2019-11-29T11:09:35.144 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.152 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.163 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.164 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.175 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.176 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.198 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.301 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-29T11:09:35.540 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-29T11:09:35.551 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:35.645 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-29T11:09:35.891 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-29T11:09:35.984 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-29T11:09:36.227 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-29T11:09:36.340 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-29T11:09:36.352 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.364 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.374 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.385 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.396 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.407 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.418 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.429 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.441 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.452 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.463 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.480 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.486 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.497 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.499 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.519 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.520 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.531 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.543 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.554 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip 2019-11-29T11:09:36.556 INFO:teuthology.task.ansible.out:4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-29T11:09:36.565 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.576 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.610 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.633 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.644 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.655 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.666 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.681 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.682 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.693 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.713 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.721 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.725 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.736 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.747 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.758 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.769 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.788 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.811 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.825 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.831 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.832 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.842 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.853 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.864 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.875 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.893 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.894 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.910 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712b 2019-11-29T11:09:36.932 INFO:teuthology.task.ansible.out:a2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47 2019-11-29T11:09:36.940 INFO:teuthology.task.ansible.out:f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXD 2019-11-29T11:09:36.942 INFO:teuthology.task.ansible.out:wMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.950 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.961 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.976 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.989 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:36.990 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.002 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.004 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.015 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.016 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.017 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.029 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.044 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.064 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.072 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.096 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.097 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.099 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.101 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.112 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.113 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.115 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.125 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.128 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.145 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.145 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.147 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.169 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'n 2019-11-29T11:09:37.174 INFO:teuthology.task.ansible.out:ame': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.188 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.195 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.224 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.227 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.228 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.242 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.243 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.254 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.256 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.259 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.271 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.272 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.273 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.283 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.307 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com 2019-11-29T11:09:37.313 INFO:teuthology.task.ansible.out: h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.327 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.327 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.329 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.330 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.341 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.365 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.366 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.367 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.380 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.381 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.382 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.384 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.394 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.395 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.397 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.409 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.431 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.432 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.433 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.435 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.436 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.447 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.448 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.460 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.462 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.481 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.501 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.503 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.504 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.546 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:37 +0000 (0:00:02.486) 0:01:35.351 ******* 2019-11-29T11:09:37.554 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.556 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.561 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.585 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.587 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.636 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:37 +0000 (0:00:00.089) 0:01:35.441 ******* 2019-11-29T11:09:37.644 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-29T11:09:37.651 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.654 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.655 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.656 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.669 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.679 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.691 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.704 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.714 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.726 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.737 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.738 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.753 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.764 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.772 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.791 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.793 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.821 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.822 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.823 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.834 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.845 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.856 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.869 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.879 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.879 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.890 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.901 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:37.959 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:37 +0000 (0:00:00.320) 0:01:35.761 ******* 2019-11-29T11:09:37.995 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-29T11:09:37.997 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:38.039 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:38 +0000 (0:00:00.082) 0:01:35.843 ******* 2019-11-29T11:09:38.344 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi114.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-29T11:09:38.414 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-29T11:09:38.663 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-29T11:09:38.747 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-29T11:09:38.979 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-29T11:09:39.053 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-29T11:09:39.306 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-29T11:09:39.401 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-29T11:09:39.636 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-29T11:09:39.740 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-29T11:09:39.997 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-29T11:09:40.067 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-29T11:09:40.304 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-29T11:09:40.421 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-29T11:09:40.621 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-29T11:09:40.748 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-29T11:09:40.986 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-29T11:09:41.123 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-29T11:09:41.320 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-29T11:09:41.472 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-29T11:09:41.641 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-29T11:09:41.791 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-29T11:09:41.966 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-29T11:09:42.074 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-29T11:09:42.282 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-29T11:09:42.390 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-29T11:09:42.594 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-29T11:09:42.766 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-29T11:09:42.927 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-29T11:09:43.104 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-29T11:09:43.232 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-29T11:09:43.395 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-29T11:09:43.582 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-29T11:09:43.740 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-29T11:09:43.876 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-29T11:09:44.073 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-29T11:09:44.198 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-29T11:09:44.386 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-29T11:09:44.544 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-29T11:09:44.710 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-29T11:09:44.846 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-29T11:09:45.038 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-29T11:09:45.178 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-29T11:09:45.374 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-29T11:09:45.469 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-29T11:09:45.700 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-29T11:09:45.784 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-29T11:09:46.018 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-29T11:09:46.113 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-29T11:09:46.332 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-29T11:09:46.439 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-29T11:09:46.638 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-29T11:09:46.785 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-29T11:09:46.848 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:46 +0000 (0:00:08.805) 0:01:44.649 ******* 2019-11-29T11:09:46.967 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-29T11:09:47.291 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-29T11:09:47.343 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:47 +0000 (0:00:00.498) 0:01:45.148 ******* 2019-11-29T11:09:47.953 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-29T11:09:47.954 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025786.87-37599797442119/source", "state": "file", "uid": 0} 2019-11-29T11:09:48.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.672) 0:01:45.821 ******* 2019-11-29T11:09:48.056 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-29T11:09:48.058 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => { "msg": "Host smithi114.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-29T11:09:48.115 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.079) 0:01:45.900 ******* 2019-11-29T11:09:48.142 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-29T11:09:48.143 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-29T11:09:48.183 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.087) 0:01:45.988 ******* 2019-11-29T11:09:48.184 INFO:teuthology.task.ansible.out: 2019-11-29T11:09:48.210 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.250 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.066) 0:01:46.054 ******* 2019-11-29T11:09:48.400 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-29T11:09:48.401 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025787.37-4146590888987/source", "state": "file", "uid": 0} 2019-11-29T11:09:48.437 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.187) 0:01:46.242 ******* 2019-11-29T11:09:48.475 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-29T11:09:48.476 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => { "msg": "Host smithi182.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-29T11:09:48.511 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.073) 0:01:46.316 ******* 2019-11-29T11:09:48.558 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-29T11:09:48.560 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-29T11:09:48.603 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.088) 0:01:46.404 ******* 2019-11-29T11:09:48.627 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-29T11:09:48.629 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.673 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.067) 0:01:46.472 ******* TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-29T11:09:48.677 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.102703", "end": "2019-11-29 11:09:48.634811", "rc": 0, "start": "2019-11-29 11:09:48.532108", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-29T11:09:48.712 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.044) 0:01:46.517 ******* 2019-11-29T11:09:48.741 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.783 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.071) 0:01:46.588 ******* 2019-11-29T11:09:48.813 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.853 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.070) 0:01:46.658 ******* 2019-11-29T11:09:48.880 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-29T11:09:48.881 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.923 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.070) 0:01:46.728 ******* 2019-11-29T11:09:48.952 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:48.986 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:48 +0000 (0:00:00.062) 0:01:46.790 ******* 2019-11-29T11:09:49.012 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-29T11:09:49.014 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.055 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.069) 0:01:46.860 ******* 2019-11-29T11:09:49.082 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-29T11:09:49.083 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.115649", "end": "2019-11-29 11:09:49.059545", "rc": 0, "start": "2019-11-29 11:09:48.943896", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-29T11:09:49.084 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.127 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.071) 0:01:46.932 ******* 2019-11-29T11:09:49.166 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.038) 0:01:46.971 ******* 2019-11-29T11:09:49.170 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-29T11:09:49.171 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:49.172 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:49.214 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.048) 0:01:47.019 ******* 2019-11-29T11:09:49.221 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-29T11:09:49.221 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.260 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.045) 0:01:47.065 ******* 2019-11-29T11:09:49.266 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-29T11:09:49.266 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.307 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.047) 0:01:47.112 ******* 2019-11-29T11:09:49.316 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.361 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.053) 0:01:47.166 ******* 2019-11-29T11:09:49.370 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.409 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.048) 0:01:47.214 ******* 2019-11-29T11:09:49.416 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-29T11:09:49.420 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.461 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.051) 0:01:47.266 ******* 2019-11-29T11:09:49.466 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-29T11:09:49.467 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:49.510 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.047) 0:01:47.313 ******* 2019-11-29T11:09:49.524 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.560 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.051) 0:01:47.365 ******* 2019-11-29T11:09:49.566 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-29T11:09:49.567 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.625 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.055) 0:01:47.421 ******* 2019-11-29T11:09:49.626 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.684 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.068) 0:01:47.489 ******* 2019-11-29T11:09:49.695 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:49.759 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.074) 0:01:47.564 ******* 2019-11-29T11:09:49.768 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-29T11:09:49.770 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.828 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.069) 0:01:47.633 ******* 2019-11-29T11:09:49.838 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-11-29T11:09:49.840 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:49.900 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.071) 0:01:47.705 ******* 2019-11-29T11:09:49.908 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi182.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:49.951 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.051) 0:01:47.756 ******* 2019-11-29T11:09:49.957 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-29T11:09:49.958 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.002 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:49 +0000 (0:00:00.050) 0:01:47.807 ******* 2019-11-29T11:09:50.008 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-29T11:09:50.010 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.053 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.051) 0:01:47.858 ******* 2019-11-29T11:09:50.059 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-29T11:09:50.060 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.102 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.048) 0:01:47.907 ******* 2019-11-29T11:09:50.108 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-29T11:09:50.109 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.149 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.047) 0:01:47.954 ******* 2019-11-29T11:09:50.155 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-29T11:09:50.156 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.205 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.055) 0:01:48.010 ******* 2019-11-29T11:09:50.218 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-29T11:09:50.222 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:50.255 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.049) 0:01:48.060 ******* 2019-11-29T11:09:50.260 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-29T11:09:50.262 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:50.298 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.103 ******* 2019-11-29T11:09:50.303 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-29T11:09:50.305 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.341 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.146 ******* 2019-11-29T11:09:50.347 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-29T11:09:50.347 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.385 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.190 ******* 2019-11-29T11:09:50.391 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-29T11:09:50.392 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:50.429 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.044) 0:01:48.234 ******* 2019-11-29T11:09:50.437 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-29T11:09:50.438 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.493 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.278 ******* TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.522 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.048) 0:01:48.326 ******* 2019-11-29T11:09:50.533 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.565 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.370 ******* 2019-11-29T11:09:50.571 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-29T11:09:50.573 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.609 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.043) 0:01:48.414 ******* 2019-11-29T11:09:50.615 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-11-29T11:09:50.615 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.652 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.042) 0:01:48.457 ******* 2019-11-29T11:09:50.668 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.697 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.044) 0:01:48.501 ******* 2019-11-29T11:09:50.702 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-29T11:09:50.703 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.745 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.048) 0:01:48.550 ******* 2019-11-29T11:09:50.751 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-29T11:09:50.758 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.792 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.044) 0:01:48.595 ******* 2019-11-29T11:09:50.797 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-29T11:09:50.798 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.836 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.045) 0:01:48.640 ******* 2019-11-29T11:09:50.844 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:50.879 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.044) 0:01:48.684 ******* 2019-11-29T11:09:50.888 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:50.924 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.044) 0:01:48.729 ******* 2019-11-29T11:09:50.931 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-29T11:09:50.932 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:50.969 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:50 +0000 (0:00:00.042) 0:01:48.772 ******* 2019-11-29T11:09:50.976 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-29T11:09:51.017 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.049) 0:01:48.822 ******* 2019-11-29T11:09:51.023 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-29T11:09:51.024 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.061 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.043) 0:01:48.866 ******* 2019-11-29T11:09:51.066 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-29T11:09:51.068 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.105 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.044) 0:01:48.910 ******* 2019-11-29T11:09:51.112 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-29T11:09:51.113 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.153 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.047) 0:01:48.958 ******* 2019-11-29T11:09:51.220 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.246 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.092) 0:01:49.051 ******* 2019-11-29T11:09:51.283 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-29T11:09:51.285 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.325 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.079) 0:01:49.130 ******* 2019-11-29T11:09:51.353 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.391 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.065) 0:01:49.196 ******* 2019-11-29T11:09:51.430 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-29T11:09:51.431 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-29T11:09:51.468 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.076) 0:01:49.273 ******* 2019-11-29T11:09:51.486 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:09:51.519 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.051) 0:01:49.324 ******* 2019-11-29T11:09:51.526 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-29T11:09:51.566 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.045) 0:01:49.370 ******* 2019-11-29T11:09:51.602 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-29T11:09:51.604 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:09:51.641 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:51 +0000 (0:00:00.075) 0:01:49.446 ******* 2019-11-29T11:09:51.997 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-11-29T11:09:51.998 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:09:52.048 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:52 +0000 (0:00:00.407) 0:01:49.853 ******* 2019-11-29T11:09:52.745 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-29T11:09:52.747 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-29T11:09:53.066 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-29T11:09:53.672 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-29T11:09:53.719 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:53 +0000 (0:00:01.670) 0:01:51.523 ******* 2019-11-29T11:09:53.898 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-29T11:09:53.976 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:53 +0000 (0:00:00.257) 0:01:51.781 ******* 2019-11-29T11:09:54.905 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-29T11:09:54.907 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025793.76-236908431328480/source", "state": "file", "uid": 0} 2019-11-29T11:09:55.100 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025794.03-36761076688625/source", "state": "file", "uid": 0} 2019-11-29T11:09:55.992 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025794.92-184731202072707/source", "state": "file", "uid": 0} 2019-11-29T11:09:56.040 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:56 +0000 (0:00:02.064) 0:01:53.845 ******* 2019-11-29T11:09:56.225 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575025795.11-256004423225134/source", "state": "file", "uid": 0} 2019-11-29T11:09:56.263 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:56 +0000 (0:00:00.223) 0:01:54.068 ******* 2019-11-29T11:09:56.265 INFO:teuthology.task.ansible.out: 2019-11-29T11:09:56.640 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-29T11:09:56.664 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-29T11:09:56.932 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T11:09:56.935 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-29T11:09:56.937 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T11:09:56.975 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:56 +0000 (0:00:00.711) 0:01:54.780 ******* 2019-11-29T11:09:57.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:09:57 +0000 (0:00:00.040) 0:01:54.821 ******* 2019-11-29T11:10:08.843 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-29T11:10:08.849 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.537862", "end": "2019-11-29 11:10:08.814916", "rc": 0, "start": "2019-11-29 11:09:57.277054", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.facebook.net\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.facebook.net", " * extras: mirrors.greenmountainaccess.net", " * updates: mirror.facebook.net", "Metadata Cache Created"]} 2019-11-29T11:10:08.880 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:08 +0000 (0:00:11.864) 0:02:06.685 ******* 2019-11-29T11:10:09.253 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T11:10:09.255 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-29T11:10:09.415 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-29T11:10:09.416 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.062047", "end": "2019-11-29 11:10:09.386011", "rc": 0, "start": "2019-11-29 11:09:57.323964", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.facebook.net\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirror.facebook.net", " * extras: mirrors.greenmountainaccess.net", " * updates: mirror.facebook.net", "Metadata Cache Created"]} 2019-11-29T11:10:09.453 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.572) 0:02:07.258 ******* 2019-11-29T11:10:09.555 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T11:10:09.556 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T11:10:09.594 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.141) 0:02:07.399 ******* 2019-11-29T11:10:09.621 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T11:10:09.623 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:09.660 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.066) 0:02:07.465 ******* 2019-11-29T11:10:09.687 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:09.726 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.065) 0:02:07.530 ******* 2019-11-29T11:10:09.753 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:09.790 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.064) 0:02:07.595 ******* 2019-11-29T11:10:09.807 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T11:10:09.809 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-29T11:10:09.820 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T11:10:09.821 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:09.862 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.071) 0:02:07.667 ******* 2019-11-29T11:10:09.900 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-29T11:10:09.902 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:09.961 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:09 +0000 (0:00:00.099) 0:02:07.766 ******* 2019-11-29T11:10:09.992 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.033 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.071) 0:02:07.838 ******* 2019-11-29T11:10:10.060 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-29T11:10:10.061 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.099 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.066) 0:02:07.904 ******* 2019-11-29T11:10:10.117 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-29T11:10:10.118 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-29T11:10:10.123 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.159 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.059) 0:02:07.964 ******* 2019-11-29T11:10:10.193 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.034) 0:02:07.998 ******* 2019-11-29T11:10:10.231 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T11:10:10.233 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.280 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.087) 0:02:08.085 ******* 2019-11-29T11:10:10.307 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-29T11:10:10.308 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.350 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.069) 0:02:08.154 ******* 2019-11-29T11:10:10.390 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-29T11:10:10.391 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.438 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.088) 0:02:08.243 ******* 2019-11-29T11:10:10.466 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-29T11:10:10.468 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.504 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.066) 0:02:08.309 ******* 2019-11-29T11:10:10.531 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-29T11:10:10.533 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.569 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.064) 0:02:08.374 ******* 2019-11-29T11:10:10.596 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-29T11:10:10.598 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.633 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.064) 0:02:08.438 ******* 2019-11-29T11:10:10.660 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.697 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.063) 0:02:08.502 ******* 2019-11-29T11:10:10.724 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-29T11:10:10.726 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:10.763 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:10 +0000 (0:00:00.065) 0:02:08.568 ******* 2019-11-29T11:10:11.536 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.055807", "end": "2019-11-29 11:10:11.500451", "rc": 0, "start": "2019-11-29 11:10:10.444644", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:10:11.583 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:11 +0000 (0:00:00.820) 0:02:09.388 ******* 2019-11-29T11:10:12.423 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-29T11:10:12.425 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-29T11:10:12.462 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:12 +0000 (0:00:00.879) 0:02:10.267 ******* 2019-11-29T11:10:12.489 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-29T11:10:12.490 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:12.530 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:12 +0000 (0:00:00.067) 0:02:10.335 ******* 2019-11-29T11:10:12.876 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.452464", "end": "2019-11-29 11:10:12.500455", "rc": 0, "start": "2019-11-29 11:10:11.047991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 29 November 2019 11:10:12 +0000 (0:00:00.045) 0:02:10.380 ******* TASK [common : Update apt cache] *********************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 11:10:12 +0000 (0:00:00.048) 0:02:10.429 ******* TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 11:10:12 +0000 (0:00:00.062) 0:02:10.492 ******* TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 11:10:12 +0000 (0:00:00.067) 0:02:10.559 ******* 2019-11-29T11:10:13.063 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-11-29T11:10:13.064 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-29T11:10:13.099 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.345) 0:02:10.904 ******* 2019-11-29T11:10:13.126 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-29T11:10:13.128 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:13.163 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.063) 0:02:10.967 ******* 2019-11-29T11:10:13.189 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-29T11:10:13.190 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:13.231 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.068) 0:02:11.036 ******* 2019-11-29T11:10:13.258 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-29T11:10:13.259 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:13.298 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.067) 0:02:11.103 ******* 2019-11-29T11:10:13.325 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-29T11:10:13.327 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:13.363 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.064) 0:02:11.168 ******* 2019-11-29T11:10:13.707 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-11-29T11:10:13.708 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-29T11:10:13.756 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:13 +0000 (0:00:00.391) 0:02:11.559 ******* 2019-11-29T11:10:14.272 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-29T11:10:14.304 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:14 +0000 (0:00:00.549) 0:02:12.109 ******* 2019-11-29T11:10:17.596 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-29T11:10:17.598 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-29T11:10:17.634 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:17 +0000 (0:00:03.330) 0:02:15.439 ******* 2019-11-29T11:10:18.075 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-29T11:10:18.113 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:18 +0000 (0:00:00.479) 0:02:15.918 ******* 2019-11-29T11:10:18.546 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-29T11:10:18.548 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-29T11:10:19.110 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-29T11:10:19.436 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-29T11:10:19.934 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-29T11:10:20.299 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-29T11:10:20.336 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:20 +0000 (0:00:02.222) 0:02:18.140 ******* 2019-11-29T11:10:20.641 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-29T11:10:20.642 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:10:20.678 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:20 +0000 (0:00:00.342) 0:02:18.483 ******* 2019-11-29T11:10:20.809 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-29T11:10:20.817 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-29T11:10:20.851 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:20 +0000 (0:00:00.172) 0:02:18.656 ******* 2019-11-29T11:10:21.180 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-29T11:10:21.182 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:10:21.219 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:21 +0000 (0:00:00.368) 0:02:19.024 ******* 2019-11-29T11:10:21.578 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-29T11:10:21.579 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-29T11:10:22.091 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-29T11:10:22.417 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-29T11:10:22.981 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-29T11:10:23.334 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-29T11:10:23.373 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:02.153) 0:02:21.178 ******* 2019-11-29T11:10:23.400 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-29T11:10:23.402 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:23.457 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:00.084) 0:02:21.262 ******* 2019-11-29T11:10:23.497 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-29T11:10:23.498 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-29T11:10:23.539 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:00.078) 0:02:21.341 ******* 2019-11-29T11:10:23.858 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-29T11:10:23.859 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-29T11:10:23.898 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:00.361) 0:02:21.703 ******* 2019-11-29T11:10:23.904 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-29T11:10:23.906 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-29T11:10:23.944 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:00.045) 0:02:21.749 ******* 2019-11-29T11:10:23.950 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-29T11:10:23.952 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:23.988 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:23 +0000 (0:00:00.043) 0:02:21.793 ******* 2019-11-29T11:10:23.994 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-29T11:10:23.994 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.027 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-29T11:10:24.029 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-29T11:10:24.069 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:24 +0000 (0:00:00.081) 0:02:21.874 ******* 2019-11-29T11:10:24.128 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi114.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.131 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.142 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.180 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:24 +0000 (0:00:00.110) 0:02:21.985 ******* 2019-11-29T11:10:24.396 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-29T11:10:24.399 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-29T11:10:24.435 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:24 +0000 (0:00:00.255) 0:02:22.240 ******* 2019-11-29T11:10:24.597 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-29T11:10:24.598 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.609 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.620 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.729 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-29T11:10:24.764 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:24 +0000 (0:00:00.329) 0:02:22.569 ******* 2019-11-29T11:10:27.665 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-29T11:10:27.666 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-29T11:10:27.705 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:27 +0000 (0:00:02.940) 0:02:25.510 ******* 2019-11-29T11:10:27.732 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-29T11:10:27.734 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:27.770 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:27 +0000 (0:00:00.065) 0:02:25.575 ******* 2019-11-29T11:10:28.109 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-29T11:10:28.110 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-29T11:10:28.154 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:28 +0000 (0:00:00.383) 0:02:25.959 ******* 2019-11-29T11:10:28.156 INFO:teuthology.task.ansible.out: 2019-11-29T11:10:28.182 INFO:teuthology.task.ansible.out: 2019-11-29T11:10:28.184 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:28.231 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:28 +0000 (0:00:00.075) 0:02:26.035 ******* 2019-11-29T11:10:28.694 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-29T11:10:28.760 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:28 +0000 (0:00:00.530) 0:02:26.565 ******* 2019-11-29T11:10:29.197 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-29T11:10:29.239 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:29 +0000 (0:00:00.478) 0:02:27.044 ******* 2019-11-29T11:10:29.728 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-29T11:10:29.728 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-29T11:10:29.772 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:29 +0000 (0:00:00.532) 0:02:27.576 ******* 2019-11-29T11:10:29.799 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-29T11:10:29.801 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:29.855 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:29 +0000 (0:00:00.069) 0:02:27.646 ******* 2019-11-29T11:10:30.178 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-29T11:10:30.180 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:10:30.221 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.380) 0:02:28.026 ******* 2019-11-29T11:10:30.239 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-29T11:10:30.240 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-29T11:10:30.287 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.065) 0:02:28.092 ******* 2019-11-29T11:10:30.314 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-29T11:10:30.316 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:30.361 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.064) 0:02:28.157 ******* 2019-11-29T11:10:30.572 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi114.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-29T11:10:30.607 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.255) 0:02:28.412 ******* 2019-11-29T11:10:30.635 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-29T11:10:30.638 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:30.678 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.071) 0:02:28.483 ******* 2019-11-29T11:10:30.705 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-29T11:10:30.706 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:10:30.761 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:30 +0000 (0:00:00.082) 0:02:28.566 ******* 2019-11-29T11:10:31.143 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi182.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-29T11:10:31.182 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:31 +0000 (0:00:00.420) 0:02:28.987 ******* 2019-11-29T11:10:31.208 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-29T11:10:31.218 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:31.247 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:31 +0000 (0:00:00.064) 0:02:29.052 ******* 2019-11-29T11:10:31.601 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-29T11:10:31.602 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-29T11:10:31.644 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:31 +0000 (0:00:00.397) 0:02:29.449 ******* 2019-11-29T11:10:32.199 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-29T11:10:32.236 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:32 +0000 (0:00:00.592) 0:02:30.041 ******* 2019-11-29T11:10:32.409 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-11-29T11:10:32.411 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ActiveEnterTimestampMonotonic": "20143994", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target system.slice nss-lookup.target local-fs.target var-run.mount systemd-journald.socket time-sync.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-11-29 11:07:44 UTC", "AssertTimestampMonotonic": "20142961", "Before": "xdm.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ConditionTimestampMonotonic": "20142960", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8943", "ExecMainStartTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ExecMainStartTimestampMonotonic": "20143922", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-29T11:10:32.413 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Fri 2019-11-29 11:07:44 UTC] ; stop_time=[n/a] ; pid=8943 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2019-11-29 11:07:44 UTC", "InactiveExitTimestampMonotonic": "20143994", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8943", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-29T11:10:32.415 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2019-11-29 11:07:44 UTC", "WatchdogTimestampMonotonic": "20143967", "WatchdogUSec": "0"}} 2019-11-29T11:10:32.455 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:32 +0000 (0:00:00.218) 0:02:30.260 ******* 2019-11-29T11:10:32.627 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ActiveEnterTimestampMonotonic": "19999994", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-journald.socket network.target local-fs.target time-sync.target var-run.mount basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Fri 2019-11-29 11:07:44 UTC", "AssertTimestampMonotonic": "19999298", "Before": "xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ConditionTimestampMonotonic": "19999297", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8941", "ExecMainStartTimestamp": "Fri 2019-11-29 11:07:44 UTC", "ExecMainStartTimestampMonotonic": "19999912", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-11-29T11:10:32.629 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Fri 2019-11-29 11:07:44 UTC] ; stop_time=[n/a] ; pid=8941 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2019-11-29 11:07:44 UTC", "InactiveExitTimestampMonotonic": "19999994", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8941", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-11-29T11:10:32.630 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Fri 2019-11-29 11:07:44 UTC", "WatchdogTimestampMonotonic": "19999962", "WatchdogUSec": "0"}} 2019-11-29T11:10:32.668 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:32 +0000 (0:00:00.213) 0:02:30.473 ******* 2019-11-29T11:10:32.778 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-11-29T11:10:32.780 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.003938", "end": "2019-11-29 11:10:32.740228", "rc": 0, "start": "2019-11-29 11:10:32.736290", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-29T11:10:32.820 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:32 +0000 (0:00:00.151) 0:02:30.625 ******* 2019-11-29T11:10:33.040 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.005098", "end": "2019-11-29 11:10:33.011485", "rc": 0, "start": "2019-11-29 11:10:33.006387", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-29T11:10:33.083 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:33 +0000 (0:00:00.260) 0:02:30.885 ******* 2019-11-29T11:10:33.317 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-29T11:10:33.318 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-29T11:10:33.371 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:33 +0000 (0:00:00.290) 0:02:31.176 ******* 2019-11-29T11:10:33.570 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-29T11:10:33.615 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:33 +0000 (0:00:00.244) 0:02:31.420 ******* 2019-11-29T11:10:35.867 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-29T11:10:35.869 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-29T11:10:35.904 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:35 +0000 (0:00:02.289) 0:02:33.709 ******* 2019-11-29T11:10:36.087 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-29T11:10:36.133 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:36 +0000 (0:00:00.228) 0:02:33.937 ******* 2019-11-29T11:10:37.279 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-29T11:10:37.281 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-29T11:10:37.330 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:37 +0000 (0:00:01.197) 0:02:35.135 ******* 2019-11-29T11:10:37.848 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} Friday 29 November 2019 11:10:37 +0000 (0:00:00.081) 0:02:35.216 ******* 2019-11-29T11:10:45.728 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-29T11:10:45.730 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.041523", "end": "2019-11-29 11:10:45.696598", "failed_when_result": false, "rc": 0, "start": "2019-11-29 11:10:37.655075", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-29T11:10:45.775 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:45 +0000 (0:00:08.364) 0:02:43.580 ******* 2019-11-29T11:10:46.733 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-29T11:10:46.734 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-29T11:10:46.772 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:46 +0000 (0:00:00.996) 0:02:44.577 ******* 2019-11-29T11:10:47.040 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-11-29T11:10:47.041 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.288601", "end": "2019-11-29 11:10:47.013860", "failed_when_result": false, "rc": 0, "start": "2019-11-29 11:10:37.725259", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-29T11:10:47.080 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:47 +0000 (0:00:00.307) 0:02:44.885 ******* 2019-11-29T11:10:47.108 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013897", "end": "2019-11-29 11:10:47.061969", "rc": 0, "start": "2019-11-29 11:10:47.048072", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-29T11:10:47.141 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:47 +0000 (0:00:00.061) 0:02:44.946 ******* 2019-11-29T11:10:47.474 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-29T11:10:47.476 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.027915", "end": "2019-11-29 11:10:47.447378", "rc": 0, "start": "2019-11-29 11:10:47.419463", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:10:47.514 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:47 +0000 (0:00:00.372) 0:02:45.319 ******* 2019-11-29T11:10:48.033 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-29T11:10:48.034 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-29T11:10:48.083 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:48 +0000 (0:00:00.568) 0:02:45.888 ******* 2019-11-29T11:10:48.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-29T11:10:48.433 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014483", "end": "2019-11-29 11:10:48.401765", "rc": 0, "start": "2019-11-29 11:10:48.387282", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-29T11:10:48.471 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:48 +0000 (0:00:00.388) 0:02:46.276 ******* 2019-11-29T11:10:48.790 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-29T11:10:48.792 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014261", "end": "2019-11-29 11:10:48.762273", "rc": 0, "start": "2019-11-29 11:10:48.748012", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:10:48.829 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:48 +0000 (0:00:00.357) 0:02:46.633 ******* 2019-11-29T11:10:55.703 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.873551", "end": "2019-11-29 11:10:55.657551", "rc": 0, "start": "2019-11-29 11:10:47.784000", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:10:55.760 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:55 +0000 (0:00:06.931) 0:02:53.564 ******* 2019-11-29T11:10:56.114 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-29T11:10:56.116 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-29T11:10:56.154 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.394) 0:02:53.959 ******* 2019-11-29T11:10:56.193 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-29T11:10:56.195 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-29T11:10:56.250 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.094) 0:02:54.053 ******* 2019-11-29T11:10:56.297 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi114.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T11:10:56.336 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.087) 0:02:54.141 ******* 2019-11-29T11:10:56.392 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi114.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-29T11:10:56.439 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.102) 0:02:54.243 ******* 2019-11-29T11:10:56.483 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi114.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T11:10:56.530 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.092) 0:02:54.335 ******* 2019-11-29T11:10:56.839 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-11-29T11:10:56.841 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T11:10:56.886 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:56 +0000 (0:00:00.355) 0:02:54.691 ******* 2019-11-29T11:10:57.071 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-29T11:10:57.072 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.907857", "end": "2019-11-29 11:10:57.040053", "rc": 0, "start": "2019-11-29 11:10:49.132196", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:10:57.111 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.225) 0:02:54.916 ******* 2019-11-29T11:10:57.247 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-29T11:10:57.249 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-29T11:10:57.296 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.173) 0:02:55.090 ******* 2019-11-29T11:10:57.312 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-29T11:10:57.314 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:57.361 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.075) 0:02:55.166 ******* 2019-11-29T11:10:57.388 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-29T11:10:57.390 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:57.444 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.083) 0:02:55.249 ******* 2019-11-29T11:10:57.492 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-29T11:10:57.494 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-29T11:10:57.533 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.088) 0:02:55.338 ******* 2019-11-29T11:10:57.580 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-11-29T11:10:57.582 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-29T11:10:57.620 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.087) 0:02:55.425 ******* 2019-11-29T11:10:57.667 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-29T11:10:57.669 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T11:10:57.712 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.091) 0:02:55.517 ******* 2019-11-29T11:10:57.766 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-29T11:10:57.767 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-29T11:10:57.807 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.093) 0:02:55.611 ******* 2019-11-29T11:10:57.813 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-29T11:10:57.814 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-29T11:10:57.871 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.059) 0:02:55.670 ******* TASK [testnode : Including version specific variables.] ************************ 2019-11-29T11:10:57.882 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-29T11:10:57.912 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:57 +0000 (0:00:00.046) 0:02:55.717 ******* 2019-11-29T11:10:58.233 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-29T11:10:58.276 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.360) 0:02:56.077 ******* 2019-11-29T11:10:58.598 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-29T11:10:58.600 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-29T11:10:58.641 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.368) 0:02:56.446 ******* 2019-11-29T11:10:58.668 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:58.705 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.063) 0:02:56.510 ******* 2019-11-29T11:10:58.736 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:10:58.771 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.066) 0:02:56.576 ******* 2019-11-29T11:10:58.830 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-29T11:10:58.870 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.098) 0:02:56.675 ******* 2019-11-29T11:10:58.907 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-29T11:10:58.909 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi114"}, "changed": false} 2019-11-29T11:10:58.945 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:58 +0000 (0:00:00.074) 0:02:56.750 ******* 2019-11-29T11:10:59.140 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi182.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-29T11:10:59.180 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:10:59 +0000 (0:00:00.235) 0:02:56.985 ******* 2019-11-29T11:10:59.962 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi114.front.sepia.ceph.com", "ansible_hostname": "smithi114", "ansible_nodename": "smithi114"}, "changed": true, "name": "smithi114"} 2019-11-29T11:11:00.008 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:00 +0000 (0:00:00.827) 0:02:57.813 ******* 2019-11-29T11:11:00.273 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-29T11:11:00.274 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-29T11:11:00.334 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:00 +0000 (0:00:00.326) 0:02:58.139 ******* 2019-11-29T11:11:00.363 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi182"}, "changed": false} 2019-11-29T11:11:00.423 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:00 +0000 (0:00:00.087) 0:02:58.226 ******* 2019-11-29T11:11:00.831 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-11-29T11:11:00.832 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-29T11:11:00.876 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:00 +0000 (0:00:00.454) 0:02:58.681 ******* 2019-11-29T11:11:00.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-11-29T11:11:00.946 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi182.front.sepia.ceph.com", "ansible_hostname": "smithi182", "ansible_nodename": "smithi182"}, "changed": true, "name": "smithi182"} 2019-11-29T11:11:00.992 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:00 +0000 (0:00:00.116) 0:02:58.797 ******* 2019-11-29T11:11:01.787 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-29T11:11:01.788 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-29T11:11:01.829 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:01 +0000 (0:00:00.837) 0:02:59.634 ******* 2019-11-29T11:11:01.972 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-29T11:11:02.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:02 +0000 (0:00:00.185) 0:02:59.820 ******* 2019-11-29T11:11:02.794 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi114.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-29T11:11:02.855 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:02 +0000 (0:00:00.839) 0:03:00.660 ******* 2019-11-29T11:11:02.955 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-29T11:11:02.996 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:02 +0000 (0:00:00.139) 0:03:00.799 ******* 2019-11-29T11:11:03.753 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-29T11:11:03.754 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-29T11:11:03.801 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:03 +0000 (0:00:00.807) 0:03:01.606 ******* 2019-11-29T11:11:03.894 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-29T11:11:03.895 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-29T11:11:03.959 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:03 +0000 (0:00:00.157) 0:03:01.764 ******* 2019-11-29T11:11:04.138 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T11:11:04.178 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:04 +0000 (0:00:00.219) 0:03:01.983 ******* 2019-11-29T11:11:04.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T11:11:04.509 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-29T11:11:04.547 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:04 +0000 (0:00:00.369) 0:03:02.352 ******* 2019-11-29T11:11:04.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-29T11:11:04.865 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-29T11:11:04.909 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:04 +0000 (0:00:00.361) 0:03:02.714 ******* 2019-11-29T11:11:04.915 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T11:11:04.916 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-29T11:11:04.981 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:04 +0000 (0:00:00.072) 0:03:02.786 ******* 2019-11-29T11:11:05.218 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-29T11:11:05.218 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T11:11:05.256 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:05 +0000 (0:00:00.275) 0:03:03.061 ******* 2019-11-29T11:11:05.604 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T11:11:05.605 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-29T11:11:05.655 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:05 +0000 (0:00:00.398) 0:03:03.460 ******* 2019-11-29T11:11:05.943 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T11:11:05.943 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-29T11:11:06.012 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:05 +0000 (0:00:00.339) 0:03:03.800 ******* TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi182.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-29T11:11:06.047 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:06 +0000 (0:00:00.051) 0:03:03.852 ******* 2019-11-29T11:11:06.986 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-29T11:11:06.988 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-29T11:11:07.027 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:07 +0000 (0:00:00.979) 0:03:04.832 ******* 2019-11-29T11:11:07.034 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T11:11:07.037 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-29T11:11:07.099 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:07 +0000 (0:00:00.069) 0:03:04.901 ******* 2019-11-29T11:11:08.052 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-29T11:11:08.087 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:08 +0000 (0:00:00.990) 0:03:05.892 ******* 2019-11-29T11:11:09.406 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T11:11:09.408 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-29T11:11:09.410 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.072643", "end": "2019-11-29 11:11:09.371071", "rc": 0, "start": "2019-11-29 11:11:07.298428", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:11:09.446 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:09 +0000 (0:00:01.358) 0:03:07.251 ******* 2019-11-29T11:11:09.474 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-29T11:11:09.513 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:09 +0000 (0:00:00.067) 0:03:07.318 ******* 2019-11-29T11:11:10.487 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T11:11:10.488 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-29T11:11:10.500 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T11:11:10.501 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.085091", "end": "2019-11-29 11:11:10.470902", "rc": 0, "start": "2019-11-29 11:11:08.385811", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:11:10.544 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:10 +0000 (0:00:01.031) 0:03:08.349 ******* 2019-11-29T11:11:10.572 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-29T11:11:10.619 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:10 +0000 (0:00:00.074) 0:03:08.424 ******* 2019-11-29T11:11:11.339 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T11:11:11.341 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-29T11:11:11.385 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:11 +0000 (0:00:00.766) 0:03:09.190 ******* 2019-11-29T11:11:11.412 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-29T11:11:11.414 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:11.452 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:11 +0000 (0:00:00.064) 0:03:09.255 ******* 2019-11-29T11:11:11.510 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi114.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:11.521 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:11.579 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:11 +0000 (0:00:00.127) 0:03:09.383 ******* 2019-11-29T11:11:11.584 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T11:11:11.585 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-29T11:11:11.612 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:11.674 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:11 +0000 (0:00:00.096) 0:03:09.479 ******* 2019-11-29T11:11:11.716 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-29T11:11:11.781 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:11 +0000 (0:00:00.106) 0:03:09.586 ******* 2019-11-29T11:11:12.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-29T11:11:12.297 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-29T11:11:12.334 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.552) 0:03:10.139 ******* 2019-11-29T11:11:12.531 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-29T11:11:12.532 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-29T11:11:12.585 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.250) 0:03:10.390 ******* 2019-11-29T11:11:12.612 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-29T11:11:12.613 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:12.659 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.074) 0:03:10.464 ******* 2019-11-29T11:11:12.697 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-29T11:11:12.698 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:12.708 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:12.747 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.087) 0:03:10.552 ******* 2019-11-29T11:11:12.787 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-29T11:11:12.792 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:12.825 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.077) 0:03:10.630 ******* 2019-11-29T11:11:12.861 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T11:11:12.863 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-29T11:11:12.900 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.075) 0:03:10.705 ******* 2019-11-29T11:11:12.943 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.286723", "end": "2019-11-29 11:11:12.904175", "rc": 0, "start": "2019-11-29 11:11:12.617452", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.facebook.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.facebook.net", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.greenmountainaccess.net", " * updates: mirror.facebook.net", "No unfinished transactions left."]} 2019-11-29T11:11:12.982 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:12 +0000 (0:00:00.082) 0:03:10.787 ******* 2019-11-29T11:11:13.340 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi114.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.035992", "end": "2019-11-29 11:11:13.312204", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 11:11:13.276212", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-29T11:11:13.391 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:13 +0000 (0:00:00.408) 0:03:11.196 ******* 2019-11-29T11:11:13.400 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-29T11:11:13.401 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-29T11:11:13.450 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:13 +0000 (0:00:00.058) 0:03:11.255 ******* 2019-11-29T11:11:13.459 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:13.509 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:13 +0000 (0:00:00.058) 0:03:11.314 ******* 2019-11-29T11:11:14.117 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-11-29T11:11:14.119 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.322575", "end": "2019-11-29 11:11:14.083879", "rc": 0, "start": "2019-11-29 11:11:13.761304", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.facebook.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirror.facebook.net", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirrors.greenmountainaccess.net", " * updates: mirror.facebook.net", "No unfinished transactions left."]} 2019-11-29T11:11:14.172 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:14 +0000 (0:00:00.659) 0:03:11.974 ******* 2019-11-29T11:11:14.573 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-29T11:11:14.575 INFO:teuthology.task.ansible.out:fatal: [smithi182.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.051694", "end": "2019-11-29 11:11:14.534532", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 11:11:14.482838", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-29T11:11:14.613 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:14 +0000 (0:00:00.444) 0:03:12.418 ******* 2019-11-29T11:11:14.650 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-29T11:11:14.651 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:14.694 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:14 +0000 (0:00:00.081) 0:03:12.499 ******* 2019-11-29T11:11:23.772 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-29T11:11:23.774 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-29T11:11:23.777 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-29T11:11:23.778 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T11:11:23.812 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:23 +0000 (0:00:09.117) 0:03:21.617 ******* 2019-11-29T11:11:24.942 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-29T11:11:24.944 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-29T11:11:24.945 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T11:11:24.982 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:24 +0000 (0:00:01.169) 0:03:22.787 ******* 2019-11-29T11:11:27.188 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-29T11:11:27.189 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-29T11:11:27.235 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:27 +0000 (0:00:02.253) 0:03:25.040 ******* 2019-11-29T11:11:28.405 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-29T11:11:28.450 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:28 +0000 (0:00:01.214) 0:03:26.255 ******* 2019-11-29T11:11:44.943 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T11:11:44.945 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-29T11:11:44.946 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-29T11:11:44.948 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.facebook.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependenc 2019-11-29T11:11:44.951 INFO:teuthology.task.ansible.out:ies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 22 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-29T11:11:44.953 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T11:11:44.995 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:44 +0000 (0:00:16.544) 0:03:42.800 ******* 2019-11-29T11:11:45.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-11-29T11:11:45.801 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-29T11:11:45.838 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:45 +0000 (0:00:00.842) 0:03:43.643 ******* 2019-11-29T11:11:46.375 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-29T11:11:46.412 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:46 +0000 (0:00:00.574) 0:03:44.217 ******* 2019-11-29T11:11:46.452 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T11:11:46.454 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:46.495 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:46 +0000 (0:00:00.082) 0:03:44.299 ******* 2019-11-29T11:11:46.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T11:11:46.545 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-29T11:11:46.546 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-29T11:11:46.548 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirror.facebook.net\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirrors.greenmountainaccess.net\n * updates: mirror.facebook.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependenc 2019-11-29T11:11:46.550 INFO:teuthology.task.ansible.out:ies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 21 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-29T11:11:46.551 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-29T11:11:46.604 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:46 +0000 (0:00:00.109) 0:03:44.409 ******* 2019-11-29T11:11:46.928 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-29T11:11:46.932 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service basic.target polkit.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ip6tables.service ipset.service ebtables.service iptables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-29T11:11:46.933 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-29T11:11:46.935 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T11:11:46.978 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:46 +0000 (0:00:00.374) 0:03:44.783 ******* 2019-11-29T11:11:47.356 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi114.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-29T11:11:47.400 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:47 +0000 (0:00:00.417) 0:03:45.201 ******* 2019-11-29T11:11:47.404 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-29T11:11:47.451 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:47 +0000 (0:00:00.052) 0:03:45.253 ******* 2019-11-29T11:11:47.981 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T11:11:47.982 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-29T11:11:48.037 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.584) 0:03:45.838 ******* 2019-11-29T11:11:48.072 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.115 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.081) 0:03:45.919 ******* 2019-11-29T11:11:48.227 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-29T11:11:48.229 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-29T11:11:48.264 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.149) 0:03:46.069 ******* 2019-11-29T11:11:48.300 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.333 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.069) 0:03:46.138 ******* 2019-11-29T11:11:48.364 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-29T11:11:48.399 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.065) 0:03:46.204 ******* 2019-11-29T11:11:48.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.464 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.065) 0:03:46.269 ******* 2019-11-29T11:11:48.487 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-11-29T11:11:48.489 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.524 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.059) 0:03:46.329 ******* 2019-11-29T11:11:48.544 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-29T11:11:48.545 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.service polkit.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "iptables.service ip6tables.service ebtables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-29T11:11:48.547 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-29T11:11:48.548 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T11:11:48.584 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.060) 0:03:46.389 ******* 2019-11-29T11:11:48.590 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-29T11:11:48.592 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.637 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.053) 0:03:46.442 ******* 2019-11-29T11:11:48.663 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-29T11:11:48.665 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.715 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.077) 0:03:46.520 ******* 2019-11-29T11:11:48.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-29T11:11:48.779 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.064) 0:03:46.584 ******* 2019-11-29T11:11:48.835 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-29T11:11:48.837 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.878 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.098) 0:03:46.683 ******* 2019-11-29T11:11:48.905 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-29T11:11:48.907 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:48.944 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:48 +0000 (0:00:00.064) 0:03:46.748 ******* 2019-11-29T11:11:48.978 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.016 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.073) 0:03:46.821 ******* 2019-11-29T11:11:49.028 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi182.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-29T11:11:49.066 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.049) 0:03:46.871 ******* 2019-11-29T11:11:49.071 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T11:11:49.072 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.113 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.046) 0:03:46.918 ******* 2019-11-29T11:11:49.139 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-29T11:11:49.147 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.186 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.072) 0:03:46.991 ******* 2019-11-29T11:11:49.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T11:11:49.214 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.253 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.066) 0:03:47.058 ******* 2019-11-29T11:11:49.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-29T11:11:49.283 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.328 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.075) 0:03:47.133 ******* 2019-11-29T11:11:49.355 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-29T11:11:49.357 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.396 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.068) 0:03:47.201 ******* 2019-11-29T11:11:49.423 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-29T11:11:49.425 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.460 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.063) 0:03:47.265 ******* 2019-11-29T11:11:49.476 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-11-29T11:11:49.478 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-29T11:11:49.514 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.053) 0:03:47.319 ******* 2019-11-29T11:11:49.520 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.559 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.044) 0:03:47.364 ******* 2019-11-29T11:11:49.565 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-29T11:11:49.565 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.607 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.047) 0:03:47.411 ******* 2019-11-29T11:11:49.619 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.656 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.044) 0:03:47.456 ******* 2019-11-29T11:11:49.657 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-29T11:11:49.696 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.045) 0:03:47.501 ******* 2019-11-29T11:11:49.702 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-29T11:11:49.703 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.748 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.044) 0:03:47.545 ******* TASK [testnode : Set apt preferences] ****************************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.788 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.045) 0:03:47.591 ******* 2019-11-29T11:11:49.793 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.831 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.044) 0:03:47.636 ******* 2019-11-29T11:11:49.838 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.882 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.044) 0:03:47.680 ******* TASK [testnode : Stop apache2] ************************************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.921 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.045) 0:03:47.726 ******* 2019-11-29T11:11:49.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-11-29T11:11:49.929 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:49.977 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:49 +0000 (0:00:00.045) 0:03:47.772 ******* TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.010 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.043) 0:03:47.815 ******* 2019-11-29T11:11:50.016 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-29T11:11:50.018 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.054 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.044) 0:03:47.860 ******* 2019-11-29T11:11:50.068 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.098 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.042) 0:03:47.903 ******* 2019-11-29T11:11:50.103 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-29T11:11:50.143 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:47.948 ******* 2019-11-29T11:11:50.149 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T11:11:50.149 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.188 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.043) 0:03:47.992 ******* 2019-11-29T11:11:50.192 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-29T11:11:50.194 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.230 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.042) 0:03:48.035 ******* 2019-11-29T11:11:50.243 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T11:11:50.245 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.285 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.049) 0:03:48.085 ******* 2019-11-29T11:11:50.286 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-11-29T11:11:50.288 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.325 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:48.130 ******* 2019-11-29T11:11:50.331 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-29T11:11:50.331 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.370 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.044) 0:03:48.175 ******* 2019-11-29T11:11:50.377 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-11-29T11:11:50.378 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.425 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.054) 0:03:48.230 ******* 2019-11-29T11:11:50.431 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-29T11:11:50.433 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.471 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:48.276 ******* 2019-11-29T11:11:50.479 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T11:11:50.480 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.518 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.046) 0:03:48.322 ******* 2019-11-29T11:11:50.524 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-29T11:11:50.525 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.570 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.047) 0:03:48.370 ******* TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-29T11:11:50.572 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.609 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.044) 0:03:48.414 ******* 2019-11-29T11:11:50.615 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.665 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.043) 0:03:48.458 ******* TASK [testnode : Install packages] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.696 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.043) 0:03:48.501 ******* 2019-11-29T11:11:50.704 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T11:11:50.706 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.744 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.047) 0:03:48.549 ******* 2019-11-29T11:11:50.750 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.791 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.047) 0:03:48.596 ******* 2019-11-29T11:11:50.796 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-29T11:11:50.798 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.837 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:48.642 ******* 2019-11-29T11:11:50.843 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-29T11:11:50.844 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.882 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:48.687 ******* 2019-11-29T11:11:50.887 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-29T11:11:50.889 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.930 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.043) 0:03:48.730 ******* 2019-11-29T11:11:50.933 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-29T11:11:50.935 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:50.970 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:50 +0000 (0:00:00.045) 0:03:48.775 ******* 2019-11-29T11:11:50.976 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-29T11:11:50.977 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.014 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.043) 0:03:48.819 ******* 2019-11-29T11:11:51.020 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-29T11:11:51.021 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.062 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.044) 0:03:48.864 ******* 2019-11-29T11:11:51.087 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-29T11:11:51.089 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.124 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.064) 0:03:48.928 ******* 2019-11-29T11:11:51.149 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-29T11:11:51.151 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.189 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.065) 0:03:48.994 ******* 2019-11-29T11:11:51.214 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-29T11:11:51.216 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.255 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.061) 0:03:49.055 ******* 2019-11-29T11:11:51.276 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-29T11:11:51.277 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.312 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.062) 0:03:49.117 ******* 2019-11-29T11:11:51.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T11:11:51.340 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.375 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.062) 0:03:49.180 ******* 2019-11-29T11:11:51.408 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.032) 0:03:49.213 ******* 2019-11-29T11:11:51.433 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-11-29T11:11:51.435 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.470 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.061) 0:03:49.275 ******* 2019-11-29T11:11:51.496 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-29T11:11:51.497 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.533 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.063) 0:03:49.338 ******* 2019-11-29T11:11:51.559 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-29T11:11:51.561 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.599 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.062) 0:03:49.401 ******* 2019-11-29T11:11:51.643 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.692 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.089) 0:03:49.490 ******* 2019-11-29T11:11:51.701 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T11:11:51.702 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:11:51.738 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.053) 0:03:49.544 ******* 2019-11-29T11:11:51.745 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.783 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.044) 0:03:49.588 ******* 2019-11-29T11:11:51.824 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.860 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.076) 0:03:49.665 ******* 2019-11-29T11:11:51.894 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:51.929 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.066) 0:03:49.732 ******* 2019-11-29T11:11:51.954 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-29T11:11:51.956 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.003 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:51 +0000 (0:00:00.066) 0:03:49.799 ******* 2019-11-29T11:11:52.027 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.066 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.072) 0:03:49.871 ******* 2019-11-29T11:11:52.095 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T11:11:52.097 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-29T11:11:52.098 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.144 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.078) 0:03:49.949 ******* 2019-11-29T11:11:52.185 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.040) 0:03:49.990 ******* 2019-11-29T11:11:52.190 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T11:11:52.190 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.230 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.043) 0:03:50.033 ******* 2019-11-29T11:11:52.236 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.275 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.046) 0:03:50.080 ******* 2019-11-29T11:11:52.281 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.321 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.045) 0:03:50.126 ******* 2019-11-29T11:11:52.349 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-29T11:11:52.350 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.401 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.080) 0:03:50.206 ******* 2019-11-29T11:11:52.431 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.471 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.069) 0:03:50.276 ******* 2019-11-29T11:11:52.511 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T11:11:52.512 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.557 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.084) 0:03:50.361 ******* 2019-11-29T11:11:52.599 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.602 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-29T11:11:52.642 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.086) 0:03:50.447 ******* 2019-11-29T11:11:52.678 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.036) 0:03:50.483 ******* 2019-11-29T11:11:52.685 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T11:11:52.691 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.725 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.046) 0:03:50.530 ******* 2019-11-29T11:11:52.753 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.793 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.067) 0:03:50.597 ******* 2019-11-29T11:11:52.843 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.886 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.093) 0:03:50.691 ******* 2019-11-29T11:11:52.917 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-29T11:11:52.918 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:52.966 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:52 +0000 (0:00:00.079) 0:03:50.771 ******* 2019-11-29T11:11:52.994 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.034 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.068) 0:03:50.839 ******* 2019-11-29T11:11:53.040 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T11:11:53.041 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:11:53.089 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.050) 0:03:50.890 ******* 2019-11-29T11:11:53.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T11:11:53.094 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.135 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.050) 0:03:50.940 ******* 2019-11-29T11:11:53.164 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T11:11:53.166 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.208 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.072) 0:03:51.013 ******* 2019-11-29T11:11:53.248 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.311 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.103) 0:03:51.116 ******* 2019-11-29T11:11:53.345 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.379 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.068) 0:03:51.184 ******* 2019-11-29T11:11:53.418 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T11:11:53.420 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-29T11:11:53.462 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.082) 0:03:51.267 ******* 2019-11-29T11:11:53.468 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-29T11:11:53.470 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.514 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.051) 0:03:51.318 ******* 2019-11-29T11:11:53.520 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T11:11:53.522 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.575 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.061) 0:03:51.380 ******* 2019-11-29T11:11:53.583 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.626 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.051) 0:03:51.431 ******* 2019-11-29T11:11:53.633 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T11:11:53.634 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.674 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.047) 0:03:51.479 ******* 2019-11-29T11:11:53.683 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-29T11:11:53.688 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.724 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.049) 0:03:51.528 ******* 2019-11-29T11:11:53.729 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.774 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.046) 0:03:51.575 ******* 2019-11-29T11:11:53.775 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-29T11:11:53.777 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.836 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.061) 0:03:51.636 ******* 2019-11-29T11:11:53.839 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.890 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.058) 0:03:51.695 ******* 2019-11-29T11:11:53.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-29T11:11:53.899 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:53.945 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:53 +0000 (0:00:00.055) 0:03:51.750 ******* 2019-11-29T11:11:53.954 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T11:11:54.052 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 11:11:53 +0000 (0:00:00.048) 0:03:51.798 ******* TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 29 November 2019 11:11:54 +0000 (0:00:00.044) 0:03:51.843 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.086 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.047) 0:03:51.891 ******* 2019-11-29T11:11:54.092 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-29T11:11:54.093 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.132 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.046) 0:03:51.937 ******* 2019-11-29T11:11:54.138 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-29T11:11:54.139 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.180 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.047) 0:03:51.985 ******* 2019-11-29T11:11:54.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-29T11:11:54.228 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.045) 0:03:52.030 ******* 2019-11-29T11:11:54.231 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-29T11:11:54.234 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.270 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.044) 0:03:52.075 ******* 2019-11-29T11:11:54.276 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi114.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.289 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-29T11:11:54.301 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-29T11:11:54.302 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi114.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.342 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.072) 0:03:52.147 ******* 2019-11-29T11:11:54.348 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.349 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.351 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.395 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.051) 0:03:52.199 ******* 2019-11-29T11:11:54.400 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-29T11:11:54.401 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.438 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.044) 0:03:52.243 ******* 2019-11-29T11:11:54.473 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.505 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.066) 0:03:52.309 ******* 2019-11-29T11:11:54.532 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-29T11:11:54.534 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.577 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.072) 0:03:52.382 ******* 2019-11-29T11:11:54.586 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-29T11:11:54.588 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003734", "end": "2019-11-29 11:11:54.518745", "rc": 0, "start": "2019-11-29 11:11:54.515011", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-29T11:11:54.642 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.065) 0:03:52.447 ******* 2019-11-29T11:11:54.649 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-29T11:11:54.650 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.692 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.049) 0:03:52.497 ******* 2019-11-29T11:11:54.701 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.741 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.049) 0:03:52.546 ******* 2019-11-29T11:11:54.747 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-29T11:11:54.748 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.799 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.057) 0:03:52.604 ******* 2019-11-29T11:11:54.807 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-29T11:11:54.807 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.855 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.055) 0:03:52.660 ******* 2019-11-29T11:11:54.863 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-29T11:11:54.863 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.912 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.054) 0:03:52.715 ******* 2019-11-29T11:11:54.918 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-29T11:11:54.920 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:54.964 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:54 +0000 (0:00:00.054) 0:03:52.769 ******* 2019-11-29T11:11:54.970 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-29T11:11:54.972 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.012 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.044) 0:03:52.814 ******* 2019-11-29T11:11:55.015 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-29T11:11:55.016 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.055 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.045) 0:03:52.860 ******* 2019-11-29T11:11:55.062 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-29T11:11:55.064 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.108 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.052) 0:03:52.913 ******* 2019-11-29T11:11:55.145 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-29T11:11:55.146 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.206 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.097) 0:03:53.011 ******* 2019-11-29T11:11:55.235 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.292 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.085) 0:03:53.096 ******* 2019-11-29T11:11:55.336 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-11-29T11:11:55.338 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.376 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.084) 0:03:53.180 ******* 2019-11-29T11:11:55.403 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-29T11:11:55.405 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.444 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.064) 0:03:53.245 ******* 2019-11-29T11:11:55.477 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.515 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.075) 0:03:53.320 ******* 2019-11-29T11:11:55.556 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-29T11:11:55.593 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.075) 0:03:53.396 ******* 2019-11-29T11:11:55.604 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-29T11:11:55.645 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.052) 0:03:53.448 ******* 2019-11-29T11:11:55.650 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-11-29T11:11:55.651 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.653 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-29T11:11:55.663 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.665 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.674 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.687 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi114.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-29T11:11:55.691 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi182.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-29T11:11:55.729 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.085) 0:03:53.534 ******* 2019-11-29T11:11:55.773 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.042) 0:03:53.576 ******* 2019-11-29T11:11:55.933 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-29T11:11:55.934 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003804", "end": "2019-11-29 11:11:55.907504", "rc": 0, "start": "2019-11-29 11:11:55.903700", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-29T11:11:55.983 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:55 +0000 (0:00:00.204) 0:03:53.781 ******* 2019-11-29T11:11:56.020 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.081 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.105) 0:03:53.886 ******* 2019-11-29T11:11:56.088 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-29T11:11:56.090 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.012288", "end": "2019-11-29 11:11:56.020812", "rc": 0, "start": "2019-11-29 11:11:56.008524", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:11:56.127 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.046) 0:03:53.932 ******* 2019-11-29T11:11:56.133 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-29T11:11:56.135 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.182 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.049) 0:03:53.982 ******* TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-29T11:11:56.183 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.222 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.045) 0:03:54.027 ******* 2019-11-29T11:11:56.228 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-29T11:11:56.229 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.267 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.045) 0:03:54.072 ******* 2019-11-29T11:11:56.273 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-29T11:11:56.312 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.043) 0:03:54.116 ******* 2019-11-29T11:11:56.317 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-29T11:11:56.319 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.373 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.048) 0:03:54.165 ******* TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYVM', u'wwn-0x5000c50091e2f173'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QYVM', u'wwn': u'0x5000c50091e2f173', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYVM-part1', u'wwn-0x5000c50091e2f173-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYVM", "wwn-0x5000c50091e2f173"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYVM-part1", "wwn-0x5000c50091e2f173-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_han 2019-11-29T11:11:56.375 INFO:teuthology.task.ansible.out:dle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QYVM", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e2f173"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:56.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-29T11:11:56.783 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-29T11:11:56.819 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.459) 0:03:54.624 ******* 2019-11-29T11:11:56.861 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T11:11:56.863 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item={u'block_used': 13034928, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289556, u'size_available': 930978021376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289556, "block_size": 4096, "block_total": 240324484, "block_used": 13034928, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978021376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-29T11:11:56.900 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:56 +0000 (0:00:00.080) 0:03:54.705 ******* 2019-11-29T11:11:57.201 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-29T11:11:57.202 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013007", "end": "2019-11-29 11:11:57.167895", "rc": 0, "start": "2019-11-29 11:11:57.154888", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:11:57.241 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:57 +0000 (0:00:00.341) 0:03:55.046 ******* 2019-11-29T11:11:57.299 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-29T11:11:57.300 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'block_used': 13034928, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289556, u'size_available': 930978021376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289556, "block_size": 4096, "block_total": 240324484, "block_used": 13034928, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978021376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:57.340 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:57 +0000 (0:00:00.098) 0:03:55.144 ******* 2019-11-29T11:11:57.367 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-11-29T11:11:57.406 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:11:57 +0000 (0:00:00.066) 0:03:55.211 ******* 2019-11-29T11:11:57.465 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-29T11:11:57.466 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQH', u'wwn-0x5000c50092922711'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFQH', u'wwn': u'0x5000c50092922711', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQH-part1', u'wwn-0x5000c50092922711-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQH", "wwn-0x5000c50092922711"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQH-part1", "wwn-0x5000c50092922711-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFQH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T11:11:57.467 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092922711"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:11:58.252 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-KcSbiE-WwF0-Dg6V-VsfU-Uiob-lLyZ-hJEMhn', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WB400BGN', u'nvme-nvme.8086-50484654363230343030574234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.588002", "end": "2019-11-29 11:11:58.217945", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-KcSbiE-WwF0-Dg6V-VsfU-Uiob-lLyZ-hJEMhn", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WB400BGN", "nvme-nvme.8086-50484654363230343030574234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:11:56.629943", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-29T11:11:58.254 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:11:59.361 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-nQJpps-rReA-g2oq-6Ac5-Ucqa-D0jA-70D0zX', u'nvme-INTEL_SSDPEDMD400G4_CVFT6161005T400BGN', u'nvme-nvme.8086-43564654363136313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.586892", "end": "2019-11-29 11:11:59.321118", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-nQJpps-rReA-g2oq-6Ac5-Ucqa-D0jA-70D0zX", "nvme-INTEL_SSDPEDMD400G4_CVFT6161005T400BGN", "nvme-nvme.8086-43564654363136313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:11:57.734226", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-29T11:11:59.363 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:11:59.625 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JA7C8AHLxlrun7CSWI0Nnc8ADqyp3It7f'], u'uuids': [u'ce212d2a-cc2d-439c-9f73-782bf415e967']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.049402", "end": "2019-11-29 11:11:59.578847", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JA7C8AHLxlrun7CSWI0Nnc8ADqyp3It7f"], "labels": [], "masters": [], "uuids": ["ce212d2a-cc2d-439c-9f73-782bf415e967"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:11:58.529445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:00.773 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhixG0OZm3cO8yRLzboSIY9UdB4kKgGVqa'], u'uuids': [u'717daadd-7615-413b-8c52-316ee437589f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.063293", "end": "2019-11-29 11:12:00.730374", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhixG0OZm3cO8yRLzboSIY9UdB4kKgGVqa"], "labels": [], "masters": [], "uuids": ["717daadd-7615-413b-8c52-316ee437589f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:11:59.667081", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:01.004 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jd0Xh7PssInezWOZPUhXX0QdTfdfpWm3f'], u'uuids': [u'59bfd3eb-c1cf-420c-933d-bdc6d90263ba']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.054539", "end": "2019-11-29 11:12:00.970154", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jd0Xh7PssInezWOZPUhXX0QdTfdfpWm3f"], "labels": [], "masters": [], "uuids": ["59bfd3eb-c1cf-420c-933d-bdc6d90263ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:11:59.915615", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:02.129 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhMwpDeGMCWvtLhR2a8Ly9jfS6IBAs4ufZ'], u'uuids': [u'04a4128b-c99a-4e96-a5eb-dea90921f5c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.054802", "end": "2019-11-29 11:12:02.095536", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhMwpDeGMCWvtLhR2a8Ly9jfS6IBAs4ufZ"], "labels": [], "masters": [], "uuids": ["04a4128b-c99a-4e96-a5eb-dea90921f5c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:01.040734", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:02.371 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JRxeKjTjEypFZs02vmscC99QOef2OacNy'], u'uuids': [u'e1e243f8-3e82-4a14-b13d-010edf56d469']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.050377", "end": "2019-11-29 11:12:02.337012", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JRxeKjTjEypFZs02vmscC99QOef2OacNy"], "labels": [], "masters": [], "uuids": ["e1e243f8-3e82-4a14-b13d-010edf56d469"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:01.286635", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:03.524 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhJ1pVZDY08RvRj6IqwGMFT0NebtMDf8TW'], u'uuids': [u'3fbbb1cb-da32-4580-b2b9-d41c297627c4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.062388", "end": "2019-11-29 11:12:03.487166", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhJ1pVZDY08RvRj6IqwGMFT0NebtMDf8TW"], "labels": [], "masters": [], "uuids": ["3fbbb1cb-da32-4580-b2b9-d41c297627c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:02.424778", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:03.777 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JZHaLZ6AVC6jRRaE8bXeZdc3XgnQPLPSo'], u'uuids': [u'4b4138aa-46b4-44c1-ba2e-143a2d2cab36']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.104340", "end": "2019-11-29 11:12:03.745443", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JZHaLZ6AVC6jRRaE8bXeZdc3XgnQPLPSo"], "labels": [], "masters": [], "uuids": ["4b4138aa-46b4-44c1-ba2e-143a2d2cab36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:02.641103", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:04.910 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhespS0DTlOrDNX3maJUFKusLca35AofEM'], u'uuids': [u'44397298-b26a-4dd1-9e14-1ee24e9dc9c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.076151", "end": "2019-11-29 11:12:04.871812", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhespS0DTlOrDNX3maJUFKusLca35AofEM"], "labels": [], "masters": [], "uuids": ["44397298-b26a-4dd1-9e14-1ee24e9dc9c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:03.795661", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:05.154 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jo9v7MQ13HxGWyZtH63tcfcneYlTQho38'], u'uuids': [u'f2f96411-e003-4efe-9156-61600a983a8f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.061746", "end": "2019-11-29 11:12:05.113655", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jo9v7MQ13HxGWyZtH63tcfcneYlTQho38"], "labels": [], "masters": [], "uuids": ["f2f96411-e003-4efe-9156-61600a983a8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:04.051909", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:05.227 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:05 +0000 (0:00:07.820) 0:04:03.031 ******* 2019-11-29T11:12:05.281 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-29T11:12:05.282 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYVM', u'wwn-0x5000c50091e2f173'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QYVM', u'wwn': u'0x5000c50091e2f173', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QYVM-part1', u'wwn-0x5000c50091e2f173-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYVM", "wwn-0x5000c50091e2f173"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QYVM-part1", "wwn-0x5000c50091e2f173-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QYVM", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T11:12:05.283 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e2f173"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:05.670 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-KcSbiE-WwF0-Dg6V-VsfU-Uiob-lLyZ-hJEMhn', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400WB400BGN', u'nvme-nvme.8086-50484654363230343030574234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.081563", "end": "2019-11-29 11:12:05.636468", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-KcSbiE-WwF0-Dg6V-VsfU-Uiob-lLyZ-hJEMhn", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WB400BGN", "nvme-nvme.8086-50484654363230343030574234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:05.554905", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-29T11:12:05.672 INFO:teuthology.task.ansible.out:pied, 0.0748038 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0748038 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:06.155 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JA7C8AHLxlrun7CSWI0Nnc8ADqyp3It7f'], u'uuids': [u'ce212d2a-cc2d-439c-9f73-782bf415e967']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.177707", "end": "2019-11-29 11:12:06.113719", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JA7C8AHLxlrun7CSWI0Nnc8ADqyp3It7f"], "labels": [], "masters": [], "uuids": ["ce212d2a-cc2d-439c-9f73-782bf415e967"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:05.936012", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.171125 s, 674 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.171125 s, 674 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:06.307 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-29T11:12:06.308 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhqAqEvuslDC1ljsPf8JpiMFqOgl6Odhnw'], u'uuids': [u'ffa7beaa-41d0-45bf-90c5-db6826e3faa6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.067461", "end": "2019-11-29 11:12:06.264901", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhqAqEvuslDC1ljsPf8JpiMFqOgl6Odhnw"], "labels": [], "masters": [], "uuids": ["ffa7beaa-41d0-45bf-90c5-db6826e3faa6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:05.197440", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-29T11:12:06.366 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:06 +0000 (0:00:01.139) 0:04:04.171 ******* 2019-11-29T11:12:06.416 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-29T11:12:06.417 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQH', u'wwn-0x5000c50092922711'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XFQH', u'wwn': u'0x5000c50092922711', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XFQH-part1', u'wwn-0x5000c50092922711-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQH", "wwn-0x5000c50092922711"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFQH-part1", "wwn-0x5000c50092922711-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFQH", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-29T11:12:06.419 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092922711"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:06.626 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jd0Xh7PssInezWOZPUhXX0QdTfdfpWm3f'], u'uuids': [u'59bfd3eb-c1cf-420c-933d-bdc6d90263ba']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.176588", "end": "2019-11-29 11:12:06.590324", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jd0Xh7PssInezWOZPUhXX0QdTfdfpWm3f"], "labels": [], "masters": [], "uuids": ["59bfd3eb-c1cf-420c-933d-bdc6d90263ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:06.413736", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.170163 s, 678 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.170163 s, 678 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:06.821 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-nQJpps-rReA-g2oq-6Ac5-Ucqa-D0jA-70D0zX', u'nvme-INTEL_SSDPEDMD400G4_CVFT6161005T400BGN', u'nvme-nvme.8086-43564654363136313030355434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.084809", "end": "2019-11-29 11:12:06.785673", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-nQJpps-rReA-g2oq-6Ac5-Ucqa-D0jA-70D0zX", "nvme-INTEL_SSDPEDMD400G4_CVFT6161005T400BGN", "nvme-nvme.8086-43564654363136313030355434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:06.700864", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-29T11:12:06.823 INFO:teuthology.task.ansible.out:pied, 0.0777907 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0777907 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:07.122 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JRxeKjTjEypFZs02vmscC99QOef2OacNy'], u'uuids': [u'e1e243f8-3e82-4a14-b13d-010edf56d469']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.177976", "end": "2019-11-29 11:12:07.097240", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JRxeKjTjEypFZs02vmscC99QOef2OacNy"], "labels": [], "masters": [], "uuids": ["e1e243f8-3e82-4a14-b13d-010edf56d469"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:06.919264", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.171537 s, 672 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.171537 s, 672 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:07.230 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhixG0OZm3cO8yRLzboSIY9UdB4kKgGVqa'], u'uuids': [u'717daadd-7615-413b-8c52-316ee437589f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.156724", "end": "2019-11-29 11:12:07.201791", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhixG0OZm3cO8yRLzboSIY9UdB4kKgGVqa"], "labels": [], "masters": [], "uuids": ["717daadd-7615-413b-8c52-316ee437589f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:07.045067", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.151266 s, 763 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.151266 s, 763 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:07.645 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JZHaLZ6AVC6jRRaE8bXeZdc3XgnQPLPSo'], u'uuids': [u'4b4138aa-46b4-44c1-ba2e-143a2d2cab36']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.208659", "end": "2019-11-29 11:12:07.618486", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5JZHaLZ6AVC6jRRaE8bXeZdc3XgnQPLPSo"], "labels": [], "masters": [], "uuids": ["4b4138aa-46b4-44c1-ba2e-143a2d2cab36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:07.409827", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.202398 s, 570 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.202398 s, 570 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:07.709 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhMwpDeGMCWvtLhR2a8Ly9jfS6IBAs4ufZ'], u'uuids': [u'04a4128b-c99a-4e96-a5eb-dea90921f5c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.169883", "end": "2019-11-29 11:12:07.682168", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhMwpDeGMCWvtLhR2a8Ly9jfS6IBAs4ufZ"], "labels": [], "masters": [], "uuids": ["04a4128b-c99a-4e96-a5eb-dea90921f5c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:07.512285", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.163512 s, 705 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.163512 s, 705 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:08.117 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jo9v7MQ13HxGWyZtH63tcfcneYlTQho38'], u'uuids': [u'f2f96411-e003-4efe-9156-61600a983a8f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.169283", "end": "2019-11-29 11:12:08.079667", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-eaMOvNgqvOaQEZUkA9baBUuzR0tIEn5Jo9v7MQ13HxGWyZtH63tcfcneYlTQho38"], "labels": [], "masters": [], "uuids": ["f2f96411-e003-4efe-9156-61600a983a8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:07.910384", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.163349 s, 706 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.163349 s, 706 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:08.167 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:08 +0000 (0:00:01.800) 0:04:05.972 ******* 2019-11-29T11:12:08.200 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhJ1pVZDY08RvRj6IqwGMFT0NebtMDf8TW'], u'uuids': [u'3fbbb1cb-da32-4580-b2b9-d41c297627c4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.170020", "end": "2019-11-29 11:12:08.155996", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhJ1pVZDY08RvRj6IqwGMFT0NebtMDf8TW"], "labels": [], "masters": [], "uuids": ["3fbbb1cb-da32-4580-b2b9-d41c297627c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:07.985976", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.163342 s, 706 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.163342 s, 706 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:08.585 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-29T11:12:08.586 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.092048", "end": "2019-11-29 11:12:08.554483", "rc": 0, "start": "2019-11-29 11:12:08.462435", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:08.625 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:08 +0000 (0:00:00.457) 0:04:06.429 ******* 2019-11-29T11:12:08.687 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-29T11:12:08.689 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhespS0DTlOrDNX3maJUFKusLca35AofEM'], u'uuids': [u'44397298-b26a-4dd1-9e14-1ee24e9dc9c0']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.171755", "end": "2019-11-29 11:12:08.633210", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhespS0DTlOrDNX3maJUFKusLca35AofEM"], "labels": [], "masters": [], "uuids": ["44397298-b26a-4dd1-9e14-1ee24e9dc9c0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:08.461455", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.16604 s, 695 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.16604 s, 695 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:08.963 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.042912", "end": "2019-11-29 11:12:08.939620", "rc": 0, "start": "2019-11-29 11:12:08.896708", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:09.010 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.385) 0:04:06.815 ******* 2019-11-29T11:12:09.037 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-29T11:12:09.077 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.066) 0:04:06.882 ******* 2019-11-29T11:12:09.103 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-29T11:12:09.105 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.163 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.080) 0:04:06.962 ******* 2019-11-29T11:12:09.165 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhqAqEvuslDC1ljsPf8JpiMFqOgl6Odhnw'], u'uuids': [u'ffa7beaa-41d0-45bf-90c5-db6826e3faa6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.182840", "end": "2019-11-29 11:12:09.107141", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-64IcioXm2tq1hQu7oTGqeszXcPzdOOxhqAqEvuslDC1ljsPf8JpiMFqOgl6Odhnw"], "labels": [], "masters": [], "uuids": ["ffa7beaa-41d0-45bf-90c5-db6826e3faa6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-29 11:12:08.924301", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.176403 s, 654 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.176403 s, 654 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:09.209 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.051) 0:04:07.014 ******* 2019-11-29T11:12:09.216 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-29T11:12:09.217 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.256 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.046) 0:04:07.060 ******* 2019-11-29T11:12:09.283 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T11:12:09.284 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.323 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.067) 0:04:07.128 ******* 2019-11-29T11:12:09.350 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-29T11:12:09.353 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.388 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.064) 0:04:07.193 ******* 2019-11-29T11:12:09.620 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi182.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.083645", "end": "2019-11-29 11:12:09.578691", "rc": 0, "start": "2019-11-29 11:12:09.495046", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:09.677 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.288) 0:04:07.482 ******* 2019-11-29T11:12:09.704 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-29T11:12:09.706 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:12:09.743 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.066) 0:04:07.548 ******* 2019-11-29T11:12:09.782 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T11:12:09.782 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={u'block_used': 13034939, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289545, u'size_available': 930977976320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289545, "block_size": 4096, "block_total": 240324484, "block_used": 13034939, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930977976320, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.819 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.075) 0:04:07.624 ******* 2019-11-29T11:12:09.858 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.894 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.074) 0:04:07.699 ******* 2019-11-29T11:12:09.920 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T11:12:09.922 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:09.958 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:09 +0000 (0:00:00.064) 0:04:07.763 ******* 2019-11-29T11:12:10.018 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.050 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.092) 0:04:07.855 ******* 2019-11-29T11:12:10.066 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-11-29T11:12:10.074 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051890", "end": "2019-11-29 11:12:10.034254", "rc": 0, "start": "2019-11-29 11:12:09.982364", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:10.113 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.062) 0:04:07.918 ******* 2019-11-29T11:12:10.118 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-29T11:12:10.119 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.165 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.052) 0:04:07.970 ******* 2019-11-29T11:12:10.171 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-29T11:12:10.219 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.050) 0:04:08.020 ******* 2019-11-29T11:12:10.221 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-29T11:12:10.222 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.266 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.050) 0:04:08.071 ******* 2019-11-29T11:12:10.272 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-29T11:12:10.274 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.314 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.048) 0:04:08.119 ******* 2019-11-29T11:12:10.320 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-29T11:12:10.322 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.364 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.046) 0:04:08.166 ******* 2019-11-29T11:12:10.368 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-29T11:12:10.369 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.410 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.048) 0:04:08.215 ******* 2019-11-29T11:12:10.436 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T11:12:10.440 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.486 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.076) 0:04:08.291 ******* 2019-11-29T11:12:10.519 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-29T11:12:10.520 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:10.561 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.074) 0:04:08.365 ******* 2019-11-29T11:12:10.889 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-11-29T11:12:10.891 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-29T11:12:10.933 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:10 +0000 (0:00:00.372) 0:04:08.738 ******* 2019-11-29T11:12:10.982 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-29T11:12:10.983 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={u'block_used': 13034928, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227289556, u'size_available': 930978021376, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966955, u'device': u'/dev/sda1', u'inode_used': 88021, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227289556, "block_size": 4096, "block_total": 240324484, "block_used": 13034928, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966955, "inode_total": 61054976, "inode_used": 88021, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930978021376, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.024 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.090) 0:04:08.829 ******* 2019-11-29T11:12:11.074 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-29T11:12:11.075 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.112 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.087) 0:04:08.917 ******* 2019-11-29T11:12:11.138 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.181 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.069) 0:04:08.986 ******* 2019-11-29T11:12:11.187 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-29T11:12:11.187 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-29T11:12:11.232 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.051) 0:04:09.037 ******* 2019-11-29T11:12:11.239 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T11:12:11.240 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.280 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.046) 0:04:09.084 ******* 2019-11-29T11:12:11.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-29T11:12:11.311 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.346 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.066) 0:04:09.151 ******* 2019-11-29T11:12:11.372 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-29T11:12:11.374 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.411 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.064) 0:04:09.215 ******* 2019-11-29T11:12:11.451 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-11-29T11:12:11.453 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:11.509 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:11 +0000 (0:00:00.097) 0:04:09.313 ******* 2019-11-29T11:12:12.043 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-29T11:12:12.045 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-29T11:12:12.099 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:12 +0000 (0:00:00.588) 0:04:09.902 ******* 2019-11-29T11:12:12.109 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:12.542 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:12.598 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:12.997 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:13.071 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:13.422 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:13.565 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:13.873 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:13.911 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:13 +0000 (0:00:01.814) 0:04:11.716 ******* 2019-11-29T11:12:14.075 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:14.223 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-29T11:12:14.258 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:14 +0000 (0:00:00.343) 0:04:12.060 ******* 2019-11-29T11:12:14.303 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-29T11:12:14.304 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:14.550 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-29T11:12:14.590 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:14 +0000 (0:00:00.334) 0:04:12.395 ******* 2019-11-29T11:12:14.607 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-29T11:12:14.608 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:14.898 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-29T11:12:14.900 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-29T11:12:14.935 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:14 +0000 (0:00:00.344) 0:04:12.740 ******* 2019-11-29T11:12:14.939 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-29T11:12:14.940 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:14.984 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:15.224 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:15.269 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:15.522 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:15.565 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:15 +0000 (0:00:00.630) 0:04:13.370 ******* 2019-11-29T11:12:15.573 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:15.869 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:15.923 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-29T11:12:15.925 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:12:15.964 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:15 +0000 (0:00:00.399) 0:04:13.769 ******* 2019-11-29T11:12:16.012 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-29T11:12:16.014 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-29T11:12:16.059 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:16 +0000 (0:00:00.094) 0:04:13.864 ******* 2019-11-29T11:12:16.204 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi182.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-29T11:12:16.254 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:16 +0000 (0:00:00.194) 0:04:14.059 ******* 2019-11-29T11:12:16.572 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-29T11:12:16.573 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-29T11:12:16.624 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:16 +0000 (0:00:00.370) 0:04:14.429 ******* 2019-11-29T11:12:16.660 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-29T11:12:16.662 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-29T11:12:16.702 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:16 +0000 (0:00:00.078) 0:04:14.507 ******* 2019-11-29T11:12:16.803 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-29T11:12:16.805 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true} 2019-11-29T11:12:16.851 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:16 +0000 (0:00:00.148) 0:04:14.656 ******* 2019-11-29T11:12:16.853 INFO:teuthology.task.ansible.out: 2019-11-29T11:12:17.167 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true} 2019-11-29T11:12:17.207 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.353) 0:04:15.010 ******* 2019-11-29T11:12:17.606 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-29T11:12:17.608 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-29T11:12:17.652 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.447) 0:04:15.457 ******* 2019-11-29T11:12:17.680 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.716 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.063) 0:04:15.521 ******* 2019-11-29T11:12:17.722 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-29T11:12:17.723 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-29T11:12:17.765 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.048) 0:04:15.570 ******* 2019-11-29T11:12:17.770 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-29T11:12:17.771 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.810 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.044) 0:04:15.615 ******* 2019-11-29T11:12:17.820 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-29T11:12:17.822 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.858 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.048) 0:04:15.663 ******* 2019-11-29T11:12:17.864 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-29T11:12:17.866 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.903 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.044) 0:04:15.708 ******* 2019-11-29T11:12:17.911 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-29T11:12:17.912 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.949 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.046) 0:04:15.754 ******* 2019-11-29T11:12:17.960 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:17.994 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:17 +0000 (0:00:00.044) 0:04:15.799 ******* 2019-11-29T11:12:18.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.041 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.046) 0:04:15.846 ******* 2019-11-29T11:12:18.049 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.087 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.045) 0:04:15.891 ******* 2019-11-29T11:12:18.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-29T11:12:18.094 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.148 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.061) 0:04:15.952 ******* 2019-11-29T11:12:18.153 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-29T11:12:18.155 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.192 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.044) 0:04:15.997 ******* 2019-11-29T11:12:18.199 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-29T11:12:18.199 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.240 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.048) 0:04:16.045 ******* 2019-11-29T11:12:18.246 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-29T11:12:18.248 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.285 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.044) 0:04:16.090 ******* 2019-11-29T11:12:18.293 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-29T11:12:18.295 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.337 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.051) 0:04:16.142 ******* 2019-11-29T11:12:18.365 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-29T11:12:18.366 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.401 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.064) 0:04:16.206 ******* 2019-11-29T11:12:18.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-29T11:12:18.767 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.365) 0:04:16.572 ******* 2019-11-29T11:12:18.768 INFO:teuthology.task.ansible.out: 2019-11-29T11:12:18.795 INFO:teuthology.task.ansible.out: 2019-11-29T11:12:18.797 INFO:teuthology.task.ansible.out:TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.835 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.068) 0:04:16.640 ******* 2019-11-29T11:12:18.839 INFO:teuthology.task.ansible.out: 2019-11-29T11:12:18.866 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-29T11:12:18.867 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:18.908 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.072) 0:04:16.713 ******* 2019-11-29T11:12:18.948 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:18 +0000 (0:00:00.035) 0:04:16.748 ******* 2019-11-29T11:12:18.979 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-29T11:12:18.980 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:19.027 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:19 +0000 (0:00:00.083) 0:04:16.832 ******* 2019-11-29T11:12:19.075 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:19.120 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:19 +0000 (0:00:00.093) 0:04:16.925 ******* 2019-11-29T11:12:19.820 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-29T11:12:19.821 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-29T11:12:19.867 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:19 +0000 (0:00:00.747) 0:04:17.672 ******* 2019-11-29T11:12:19.894 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-29T11:12:19.896 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:19.941 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:19 +0000 (0:00:00.064) 0:04:17.737 ******* 2019-11-29T11:12:20.037 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-29T11:12:20.038 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-29T11:12:20.085 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:20 +0000 (0:00:00.147) 0:04:17.884 ******* 2019-11-29T11:12:20.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-29T11:12:20.108 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:20.148 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:20 +0000 (0:00:00.065) 0:04:17.949 ******* 2019-11-29T11:12:20.444 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-29T11:12:20.448 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "ntpdate.service system.slice syslog.target -.mount basic.target sntp.service tmp.mount systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-29T11:12:20.449 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-29T11:12:20.456 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T11:12:20.483 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:20 +0000 (0:00:00.338) 0:04:18.288 ******* 2019-11-29T11:12:20.659 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice ntpdate.service syslog.target basic.target sntp.service tmp.mount -.mount systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target multi-user.target chronyd.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-29T11:12:20.661 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127510", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127510", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-29T11:12:20.662 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-29T11:12:20.700 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:20 +0000 (0:00:00.216) 0:04:18.505 ******* 2019-11-29T11:12:21.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-29T11:12:21.436 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-29T11:12:21.483 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:21 +0000 (0:00:00.782) 0:04:19.288 ******* 2019-11-29T11:12:21.511 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:21.552 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:21 +0000 (0:00:00.068) 0:04:19.357 ******* 2019-11-29T11:12:21.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-29T11:12:21.615 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-29T11:12:21.654 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:21 +0000 (0:00:00.101) 0:04:19.459 ******* 2019-11-29T11:12:21.681 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-29T11:12:21.684 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:21.749 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:21 +0000 (0:00:00.094) 0:04:19.554 ******* 2019-11-29T11:12:21.900 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-29T11:12:21.902 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-29T11:12:21.942 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:21 +0000 (0:00:00.193) 0:04:19.747 ******* 2019-11-29T11:12:22.083 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-29T11:12:22.135 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:22 +0000 (0:00:00.192) 0:04:19.940 ******* 2019-11-29T11:12:22.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-29T11:12:22.869 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-29T11:12:22.920 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:22 +0000 (0:00:00.784) 0:04:20.725 ******* 2019-11-29T11:12:22.971 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-29T11:12:23.015 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:23 +0000 (0:00:00.095) 0:04:20.820 ******* 2019-11-29T11:12:24.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remot 2019-11-29T11:12:24.654 INFO:teuthology.task.ansible.out:o>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-29T11:12:24.693 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:01.678) 0:04:22.498 ******* 2019-11-29T11:12:24.738 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:00.044) 0:04:22.543 ******* 2019-11-29T11:12:24.744 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-29T11:12:24.744 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:24.789 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:00.051) 0:04:22.594 ******* 2019-11-29T11:12:24.796 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:24.839 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:00.050) 0:04:22.644 ******* 2019-11-29T11:12:24.847 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-29T11:12:24.849 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-29T11:12:24.889 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:00.050) 0:04:22.694 ******* 2019-11-29T11:12:24.896 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-29T11:12:24.938 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:24 +0000 (0:00:00.048) 0:04:22.743 ******* 2019-11-29T11:12:25.225 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-29T11:12:25.227 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-29T11:12:25.271 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.332) 0:04:23.076 ******* 2019-11-29T11:12:25.278 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-29T11:12:25.318 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.047) 0:04:23.123 ******* 2019-11-29T11:12:25.327 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-29T11:12:25.327 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:25.376 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.058) 0:04:23.181 ******* 2019-11-29T11:12:25.392 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:25.431 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.054) 0:04:23.236 ******* 2019-11-29T11:12:25.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi114.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-29T11:12:25.478 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.047) 0:04:23.283 ******* 2019-11-29T11:12:25.484 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-29T11:12:25.522 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.044) 0:04:23.327 ******* 2019-11-29T11:12:25.528 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-29T11:12:25.530 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:25.584 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.061) 0:04:23.389 ******* 2019-11-29T11:12:25.590 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:25.627 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.043) 0:04:23.432 ******* 2019-11-29T11:12:25.901 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-29T11:12:25.902 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-29T11:12:25.944 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.310) 0:04:23.743 ******* 2019-11-29T11:12:25.958 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-29T11:12:25.998 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:25 +0000 (0:00:00.059) 0:04:23.803 ******* 2019-11-29T11:12:26.280 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-29T11:12:26.282 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-29T11:12:26.329 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.331) 0:04:24.134 ******* 2019-11-29T11:12:26.348 INFO:teuthology.task.ansible.out:changed: [smithi182.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-29T11:12:26.393 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.064) 0:04:24.198 ******* 2019-11-29T11:12:26.408 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.442 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.048) 0:04:24.247 ******* 2019-11-29T11:12:26.458 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.517 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.074) 0:04:24.322 ******* 2019-11-29T11:12:26.524 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-29T11:12:26.526 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.528 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.585 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.067) 0:04:24.390 ******* 2019-11-29T11:12:26.594 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.596 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.648 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.063) 0:04:24.453 ******* 2019-11-29T11:12:26.654 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-29T11:12:26.655 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.656 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi114.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.658 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.660 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.721 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.071) 0:04:24.525 ******* 2019-11-29T11:12:26.734 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi182.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reaso 2019-11-29T11:12:26.736 INFO:teuthology.task.ansible.out:n": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.773 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.050) 0:04:24.575 ******* 2019-11-29T11:12:26.775 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-29T11:12:26.776 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.820 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.049) 0:04:24.625 ******* 2019-11-29T11:12:26.829 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.872 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.052) 0:04:24.677 ******* 2019-11-29T11:12:26.878 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-29T11:12:26.880 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.937 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.060) 0:04:24.737 ******* 2019-11-29T11:12:26.945 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:26.981 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:26 +0000 (0:00:00.049) 0:04:24.786 ******* 2019-11-29T11:12:26.988 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-29T11:12:26.988 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.031 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.049) 0:04:24.836 ******* 2019-11-29T11:12:27.038 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.081 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.049) 0:04:24.885 ******* 2019-11-29T11:12:27.088 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.126 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.045) 0:04:24.930 ******* 2019-11-29T11:12:27.132 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.173 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.047) 0:04:24.978 ******* 2019-11-29T11:12:27.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.224 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.047) 0:04:25.026 ******* 2019-11-29T11:12:27.227 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.275 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.054) 0:04:25.080 ******* 2019-11-29T11:12:27.285 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-29T11:12:27.285 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.328 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.052) 0:04:25.133 ******* 2019-11-29T11:12:27.334 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.375 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.047) 0:04:25.180 ******* 2019-11-29T11:12:27.381 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-29T11:12:27.383 INFO:teuthology.task.ansible.out:skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.428 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.052) 0:04:25.232 ******* 2019-11-29T11:12:27.441 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.478 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.050) 0:04:25.283 ******* 2019-11-29T11:12:27.484 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi114.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.536 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.055) 0:04:25.338 ******* 2019-11-29T11:12:27.543 INFO:teuthology.task.ansible.out:skipping: [smithi182.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-29T11:12:27.577 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:27 +0000 (0:00:00.043) 0:04:25.382 ******* 2019-11-29T11:12:27.884 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi114.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.013223", "end": "2019-11-29 11:12:27.845431", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-29 11:12:27.832208", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:28.199 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006534", "end": "2019-11-29 11:12:28.148708", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-29 11:12:28.142174", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:28.510 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006861", "end": "2019-11-29 11:12:28.467656", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 11:12:28.460795", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:28.870 INFO:teuthology.task.ansible.out:ok: [smithi114.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.046041", "end": "2019-11-29 11:12:28.814209", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-29 11:12:28.768168", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:28.931 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:28 +0000 (0:00:01.354) 0:04:26.736 ******* 2019-11-29T11:12:28.954 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.017212", "end": "2019-11-29 11:12:28.897070", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-29 11:12:27.879858", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:28.956 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-29T11:12:29.012 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:29 +0000 (0:00:00.080) 0:04:26.817 ******* 2019-11-29T11:12:29.259 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-29T11:12:29.261 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006735", "end": "2019-11-29 11:12:29.224008", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-29 11:12:29.217273", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:29.322 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-29T11:12:29.324 INFO:teuthology.task.ansible.out:changed: [smithi114.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T11:12:29.568 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-29T11:12:29.570 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007055", "end": "2019-11-29 11:12:29.527384", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-29 11:12:29.520329", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:30.921 INFO:teuthology.task.ansible.out:ok: [smithi182.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.033403", "end": "2019-11-29 11:12:30.879608", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-29 11:12:29.846205", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-29T11:12:30.960 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:30 +0000 (0:00:01.948) 0:04:28.765 ******* 2019-11-29T11:12:30.997 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-29T11:12:31.039 INFO:teuthology.task.ansible.out:Friday 29 November 2019 11:12:31 +0000 (0:00:00.078) 0:04:28.844 ******* 2019-11-29T11:12:31.360 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi182.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-29T11:12:31.494 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-11-29T11:12:31.498 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-29T11:12:31.503 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi114.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi182.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 Friday 29 November 2019 11:12:31 +0000 (0:00:00.461) 0:04:29.305 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 39.42s users : Update authorized_keys using the keys repo --------------------- 38.51s testnode : Install packages -------------------------------------------- 16.54s common : Update yum cache ---------------------------------------------- 11.86s testnode : Ensure ceph packages are not present. ------------------------ 9.12s users : Remove revoked users -------------------------------------------- 8.81s common : nrpe - Remove SELinux policy package --------------------------- 8.36s testnode : Zap all non-root disks --------------------------------------- 7.82s common : nrpe - Load SELinux policy package ----------------------------- 6.93s Gathering Facts --------------------------------------------------------- 3.36s common : Make sure smartmontools is installed --------------------------- 3.33s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.94s ansible-managed : Add authorized keys for the ansible user. ------------- 2.79s users : Update authorized_keys for each user with literal keys ---------- 2.49s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.29s testnode : Ensure ceph dependency packages are not present. ------------- 2.25s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.22s com 2019-11-29T11:12:31.504 INFO:teuthology.task.ansible.out:mon : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 2.15s common : Configure local epel mirrorlists ------------------------------- 2.06s testnode : Create logical volume(s) ------------------------------------- 1.81s 2019-11-29T11:12:31.802 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi182.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2019-11-29T11:12:31.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:12:31.806 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi182.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:12:31.924 INFO:teuthology.orchestra.run.smithi182:> true 2019-11-29T11:12:32.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-29T11:12:32.294 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi114.front.sepia.ceph.com', 'timeout': 60} 2019-11-29T11:12:32.400 INFO:teuthology.orchestra.run.smithi114:> true 2019-11-29T11:12:32.762 INFO:teuthology.run_tasks:Running task clock... 2019-11-29T11:12:32.826 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-29T11:12:32.827 INFO:teuthology.orchestra.run.smithi182:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-29T11:12:32.964 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-29T11:12:43.054 INFO:teuthology.orchestra.run.smithi182.stdout:ntpd: time slew -0.002355s 2019-11-29T11:12:43.093 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntp.service: Unit not found. 2019-11-29T11:12:43.215 INFO:teuthology.orchestra.run.smithi182.stdout: remote refid st t when poll reach delay offset jitter 2019-11-29T11:12:43.216 INFO:teuthology.orchestra.run.smithi182.stdout:============================================================================== 2019-11-29T11:12:43.216 INFO:teuthology.orchestra.run.smithi182.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:43.216 INFO:teuthology.orchestra.run.smithi182.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:43.216 INFO:teuthology.orchestra.run.smithi182.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:43.216 INFO:teuthology.orchestra.run.smithi182.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:43.217 INFO:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-29T11:12:43.363 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-29T11:12:53.447 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.000362s 2019-11-29T11:12:53.487 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit not found. 2019-11-29T11:12:53.613 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2019-11-29T11:12:53.613 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2019-11-29T11:12:53.613 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:53.614 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:53.615 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:53.615 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-29T11:12:53.615 INFO:teuthology.run_tasks:Running task install... 2019-11-29T11:12:53.637 DEBUG:teuthology.task.install:project ceph 2019-11-29T11:12:53.637 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}} 2019-11-29T11:12:53.637 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'} 2019-11-29T11:12:53.637 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-29T11:12:53.642 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-29T11:12:53.642 INFO:teuthology.task.install:extra packages: [] 2019-11-29T11:12:53.643 INFO:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2019-11-29T11:12:53.806 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS 2019-11-29T11:12:53.806 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:12:53.806 INFO:teuthology.orchestra.run.smithi114:> sudo lsb_release -is 2019-11-29T11:12:53.807 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-29T11:12:53.807 INFO:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2019-11-29T11:12:53.944 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS 2019-11-29T11:12:53.946 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:12:53.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:12:53.963 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS 2019-11-29T11:12:53.965 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:12:53.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-29T11:12:53.965 INFO:teuthology.orchestra.run.smithi114:> sudo lsb_release -is 2019-11-29T11:12:54.104 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS 2019-11-29T11:12:54.106 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:12:54.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:12:54.113 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuval-master/656c8e8049c2c1acd363143c842c2edf1fe09b64/centos/7/flavors/notcmalloc/ 2019-11-29T11:12:54.114 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7809.g656c8e8 2019-11-29T11:12:54.244 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-29T11:12:54.276 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuval-master/656c8e8049c2c1acd363143c842c2edf1fe09b64/centos/7/flavors/notcmalloc/ 2019-11-29T11:12:54.277 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7809.g656c8e8 2019-11-29T11:12:54.366 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-29T11:12:54.366 INFO:teuthology.orchestra.run.smithi182:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/656c8e8049c2c1acd363143c842c2edf1fe09b64/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-29T11:12:54.396 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-29T11:12:54.475 INFO:teuthology.orchestra.run.smithi182:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-29T11:12:54.516 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-29T11:12:54.516 INFO:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/656c8e8049c2c1acd363143c842c2edf1fe09b64/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-29T11:12:54.568 INFO:teuthology.orchestra.run.smithi182:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-29T11:12:54.627 INFO:teuthology.orchestra.run.smithi114:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-29T11:12:54.665 INFO:teuthology.orchestra.run.smithi182.stdout:check_obsoletes = 1 2019-11-29T11:12:54.667 INFO:teuthology.orchestra.run.smithi182:> sudo yum clean all 2019-11-29T11:12:54.713 INFO:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-29T11:12:54.790 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2019-11-29T11:12:54.792 INFO:teuthology.orchestra.run.smithi114:> sudo yum clean all 2019-11-29T11:12:54.843 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:12:54.881 INFO:teuthology.orchestra.run.smithi182.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-29T11:12:54.881 INFO:teuthology.orchestra.run.smithi182.stdout: : lab-extras updates 2019-11-29T11:12:54.925 INFO:teuthology.orchestra.run.smithi182.stdout:Cleaning up list of fastest mirrors 2019-11-29T11:12:54.925 INFO:teuthology.orchestra.run.smithi182.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-29T11:12:54.938 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-radosgw 2019-11-29T11:12:54.971 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:12:55.009 INFO:teuthology.orchestra.run.smithi114.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-29T11:12:55.009 INFO:teuthology.orchestra.run.smithi114.stdout: : lab-extras updates 2019-11-29T11:12:55.053 INFO:teuthology.orchestra.run.smithi114.stdout:Cleaning up list of fastest mirrors 2019-11-29T11:12:55.054 INFO:teuthology.orchestra.run.smithi114.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-29T11:12:55.067 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw 2019-11-29T11:12:55.170 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:12:55.212 INFO:teuthology.orchestra.run.smithi182.stdout:Determining fastest mirrors 2019-11-29T11:12:55.227 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:12:55.264 INFO:teuthology.orchestra.run.smithi114.stdout:Determining fastest mirrors 2019-11-29T11:12:55.953 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:12:55.955 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:12:55.955 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:12:55.957 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:12:55.958 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:12:55.958 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:12:55.958 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:12:55.958 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:13:03.612 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:03.813 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:03.963 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:13:03.963 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:03.963 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:03.975 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.084 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.085 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.086 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.088 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.088 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.090 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.090 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.092 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.093 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:04.093 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.101 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.103 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.104 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.105 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.106 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.107 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.109 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-29T11:13:04.110 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-29T11:13:04.111 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T11:13:04.136 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T11:13:04.136 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-29T11:13:04.136 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.136 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:04.145 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.146 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.146 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.146 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.146 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.146 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.147 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.147 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.148 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.148 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.148 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.148 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.148 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T11:13:04.149 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:04.150 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-29T11:13:04.150 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.150 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.150 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.151 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.151 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-29T11:13:04.151 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.151 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.152 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.152 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-29T11:13:04.164 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:13:04.164 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:04.165 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.177 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.285 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.286 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.287 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.289 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.289 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.291 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.291 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.293 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.294 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:04.294 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.302 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.304 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.305 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.306 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.307 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.308 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.310 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-29T11:13:04.311 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-29T11:13:04.311 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T11:13:04.312 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T11:13:04.314 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-29T11:13:04.315 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.316 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:04.316 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.320 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.321 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.322 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.323 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.324 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.325 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.326 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.327 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.328 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.328 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.329 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:04.329 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-29T11:13:04.329 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.331 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-29T11:13:04.331 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be an update 2019-11-29T11:13:04.331 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-29T11:13:04.332 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T11:13:04.334 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-29T11:13:04.334 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:04.335 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-29T11:13:04.335 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.335 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.336 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.336 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.337 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-29T11:13:04.337 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.338 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.338 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:04.338 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-29T11:13:04.996 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:05.081 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:05.081 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:13:05.084 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 6.2 M 2019-11-29T11:13:05.085 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.6 M 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 19 M 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 20 k 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 490 k 2019-11-29T11:13:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 374 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.4 M 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-argparse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 35 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 42 k 2019-11-29T11:13:05.087 INFO:teuthology.orchestra.run.smithi182.stdout: python-cephfs x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 102 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: python-rados x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 209 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: python-rbd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 199 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: python-rgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 77 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout:Updating for dependencies: 2019-11-29T11:13:05.088 INFO:teuthology.orchestra.run.smithi182.stdout: librados2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 3.5 M 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.8 M 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+20 Dependent packages) 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout:Upgrade ( 2 Dependent packages) 2019-11-29T11:13:05.089 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:05.090 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 45 M 2019-11-29T11:13:05.090 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:13:05.090 INFO:teuthology.orchestra.run.smithi182.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T11:13:05.192 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:05.277 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:05.277 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:13:05.285 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:05.285 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:05.285 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:13:05.285 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:13:05.285 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 6.2 M 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.6 M 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 19 M 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 20 k 2019-11-29T11:13:05.286 INFO:teuthology.orchestra.run.smithi114.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 490 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 374 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-29T11:13:05.287 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 5.4 M 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-argparse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 35 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-common x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 42 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-cephfs x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 102 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-rados x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 209 k 2019-11-29T11:13:05.288 INFO:teuthology.orchestra.run.smithi114.stdout: python-rbd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 199 k 2019-11-29T11:13:05.289 INFO:teuthology.orchestra.run.smithi114.stdout: python-rgw x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 77 k 2019-11-29T11:13:05.289 INFO:teuthology.orchestra.run.smithi114.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-29T11:13:05.289 INFO:teuthology.orchestra.run.smithi114.stdout:Updating for dependencies: 2019-11-29T11:13:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 3.5 M 2019-11-29T11:13:05.295 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.8 M 2019-11-29T11:13:05.296 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:05.296 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:13:05.296 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:05.296 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+20 Dependent packages) 2019-11-29T11:13:05.297 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade ( 2 Dependent packages) 2019-11-29T11:13:05.297 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:05.297 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 45 M 2019-11-29T11:13:05.298 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:13:05.298 INFO:teuthology.orchestra.run.smithi114.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-29T11:13:10.087 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:10.087 INFO:teuthology.orchestra.run.smithi114.stdout:Total 9.3 MB/s | 45 MB 00:04 2019-11-29T11:13:10.114 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:13:10.150 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:13:10.417 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:13:10.417 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:13:11.264 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T11:13:11.659 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-29T11:13:11.993 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-29T11:13:12.267 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T11:13:12.596 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-29T11:13:12.935 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-29T11:13:13.277 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:13.278 INFO:teuthology.orchestra.run.smithi182.stdout:Total 5.4 MB/s | 45 MB 00:08 2019-11-29T11:13:13.292 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:13:13.360 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:13:13.643 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:13:13.643 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:13:13.729 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-29T11:13:14.115 INFO:teuthology.orchestra.run.smithi114.stdout: Updating : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T11:13:14.338 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T11:13:14.621 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T11:13:14.674 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-29T11:13:15.010 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-29T11:13:15.275 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T11:13:15.587 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-29T11:13:15.904 INFO:teuthology.orchestra.run.smithi114.stdout: Updating : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T11:13:15.969 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-29T11:13:16.233 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T11:13:16.539 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 12/25 2019-11-29T11:13:16.773 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 13/25 2019-11-29T11:13:17.054 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T11:13:17.128 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-29T11:13:17.385 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T11:13:17.541 INFO:teuthology.orchestra.run.smithi182.stdout: Updating : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T11:13:17.691 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T11:13:17.984 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T11:13:18.049 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T11:13:18.281 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 18/25 2019-11-29T11:13:18.944 INFO:teuthology.orchestra.run.smithi182.stdout: Updating : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T11:13:19.274 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T11:13:19.583 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 12/25 2019-11-29T11:13:19.839 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 13/25 2019-11-29T11:13:20.135 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T11:13:20.462 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T11:13:20.725 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-29T11:13:20.746 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T11:13:21.019 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T11:13:21.338 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 18/25 2019-11-29T11:13:21.877 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T11:13:22.426 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 21/25 2019-11-29T11:13:23.833 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-29T11:13:24.945 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T11:13:25.479 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 21/25 2019-11-29T11:13:31.718 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T11:13:32.136 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T11:13:32.400 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T11:13:32.680 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T11:13:32.812 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T11:13:32.934 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/25 2019-11-29T11:13:33.076 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 3/25 2019-11-29T11:13:33.160 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T11:13:33.269 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 5/25 2019-11-29T11:13:33.353 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 6/25 2019-11-29T11:13:33.437 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-29T11:13:33.521 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T11:13:33.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T11:13:33.772 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T11:13:33.889 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T11:13:33.989 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 12/25 2019-11-29T11:13:34.107 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-29T11:13:34.257 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T11:13:34.391 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T11:13:34.509 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T11:13:34.626 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T11:13:34.734 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 18/25 2019-11-29T11:13:34.835 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 19/25 2019-11-29T11:13:34.876 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T11:13:34.969 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T11:13:35.044 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-29T11:13:35.128 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T11:13:35.212 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T11:13:35.213 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T11:13:35.270 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T11:13:35.509 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T11:13:35.611 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:13:35.612 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.613 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.613 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.613 INFO:teuthology.orchestra.run.smithi114.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-29T11:13:35.613 INFO:teuthology.orchestra.run.smithi114.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-29T11:13:35.613 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.614 INFO:teuthology.orchestra.run.smithi114.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-29T11:13:35.614 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-29T11:13:35.614 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.614 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-29T11:13:35.615 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.615 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-29T11:13:35.616 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.616 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.616 INFO:teuthology.orchestra.run.smithi114.stdout: python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.616 INFO:teuthology.orchestra.run.smithi114.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-29T11:13:35.616 INFO:teuthology.orchestra.run.smithi114.stdout: python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.617 INFO:teuthology.orchestra.run.smithi114.stdout: python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.617 INFO:teuthology.orchestra.run.smithi114.stdout: python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.617 INFO:teuthology.orchestra.run.smithi114.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-29T11:13:35.617 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:35.617 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Updated: 2019-11-29T11:13:35.619 INFO:teuthology.orchestra.run.smithi114.stdout: librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.619 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:35.620 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:35.620 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:13:35.745 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-test 2019-11-29T11:13:35.809 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T11:13:35.934 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-29T11:13:36.047 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:13:36.059 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 2/25 2019-11-29T11:13:36.092 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:13:36.093 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:13:36.094 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:13:36.176 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:libradosstriper1-15.0.0-7809.g656c8e8.el7.x86_64 3/25 2019-11-29T11:13:36.269 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 4/25 2019-11-29T11:13:36.394 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7809.g656c8e8.el7.x86_64 5/25 2019-11-29T11:13:36.512 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-radosgw-15.0.0-7809.g656c8e8.el7.x86_64 6/25 2019-11-29T11:13:36.612 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-29T11:13:36.712 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 8/25 2019-11-29T11:13:36.733 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:36.805 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:librgw2-15.0.0-7809.g656c8e8.el7.x86_64 9/25 2019-11-29T11:13:36.905 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-rados-15.0.0-7809.g656c8e8.el7.x86_64 10/25 2019-11-29T11:13:36.989 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-base-15.0.0-7809.g656c8e8.el7.x86_64 11/25 2019-11-29T11:13:37.067 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:13:37.068 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:37.068 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:37.082 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 12/25 2019-11-29T11:13:37.085 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:37.115 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:37.116 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:37.117 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:37.117 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-29T11:13:37.117 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-29T11:13:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-29T11:13:37.120 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-29T11:13:37.122 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:37.122 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-29T11:13:37.182 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 13/25 2019-11-29T11:13:37.316 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 14/25 2019-11-29T11:13:37.433 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-rbd-15.0.0-7809.g656c8e8.el7.x86_64 15/25 2019-11-29T11:13:37.481 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:37.564 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-common-15.0.0-7809.g656c8e8.el7.x86_64 16/25 2019-11-29T11:13:37.668 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-29T11:13:37.700 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:37.700 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:13:37.700 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 38 M 2019-11-29T11:13:37.701 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:13:37.702 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-29T11:13:37.702 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-29T11:13:37.702 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-29T11:13:37.702 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-29T11:13:37.702 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:37.703 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:13:37.703 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:37.703 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:13:37.703 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:37.704 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 38 M 2019-11-29T11:13:37.704 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 134 M 2019-11-29T11:13:37.704 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:13:37.768 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 18/25 2019-11-29T11:13:37.886 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 19/25 2019-11-29T11:13:38.028 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-selinux-15.0.0-7809.g656c8e8.el7.x86_64 20/25 2019-11-29T11:13:38.128 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-29T11:13:38.237 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-cephfs-15.0.0-7809.g656c8e8.el7.x86_64 22/25 2019-11-29T11:13:38.321 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-rgw-15.0.0-7809.g656c8e8.el7.x86_64 23/25 2019-11-29T11:13:38.322 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-29T11:13:38.653 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-29T11:13:38.655 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:38.655 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-radosgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-base.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-selinux.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.656 INFO:teuthology.orchestra.run.smithi182.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: libradosstriper1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-29T11:13:38.657 INFO:teuthology.orchestra.run.smithi182.stdout: librgw2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-argparse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-common.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-cephfs.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-rados.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-rbd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.658 INFO:teuthology.orchestra.run.smithi182.stdout: python-rgw.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Updated: 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout: librados2.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout: librbd1.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:38.659 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:13:38.773 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-test 2019-11-29T11:13:39.038 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:13:39.079 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:13:39.079 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:13:39.080 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:13:39.080 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:13:39.080 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:13:39.649 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:39.649 INFO:teuthology.orchestra.run.smithi114.stdout:Total 20 MB/s | 38 MB 00:01 2019-11-29T11:13:39.651 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:13:39.672 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:13:39.720 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:39.726 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:13:39.727 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:13:40.045 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:13:40.045 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:40.046 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:40.063 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:40.092 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:40.093 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:40.094 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:40.094 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-29T11:13:40.095 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-29T11:13:40.096 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-29T11:13:40.099 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-29T11:13:40.100 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:40.101 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-29T11:13:40.409 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-29T11:13:40.462 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:40.685 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:40.685 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:13:40.686 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:40.686 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:40.686 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 38 M 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-29T11:13:40.687 INFO:teuthology.orchestra.run.smithi182.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:40.688 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:13:40.689 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:40.689 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 38 M 2019-11-29T11:13:40.689 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 134 M 2019-11-29T11:13:40.689 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:13:40.725 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-29T11:13:41.029 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-29T11:13:42.869 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:42.869 INFO:teuthology.orchestra.run.smithi182.stdout:Total 18 MB/s | 38 MB 00:02 2019-11-29T11:13:42.871 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:13:42.898 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:13:42.965 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:13:42.966 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:13:43.647 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-29T11:13:43.926 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-29T11:13:44.254 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-29T11:13:45.044 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-29T11:13:45.429 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T11:13:45.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T11:13:45.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-11-29T11:13:45.773 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-11-29T11:13:45.873 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-29T11:13:46.415 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-29T11:13:46.416 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:46.416 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:13:46.416 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:46.416 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi114.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi114.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-29T11:13:46.417 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:46.418 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:13:46.528 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph 2019-11-29T11:13:46.802 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:13:46.848 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:13:46.849 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:13:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:13:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:13:46.850 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:13:47.495 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:47.835 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:13:47.835 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.835 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:47.837 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.866 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.867 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.868 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.870 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.870 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:47.880 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:47.882 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.883 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.885 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.886 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.887 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.888 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:47.889 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:47.891 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:47.896 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.896 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-29T11:13:47.897 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-29T11:13:47.897 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-29T11:13:47.898 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:47.899 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:47.900 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:47.901 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:47.901 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:47.902 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-29T11:13:47.903 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-29T11:13:47.904 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-29T11:13:47.904 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-29T11:13:47.904 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-29T11:13:47.905 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.906 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-29T11:13:47.906 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-29T11:13:47.916 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-29T11:13:47.917 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-29T11:13:47.917 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.917 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-29T11:13:47.917 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-29T11:13:47.918 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-29T11:13:47.918 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.918 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-29T11:13:47.918 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-29T11:13:47.919 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:13:47.919 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-29T11:13:48.214 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-29T11:13:48.269 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:48.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:48.490 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:13:48.494 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:48.494 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:48.494 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:13:48.495 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:13:48.496 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:48.496 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:13:48.496 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.0 k 2019-11-29T11:13:48.497 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:13:48.497 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.9 M 2019-11-29T11:13:48.497 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.7 M 2019-11-29T11:13:48.497 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 4.3 M 2019-11-29T11:13:48.498 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 16 M 2019-11-29T11:13:48.498 INFO:teuthology.orchestra.run.smithi114.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-29T11:13:48.498 INFO:teuthology.orchestra.run.smithi114.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-29T11:13:48.498 INFO:teuthology.orchestra.run.smithi114.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-29T11:13:48.498 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-29T11:13:48.499 INFO:teuthology.orchestra.run.smithi114.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-29T11:13:48.499 INFO:teuthology.orchestra.run.smithi114.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-29T11:13:48.499 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-29T11:13:48.499 INFO:teuthology.orchestra.run.smithi114.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-29T11:13:48.499 INFO:teuthology.orchestra.run.smithi114.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-29T11:13:48.500 INFO:teuthology.orchestra.run.smithi114.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-29T11:13:48.500 INFO:teuthology.orchestra.run.smithi114.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-29T11:13:48.500 INFO:teuthology.orchestra.run.smithi114.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-29T11:13:48.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+21 Dependent packages) 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 28 M 2019-11-29T11:13:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 87 M 2019-11-29T11:13:48.503 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:13:48.505 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T11:13:48.596 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-test-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T11:13:48.688 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-11-29T11:13:48.822 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-11-29T11:13:48.939 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-11-29T11:13:49.449 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-11-29T11:13:49.449 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:49.449 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-test.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-29T11:13:49.450 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:49.451 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:13:49.584 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph 2019-11-29T11:13:49.816 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:13:49.860 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:13:49.861 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:13:49.861 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:13:49.861 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:13:49.862 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:13:49.872 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:49.872 INFO:teuthology.orchestra.run.smithi114.stdout:Total 20 MB/s | 28 MB 00:01 2019-11-29T11:13:49.896 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:13:49.951 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:13:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:13:50.312 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:13:50.504 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:13:50.836 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:13:50.837 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.837 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:50.839 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.869 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.870 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.871 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.872 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.872 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:50.882 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:50.884 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.886 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.887 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.888 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.889 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.890 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:13:50.891 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:50.894 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:13:50.898 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.898 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-29T11:13:50.899 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-29T11:13:50.900 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-29T11:13:50.900 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:50.901 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:50.902 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:50.903 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:50.904 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-29T11:13:50.905 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-29T11:13:50.905 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-29T11:13:50.907 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-29T11:13:50.907 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-29T11:13:50.907 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-29T11:13:50.908 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.908 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-29T11:13:50.908 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T11:13:50.909 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-29T11:13:50.910 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-29T11:13:50.910 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-29T11:13:50.910 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-29T11:13:50.911 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-29T11:13:50.911 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-29T11:13:50.911 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-29T11:13:50.911 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.912 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-29T11:13:50.912 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-29T11:13:50.912 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-29T11:13:50.913 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.913 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-29T11:13:50.913 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-29T11:13:50.913 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:13:50.914 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-29T11:13:51.277 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:13:51.314 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-29T11:13:51.497 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:51.498 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:13:51.500 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:51.500 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:51.501 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:13:51.501 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:13:51.501 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:51.501 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:13:51.501 INFO:teuthology.orchestra.run.smithi182.stdout: ceph x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.0 k 2019-11-29T11:13:51.503 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:13:51.503 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.9 M 2019-11-29T11:13:51.503 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 1.7 M 2019-11-29T11:13:51.503 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 4.3 M 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 16 M 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-29T11:13:51.504 INFO:teuthology.orchestra.run.smithi182.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-29T11:13:51.505 INFO:teuthology.orchestra.run.smithi182.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-29T11:13:51.506 INFO:teuthology.orchestra.run.smithi182.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-29T11:13:51.506 INFO:teuthology.orchestra.run.smithi182.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-29T11:13:51.507 INFO:teuthology.orchestra.run.smithi182.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-29T11:13:51.507 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:51.507 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:13:51.507 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:13:51.508 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+21 Dependent packages) 2019-11-29T11:13:51.508 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:13:51.508 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 28 M 2019-11-29T11:13:51.508 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 87 M 2019-11-29T11:13:51.509 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:13:51.617 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-29T11:13:52.990 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:13:52.990 INFO:teuthology.orchestra.run.smithi182.stdout:Total 19 MB/s | 28 MB 00:01 2019-11-29T11:13:53.014 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:13:53.059 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:13:53.365 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:13:53.365 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:13:53.454 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-29T11:13:53.863 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 4/22 2019-11-29T11:13:54.127 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-29T11:13:54.358 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-29T11:13:54.425 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-29T11:13:54.733 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-29T11:13:55.621 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-29T11:13:56.122 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-29T11:13:56.245 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-29T11:13:56.421 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-29T11:13:57.008 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-11-29T11:13:57.266 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 4/22 2019-11-29T11:13:57.360 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 11/22 2019-11-29T11:13:57.564 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/22 2019-11-29T11:13:57.730 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 5/22 2019-11-29T11:13:57.881 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/22 2019-11-29T11:13:58.082 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 6/22 2019-11-29T11:13:58.200 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-29T11:13:58.473 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 7/22 2019-11-29T11:13:58.992 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 8/22 2019-11-29T11:13:59.004 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-29T11:13:59.297 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 9/22 2019-11-29T11:13:59.395 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 16/22 2019-11-29T11:13:59.807 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/22 2019-11-29T11:13:59.819 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 10/22 2019-11-29T11:14:00.126 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-mako-0.8.1-2.el7.noarch 18/22 2019-11-29T11:14:00.185 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 11/22 2019-11-29T11:14:00.432 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-six-1.9.0-0.el7.noarch 12/22 2019-11-29T11:14:00.524 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-29T11:14:00.731 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 13/22 2019-11-29T11:14:01.035 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-29T11:14:01.157 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-29T11:14:01.580 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 21/22 2019-11-29T11:14:01.814 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-29T11:14:01.859 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T11:14:01.964 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-29T11:14:02.064 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/22 2019-11-29T11:14:02.148 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 16/22 2019-11-29T11:14:02.198 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-29T11:14:02.290 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-29T11:14:02.382 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 5/22 2019-11-29T11:14:02.457 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-29T11:14:02.531 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 17/22 2019-11-29T11:14:02.533 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-29T11:14:02.633 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 8/22 2019-11-29T11:14:02.751 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 9/22 2019-11-29T11:14:02.863 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 10/22 2019-11-29T11:14:02.878 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-mako-0.8.1-2.el7.noarch 18/22 2019-11-29T11:14:02.986 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 11/22 2019-11-29T11:14:03.095 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 12/22 2019-11-29T11:14:03.194 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-29T11:14:03.259 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-29T11:14:03.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 14/22 2019-11-29T11:14:03.469 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-11-29T11:14:03.595 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-29T11:14:03.695 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-29T11:14:03.796 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-29T11:14:03.930 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-29T11:14:03.943 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-29T11:14:04.089 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-29T11:14:04.189 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-11-29T11:14:04.384 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 21/22 2019-11-29T11:14:04.602 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T11:14:04.602 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:04.602 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:04.602 INFO:teuthology.orchestra.run.smithi114.stdout: ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:04.603 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:04.603 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:04.603 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:04.603 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:04.604 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:04.604 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:04.604 INFO:teuthology.orchestra.run.smithi114.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-29T11:14:04.604 INFO:teuthology.orchestra.run.smithi114.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-29T11:14:04.605 INFO:teuthology.orchestra.run.smithi114.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-29T11:14:04.606 INFO:teuthology.orchestra.run.smithi114.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-29T11:14:04.607 INFO:teuthology.orchestra.run.smithi114.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-29T11:14:04.607 INFO:teuthology.orchestra.run.smithi114.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-29T11:14:04.607 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:04.607 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:04.629 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T11:14:04.742 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-29T11:14:04.742 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-daemon 2019-11-29T11:14:04.854 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 2/22 2019-11-29T11:14:04.975 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-29T11:14:04.982 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:05.021 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:05.022 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:05.022 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:05.022 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:05.023 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:05.059 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-11-29T11:14:05.166 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mon-15.0.0-7809.g656c8e8.el7.x86_64 5/22 2019-11-29T11:14:05.243 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-11-29T11:14:05.327 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 7/22 2019-11-29T11:14:05.428 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 8/22 2019-11-29T11:14:05.544 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-15.0.0-7809.g656c8e8.el7.x86_64 9/22 2019-11-29T11:14:05.648 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:05.661 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mds-15.0.0-7809.g656c8e8.el7.x86_64 10/22 2019-11-29T11:14:05.812 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 11/22 2019-11-29T11:14:05.912 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 12/22 2019-11-29T11:14:05.970 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:05.971 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:05.971 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:06.024 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 13/22 2019-11-29T11:14:06.147 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 14/22 2019-11-29T11:14:06.272 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-11-29T11:14:06.336 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:06.398 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-29T11:14:06.519 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-29T11:14:06.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:06.558 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:06.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:06.559 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:06.559 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-daemon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:06.560 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:06.561 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:06.561 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2019-11-29T11:14:06.561 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:06.561 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 17 k 2019-11-29T11:14:06.561 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 68 k 2019-11-29T11:14:06.562 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:06.625 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-29T11:14:06.845 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:06.848 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:06.855 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:06.855 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:06.925 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-29T11:14:07.008 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-29T11:14:07.109 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 21/22 2019-11-29T11:14:07.529 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-osd-15.0.0-7809.g656c8e8.el7.x86_64 22/22 2019-11-29T11:14:07.529 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout: ceph.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mds.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:07.530 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-osd.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-29T11:14:07.531 INFO:teuthology.orchestra.run.smithi182.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-29T11:14:07.532 INFO:teuthology.orchestra.run.smithi182.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-29T11:14:07.533 INFO:teuthology.orchestra.run.smithi182.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-29T11:14:07.533 INFO:teuthology.orchestra.run.smithi182.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-29T11:14:07.533 INFO:teuthology.orchestra.run.smithi182.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-29T11:14:07.533 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:07.533 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:07.609 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:14:07.663 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-daemon 2019-11-29T11:14:07.922 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:07.952 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:07.953 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:07.954 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:07.954 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:07.954 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:08.121 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:08.122 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:08.242 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr 2019-11-29T11:14:08.491 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:08.534 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:08.535 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:08.536 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:08.615 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:08.941 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:08.942 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:08.942 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:09.181 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:09.307 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout:Package 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:14:09.512 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do 2019-11-29T11:14:09.532 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:09.532 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:09.533 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-daemon x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 17 k 2019-11-29T11:14:09.534 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 68 k 2019-11-29T11:14:09.535 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:09.571 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-dashboard 2019-11-29T11:14:09.815 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:09.844 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:09.854 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:09.854 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:09.855 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:09.861 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:09.862 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:10.507 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:10.677 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:14:10.847 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:10.848 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:10.875 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-29T11:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-29T11:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:10.876 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-29T11:14:11.083 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-daemon-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:14:11.084 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:11.084 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:11.084 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-daemon.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:11.084 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:11.084 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:11.213 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr 2019-11-29T11:14:11.241 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:11.465 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:11.466 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:11.466 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:11.467 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:14:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:11.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 3.9 M 2019-11-29T11:14:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:11.468 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 18 k 2019-11-29T11:14:11.468 INFO:teuthology.orchestra.run.smithi114.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-29T11:14:11.469 INFO:teuthology.orchestra.run.smithi114.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-29T11:14:11.469 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+3 Dependent packages) 2019-11-29T11:14:11.470 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 4.6 M 2019-11-29T11:14:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 20 M 2019-11-29T11:14:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:11.488 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:11.526 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:11.527 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:11.528 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:11.528 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:11.528 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:Total 7.4 MB/s | 4.6 MB 00:00 2019-11-29T11:14:12.088 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:12.098 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:12.169 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:12.294 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:12.294 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:12.509 INFO:teuthology.orchestra.run.smithi182.stdout:Package 2:ceph-mgr-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:14:12.509 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do 2019-11-29T11:14:12.567 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr-dashboard 2019-11-29T11:14:12.737 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:12.771 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:12.772 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:12.773 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:12.773 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:12.773 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:12.877 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 1/4 2019-11-29T11:14:13.296 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-29T11:14:13.353 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:13.677 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:13.678 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:13.678 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:13.681 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7809.g656c8e8.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:13.710 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:13.711 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:13.712 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:13.712 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-29T11:14:13.712 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-29T11:14:13.713 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:13.713 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-29T11:14:14.078 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:14.301 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:14.301 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:14.302 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:14.303 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:14.303 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:14:14.303 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:14.303 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 3.9 M 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 18 k 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:14.304 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:14.305 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:14.305 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+3 Dependent packages) 2019-11-29T11:14:14.305 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:14.305 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 4.6 M 2019-11-29T11:14:14.306 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 20 M 2019-11-29T11:14:14.306 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:14.452 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-29T11:14:14.989 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:14.989 INFO:teuthology.orchestra.run.smithi182.stdout:Total 6.7 MB/s | 4.6 MB 00:00 2019-11-29T11:14:14.992 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:15.001 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:15.201 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:15.202 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:15.846 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 1/4 2019-11-29T11:14:16.108 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 4/4 2019-11-29T11:14:16.255 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-29T11:14:16.559 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-29T11:14:16.685 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2/4 2019-11-29T11:14:16.811 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 3/4 2019-11-29T11:14:17.340 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:17.349 INFO:teuthology.orchestra.run.smithi114.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-29T11:14:17.350 INFO:teuthology.orchestra.run.smithi114.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-29T11:14:17.350 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:17.350 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:17.414 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-29T11:14:17.462 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-29T11:14:17.695 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:17.738 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:17.738 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:17.739 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:17.739 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:17.740 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:17.853 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 4/4 2019-11-29T11:14:17.971 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-29T11:14:18.097 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7809.g656c8e8.el7.noarch 2/4 2019-11-29T11:14:18.205 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7809.g656c8e8.el7.noarch 3/4 2019-11-29T11:14:18.376 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:18.631 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-11-29T11:14:18.631 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:18.631 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-29T11:14:18.632 INFO:teuthology.orchestra.run.smithi182.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-29T11:14:18.633 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:18.633 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:18.708 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:18.708 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:18.708 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:18.753 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-29T11:14:18.971 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:19.014 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:19.152 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:19.153 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:19.153 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:19.154 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:19.154 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:19.296 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:19.296 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:19.296 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-cloud 2019-11-29T11:14:19.297 INFO:teuthology.orchestra.run.smithi114.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 82 k 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 82 k 2019-11-29T11:14:19.298 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 411 k 2019-11-29T11:14:19.299 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:19.627 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:19.628 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:19.659 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:19.664 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:19.665 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:19.992 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:19.992 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:19.992 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:20.284 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T11:14:20.356 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:20.581 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:20.582 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:20.582 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:20.582 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-cloud 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 82 k 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:20.583 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 82 k 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 411 k 2019-11-29T11:14:20.584 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:20.707 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T11:14:20.708 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:20.708 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:20.708 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:20.708 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:20.708 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:20.826 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-29T11:14:20.865 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:20.869 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:20.923 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:21.094 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:21.129 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:21.130 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:21.132 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:21.596 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T11:14:21.775 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:22.109 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:22.110 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:22.115 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:22.115 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:22.142 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:22.142 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-29T11:14:22.149 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:22.150 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:22.152 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:22.152 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:22.152 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-29T11:14:22.153 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-29T11:14:22.154 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T11:14:22.156 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T11:14:22.156 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:22.156 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-29T11:14:22.521 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:22.719 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7809.g656c8e8.el7.n 1/1 2019-11-29T11:14:22.720 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:22.720 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:22.720 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:22.720 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:22.720 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:22.739 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:22.740 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:22.741 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local 2019-11-29T11:14:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 8.6 M 2019-11-29T11:14:22.742 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-29T11:14:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-29T11:14:22.742 INFO:teuthology.orchestra.run.smithi114.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-29T11:14:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-29T11:14:22.743 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:22.743 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:22.743 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:22.744 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:14:22.744 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:22.744 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 19 M 2019-11-29T11:14:22.744 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 104 M 2019-11-29T11:14:22.744 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:22.831 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-29T11:14:23.062 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:23.105 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:23.107 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:23.107 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:23.107 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:23.107 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:23.416 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:23.416 INFO:teuthology.orchestra.run.smithi114.stdout:Total 28 MB/s | 19 MB 00:00 2019-11-29T11:14:23.443 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:23.454 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:23.570 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:23.570 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:23.756 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:24.085 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:24.085 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:24.085 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:24.088 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:24.120 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:24.120 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-29T11:14:24.132 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:24.132 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:24.132 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-29T11:14:24.132 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:24.133 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-29T11:14:24.133 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-29T11:14:24.133 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T11:14:24.133 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-29T11:14:24.134 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:24.134 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-29T11:14:24.423 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-29T11:14:24.493 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:24.719 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:24.720 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:24.721 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:24.721 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:24.721 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:14:24.721 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:24.721 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:24.722 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local 2019-11-29T11:14:24.722 INFO:teuthology.orchestra.run.smithi182.stdout: noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 8.6 M 2019-11-29T11:14:24.722 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:24.722 INFO:teuthology.orchestra.run.smithi182.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:24.723 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:24.724 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:14:24.724 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:24.724 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 19 M 2019-11-29T11:14:24.724 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 104 M 2019-11-29T11:14:24.724 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:24.879 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-29T11:14:25.410 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:25.410 INFO:teuthology.orchestra.run.smithi182.stdout:Total 28 MB/s | 19 MB 00:00 2019-11-29T11:14:25.433 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:25.459 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:25.580 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:25.580 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:26.445 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-29T11:14:26.626 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T11:14:26.927 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-29T11:14:28.413 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T11:14:28.701 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 5/5 2019-11-29T11:14:28.788 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-29T11:14:28.890 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 2/5 2019-11-29T11:14:29.047 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T11:14:29.073 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T11:14:29.156 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T11:14:29.684 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-29T11:14:29.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:29.685 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:29.685 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:29.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:29.686 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:29.686 INFO:teuthology.orchestra.run.smithi114.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-29T11:14:29.687 INFO:teuthology.orchestra.run.smithi114.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-29T11:14:29.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:29.687 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:29.818 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-rook 2019-11-29T11:14:30.060 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:30.103 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:30.104 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:30.105 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:30.105 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:30.106 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:30.739 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:30.751 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T11:14:31.046 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 5/5 2019-11-29T11:14:31.067 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:31.067 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:31.068 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:31.069 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:31.099 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:31.099 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-29T11:14:31.106 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:31.107 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-29T11:14:31.108 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-29T11:14:31.108 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-29T11:14:31.108 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:31.109 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:31.109 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:31.110 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-29T11:14:31.110 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-29T11:14:31.111 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:31.112 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-29T11:14:31.112 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-29T11:14:31.112 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-29T11:14:31.112 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-29T11:14:31.112 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-29T11:14:31.113 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:31.113 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-29T11:14:31.150 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-29T11:14:31.268 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7809.g656c8e8.el7.n 2/5 2019-11-29T11:14:31.413 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-29T11:14:31.480 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:31.526 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-29T11:14:31.707 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:31.707 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:31.707 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:31.707 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 23 k 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-29T11:14:31.708 INFO:teuthology.orchestra.run.smithi114.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-29T11:14:31.709 INFO:teuthology.orchestra.run.smithi114.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+10 Dependent packages) 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:31.710 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 1.6 M 2019-11-29T11:14:31.711 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 24 M 2019-11-29T11:14:31.711 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:32.029 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-29T11:14:32.030 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:32.030 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:32.030 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:32.030 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:32.030 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:32.032 INFO:teuthology.orchestra.run.smithi182.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-29T11:14:32.032 INFO:teuthology.orchestra.run.smithi182.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-29T11:14:32.032 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:32.032 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:32.164 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr-rook 2019-11-29T11:14:32.384 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:32.428 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:32.429 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:32.429 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:32.429 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:32.429 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:32.479 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:32.479 INFO:teuthology.orchestra.run.smithi114.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-11-29T11:14:32.493 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:32.505 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:32.616 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:32.617 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:33.070 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:33.382 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-29T11:14:33.397 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:33.401 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:33.401 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:33.401 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:33.431 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:33.433 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-29T11:14:33.433 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:33.437 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:33.437 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:33.437 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-29T11:14:33.437 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:33.438 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-29T11:14:33.438 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-29T11:14:33.438 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-29T11:14:33.438 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:33.439 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:33.439 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-29T11:14:33.439 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-29T11:14:33.439 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-29T11:14:33.440 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:33.440 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-29T11:14:33.441 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-29T11:14:33.441 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-29T11:14:33.442 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-29T11:14:33.442 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-29T11:14:33.442 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:33.443 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-29T11:14:33.728 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-29T11:14:33.806 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:34.031 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:34.031 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:34.032 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:34.032 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 23 k 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-29T11:14:34.033 INFO:teuthology.orchestra.run.smithi182.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-29T11:14:34.034 INFO:teuthology.orchestra.run.smithi182.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-29T11:14:34.035 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:34.035 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:34.035 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:34.035 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+10 Dependent packages) 2019-11-29T11:14:34.035 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:34.036 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 1.6 M 2019-11-29T11:14:34.036 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 24 M 2019-11-29T11:14:34.036 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:34.085 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-29T11:14:34.351 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-29T11:14:34.748 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-29T11:14:34.831 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:34.831 INFO:teuthology.orchestra.run.smithi182.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-11-29T11:14:34.846 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:34.859 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:34.961 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:34.963 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:35.101 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-29T11:14:35.461 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-29T11:14:35.645 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-11-29T11:14:35.735 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-29T11:14:36.002 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-11-29T11:14:36.330 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-11-29T11:14:36.603 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-11-29T11:14:36.944 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-11-29T11:14:36.959 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-29T11:14:37.359 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-29T11:14:37.436 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-11-29T11:14:37.670 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T11:14:37.762 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-29T11:14:37.811 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-29T11:14:37.844 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-29T11:14:37.936 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-29T11:14:38.036 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-29T11:14:38.128 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-11-29T11:14:38.131 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-11-29T11:14:38.204 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-29T11:14:38.338 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-29T11:14:38.455 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-29T11:14:38.572 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-29T11:14:38.689 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-29T11:14:39.177 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T11:14:39.177 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:39.177 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:39.178 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:39.178 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:39.178 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:39.179 INFO:teuthology.orchestra.run.smithi114.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-29T11:14:39.179 INFO:teuthology.orchestra.run.smithi114.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-29T11:14:39.179 INFO:teuthology.orchestra.run.smithi114.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-29T11:14:39.179 INFO:teuthology.orchestra.run.smithi114.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-29T11:14:39.180 INFO:teuthology.orchestra.run.smithi114.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-29T11:14:39.180 INFO:teuthology.orchestra.run.smithi114.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-29T11:14:39.180 INFO:teuthology.orchestra.run.smithi114.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-29T11:14:39.180 INFO:teuthology.orchestra.run.smithi114.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-29T11:14:39.180 INFO:teuthology.orchestra.run.smithi114.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-29T11:14:39.181 INFO:teuthology.orchestra.run.smithi114.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-29T11:14:39.181 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:39.181 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:39.303 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-ssh 2019-11-29T11:14:39.441 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-29T11:14:39.563 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:39.607 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:39.608 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:39.609 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:39.609 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:39.609 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:39.841 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-29T11:14:40.117 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T11:14:40.216 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-29T11:14:40.249 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:40.317 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-11-29T11:14:40.425 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-29T11:14:40.542 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-29T11:14:40.586 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:40.587 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:40.587 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:40.589 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:40.619 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:40.620 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-29T11:14:40.620 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-29T11:14:40.621 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:40.621 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-29T11:14:40.676 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-11-29T11:14:40.769 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-29T11:14:40.844 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-29T11:14:40.928 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-29T11:14:40.984 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:41.020 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-29T11:14:41.120 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-29T11:14:41.213 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:41.213 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:41.213 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:41.213 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-ssh noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 33 k 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:41.214 INFO:teuthology.orchestra.run.smithi114.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+2 Dependent packages) 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 316 k 2019-11-29T11:14:41.215 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 1.1 M 2019-11-29T11:14:41.216 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:41.547 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7809.g656c8e8.el7.noarch 11/11 2019-11-29T11:14:41.547 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:41.547 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-rook.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-29T11:14:41.548 INFO:teuthology.orchestra.run.smithi182.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-29T11:14:41.549 INFO:teuthology.orchestra.run.smithi182.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-29T11:14:41.550 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:41.550 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:41.682 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-mgr-ssh 2019-11-29T11:14:41.749 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:41.749 INFO:teuthology.orchestra.run.smithi114.stdout:Total 589 kB/s | 316 kB 00:00 2019-11-29T11:14:41.750 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:41.761 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:41.841 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:41.842 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:41.865 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:41.903 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:41.908 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:41.911 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:41.911 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:41.911 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:42.531 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:42.642 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-29T11:14:42.858 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:42.859 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:42.859 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:42.861 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 2019-11-29T11:14:42.891 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:42.891 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-29T11:14:42.892 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-29T11:14:42.892 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:42.893 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-29T11:14:42.899 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-29T11:14:43.226 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T11:14:43.259 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:43.338 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-29T11:14:43.463 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-29T11:14:43.488 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:43.488 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:43.488 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-ssh noarch 2:15.0.0-7809.g656c8e8.el7 ceph-noarch 33 k 2019-11-29T11:14:43.489 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+2 Dependent packages) 2019-11-29T11:14:43.490 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:43.491 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 316 k 2019-11-29T11:14:43.491 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 1.1 M 2019-11-29T11:14:43.491 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:43.974 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T11:14:43.974 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:43.974 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:43.975 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:44.023 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:44.024 INFO:teuthology.orchestra.run.smithi182.stdout:Total 590 kB/s | 316 kB 00:00 2019-11-29T11:14:44.027 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:44.035 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:44.107 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-fuse 2019-11-29T11:14:44.118 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:44.118 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:44.352 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:44.395 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:44.396 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:44.396 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:44.396 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:44.397 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:44.908 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-29T11:14:45.034 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:45.225 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-29T11:14:45.377 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:45.377 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:45.377 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:45.378 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:45.408 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:45.408 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:45.409 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T11:14:45.409 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:45.411 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:45.412 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:45.413 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:45.414 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:45.414 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T11:14:45.419 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-29T11:14:45.420 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-29T11:14:45.498 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T11:14:45.586 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-29T11:14:45.686 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-29T11:14:45.781 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:46.009 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:46.010 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:46.010 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:46.010 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:46.010 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:14:46.011 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:14:46.011 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:46.011 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:46.011 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 566 k 2019-11-29T11:14:46.011 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:46.012 INFO:teuthology.orchestra.run.smithi114.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-29T11:14:46.012 INFO:teuthology.orchestra.run.smithi114.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-29T11:14:46.012 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-29T11:14:46.012 INFO:teuthology.orchestra.run.smithi114.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-29T11:14:46.013 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:46.013 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:46.013 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:46.014 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:14:46.014 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:46.014 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 10 M 2019-11-29T11:14:46.014 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 49 M 2019-11-29T11:14:46.014 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:46.156 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7809.g656c8e8.el7.noarch 3/3 2019-11-29T11:14:46.156 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:46.156 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:46.156 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:46.157 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:46.157 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:46.157 INFO:teuthology.orchestra.run.smithi182.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-29T11:14:46.157 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:46.157 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:46.289 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install ceph-fuse 2019-11-29T11:14:46.442 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:46.442 INFO:teuthology.orchestra.run.smithi114.stdout:Total 23 MB/s | 10 MB 00:00 2019-11-29T11:14:46.465 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:46.494 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:46.532 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:46.576 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:46.577 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:46.578 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:46.578 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:46.579 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:46.618 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:46.618 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:47.222 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:47.560 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:47.561 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:47.561 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:47.571 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:47.603 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:47.603 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:47.604 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T11:14:47.604 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:47.606 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:47.607 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:47.609 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-29T11:14:47.609 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:47.609 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-29T11:14:47.614 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-29T11:14:47.615 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-29T11:14:47.976 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:48.209 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:48.209 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:48.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:48.210 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:48.210 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:14:48.210 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:14:48.210 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:48.211 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:48.211 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 566 k 2019-11-29T11:14:48.211 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:48.211 INFO:teuthology.orchestra.run.smithi182.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-29T11:14:48.212 INFO:teuthology.orchestra.run.smithi182.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-29T11:14:48.212 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-29T11:14:48.212 INFO:teuthology.orchestra.run.smithi182.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-29T11:14:48.212 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:48.213 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:48.213 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:48.213 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+4 Dependent packages) 2019-11-29T11:14:48.213 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:48.214 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 10 M 2019-11-29T11:14:48.214 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 49 M 2019-11-29T11:14:48.214 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:48.537 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:48.537 INFO:teuthology.orchestra.run.smithi182.stdout:Total 30 MB/s | 10 MB 00:00 2019-11-29T11:14:48.555 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:48.579 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:48.716 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:48.716 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:49.024 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-29T11:14:49.501 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-29T11:14:50.364 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-29T11:14:50.886 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-29T11:14:51.004 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-29T11:14:51.153 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T11:14:51.292 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T11:14:51.392 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-29T11:14:51.492 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-29T11:14:51.535 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-29T11:14:51.622 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-29T11:14:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-29T11:14:52.103 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:52.103 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-29T11:14:52.104 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:52.105 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:52.232 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs2 2019-11-29T11:14:52.340 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-29T11:14:52.442 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:52.482 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:52.483 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:52.484 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:52.484 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:52.484 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:52.825 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-29T11:14:53.116 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:53.148 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 5/5 2019-11-29T11:14:53.256 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:ceph-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/5 2019-11-29T11:14:53.381 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-11-29T11:14:53.439 INFO:teuthology.orchestra.run.smithi114.stdout:Package 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:14:53.439 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do 2019-11-29T11:14:53.481 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-29T11:14:53.498 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs-devel 2019-11-29T11:14:53.591 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-29T11:14:53.689 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:53.724 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:53.724 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:53.725 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:53.725 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:53.725 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:54.077 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-29T11:14:54.077 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout: ceph-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-29T11:14:54.078 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-29T11:14:54.079 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:54.079 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:54.198 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install libcephfs2 2019-11-29T11:14:54.304 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:54.400 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:54.437 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:54.437 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:54.438 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:54.438 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:54.438 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:54.625 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:14:54.626 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:54.626 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:54.626 INFO:teuthology.orchestra.run.smithi114.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7809.g656c8e8.el7 for package: 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:54.657 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:14:54.657 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:55.033 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:55.070 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:55.251 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:55.251 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:14:55.252 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:55.252 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:55.252 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:14:55.253 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:14:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:55.253 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:14:55.253 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:Installing for dependencies: 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 153 k 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package (+1 Dependent package) 2019-11-29T11:14:55.254 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 170 k 2019-11-29T11:14:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 679 k 2019-11-29T11:14:55.255 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:14:55.384 INFO:teuthology.orchestra.run.smithi182.stdout:Package 2:libcephfs2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:14:55.384 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do 2019-11-29T11:14:55.445 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install libcephfs-devel 2019-11-29T11:14:55.652 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:55.653 INFO:teuthology.orchestra.run.smithi114.stdout:Total 425 kB/s | 170 kB 00:00 2019-11-29T11:14:55.654 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:14:55.659 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:14:55.660 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:14:55.661 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:14:55.680 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:55.723 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:55.725 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:55.725 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:55.725 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:55.726 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:56.260 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T11:14:56.369 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:56.699 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:14:56.700 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:56.700 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:56.701 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7809.g656c8e8.el7 for package: 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2019-11-29T11:14:56.731 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:14:56.731 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:14:56.876 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T11:14:56.993 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T11:14:57.101 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:14:57.330 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:57.330 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:57.331 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 17 k 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 153 k 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:14:57.332 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:14:57.333 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package (+1 Dependent package) 2019-11-29T11:14:57.333 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:57.333 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 170 k 2019-11-29T11:14:57.333 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 679 k 2019-11-29T11:14:57.333 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:14:57.500 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T11:14:57.500 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:Dependency Installed: 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:14:57.501 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:14:57.619 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install librados2 2019-11-29T11:14:57.680 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:14:57.681 INFO:teuthology.orchestra.run.smithi182.stdout:Total 486 kB/s | 170 kB 00:00 2019-11-29T11:14:57.683 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:14:57.696 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:14:57.698 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:14:57.699 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:14:57.879 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:57.929 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:57.929 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:57.930 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:57.930 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:57.930 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:58.237 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T11:14:58.523 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T11:14:58.565 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:14:58.637 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:libcephfs-devel-15.0.0-7809.g656c8e8.el7.x86_64 1/2 2019-11-29T11:14:58.899 INFO:teuthology.orchestra.run.smithi114.stdout:Package 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:14:58.900 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do 2019-11-29T11:14:58.958 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install librbd1 2019-11-29T11:14:59.146 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:librados-devel-15.0.0-7809.g656c8e8.el7.x86_64 2/2 2019-11-29T11:14:59.147 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:59.147 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:14:59.147 INFO:teuthology.orchestra.run.smithi182.stdout: libcephfs-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:59.147 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:59.147 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:14:59.148 INFO:teuthology.orchestra.run.smithi182.stdout: librados-devel.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:14:59.148 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:14:59.148 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:14:59.202 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:59.247 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:59.248 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:59.249 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:59.250 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:59.250 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:14:59.266 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install librados2 2019-11-29T11:14:59.524 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:14:59.568 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:14:59.569 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:14:59.569 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:14:59.570 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:14:59.570 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:14:59.895 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:00.207 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:00.230 INFO:teuthology.orchestra.run.smithi114.stdout:Package 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:15:00.231 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do 2019-11-29T11:15:00.290 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install python-ceph 2019-11-29T11:15:00.509 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:15:00.545 INFO:teuthology.orchestra.run.smithi182.stdout:Package 2:librados2-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:15:00.547 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do 2019-11-29T11:15:00.550 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:15:00.551 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:15:00.551 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:15:00.552 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:15:00.552 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:15:00.606 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install librbd1 2019-11-29T11:15:00.860 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:15:00.900 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:15:00.901 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:15:00.901 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:15:00.901 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:15:00.901 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:15:01.194 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:15:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:15:01.526 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:15:01.544 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:01.882 INFO:teuthology.orchestra.run.smithi182.stdout:Package 2:librbd1-15.0.0-7809.g656c8e8.el7.x86_64 already installed and latest version 2019-11-29T11:15:01.883 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do 2019-11-29T11:15:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:15:01.949 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install python-ceph 2019-11-29T11:15:02.118 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:02.118 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: Size 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-compat x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.2 k 2019-11-29T11:15:02.119 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 2.2 k 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 0 2019-11-29T11:15:02.120 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:15:02.160 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:15:02.204 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:15:02.206 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:15:02.206 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:15:02.206 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:15:02.206 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:15:02.398 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:15:02.399 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:15:02.400 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:15:02.401 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:15:02.867 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:02.962 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:03.194 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:15:03.194 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:15:03.194 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:15:03.447 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:03.448 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:03.448 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:15:03.448 INFO:teuthology.orchestra.run.smithi114.stdout: python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:03.448 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:03.448 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:15:03.563 INFO:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-fuse 2019-11-29T11:15:03.564 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:15:03.791 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:03.791 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:15:03.792 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:03.792 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:03.792 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout: Size 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-compat x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 2.2 k 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:03.793 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T11:15:03.794 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:03.794 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 2.2 k 2019-11-29T11:15:03.794 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 0 2019-11-29T11:15:03.794 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:15:03.815 INFO:teuthology.orchestra.run.smithi114.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:15:03.861 INFO:teuthology.orchestra.run.smithi114.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:15:03.862 INFO:teuthology.orchestra.run.smithi114.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:15:03.862 INFO:teuthology.orchestra.run.smithi114.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:15:03.863 INFO:teuthology.orchestra.run.smithi114.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:15:03.863 INFO:teuthology.orchestra.run.smithi114.stdout: * updates: mirror.datto.com 2019-11-29T11:15:04.091 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:15:04.094 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:15:04.094 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:15:04.095 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:15:04.506 INFO:teuthology.orchestra.run.smithi114.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:04.570 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:04.842 INFO:teuthology.orchestra.run.smithi114.stdout:Resolving Dependencies 2019-11-29T11:15:04.842 INFO:teuthology.orchestra.run.smithi114.stdout:--> Running transaction check 2019-11-29T11:15:04.842 INFO:teuthology.orchestra.run.smithi114.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:python-ceph-compat-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: python-ceph-compat.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:05.086 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:15:05.199 INFO:teuthology.orchestra.run.smithi182:> sudo yum -y install rbd-fuse 2019-11-29T11:15:05.216 INFO:teuthology.orchestra.run.smithi114.stdout:--> Finished Dependency Resolution 2019-11-29T11:15:05.378 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:15:05.416 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:15:05.416 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:15:05.417 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:15:05.417 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:15:05.418 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:15:05.442 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:05.444 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies Resolved 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2019-11-29T11:15:05.445 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 76 k 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 76 k 2019-11-29T11:15:05.446 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 200 k 2019-11-29T11:15:05.447 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading packages: 2019-11-29T11:15:05.773 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2019-11-29T11:15:05.794 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2019-11-29T11:15:05.795 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded 2019-11-29T11:15:05.796 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2019-11-29T11:15:06.024 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:15:06.268 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:06.352 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:15:06.352 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:15:06.352 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 will be installed 2019-11-29T11:15:06.722 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:15:06.950 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:06.951 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:15:06.952 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:06.952 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:06.952 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:15:06.953 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:06.953 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:15:06.953 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse x86_64 2:15.0.0-7809.g656c8e8.el7 ceph 76 k 2019-11-29T11:15:06.953 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:06.953 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:15:06.954 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:15:06.954 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T11:15:06.954 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:06.954 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 76 k 2019-11-29T11:15:06.955 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 200 k 2019-11-29T11:15:06.955 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:15:07.029 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:07.029 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:07.029 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2019-11-29T11:15:07.029 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:07.029 INFO:teuthology.orchestra.run.smithi114.stdout: 2019-11-29T11:15:07.030 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2019-11-29T11:15:07.133 DEBUG:teuthology.parallel:result is None 2019-11-29T11:15:07.284 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:15:07.304 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:15:07.306 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:15:07.306 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:15:07.899 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:08.325 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : 2:rbd-fuse-15.0.0-7809.g656c8e8.el7.x86_64 1/1 2019-11-29T11:15:08.325 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:08.325 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:15:08.325 INFO:teuthology.orchestra.run.smithi182.stdout: rbd-fuse.x86_64 2:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:08.326 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:15:08.326 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:15:08.442 DEBUG:teuthology.parallel:result is None 2019-11-29T11:15:08.442 INFO:teuthology.orchestra.run.smithi182:> sudo lsb_release -is 2019-11-29T11:15:08.585 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS 2019-11-29T11:15:08.587 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:15:08.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:15:08.781 INFO:teuthology.orchestra.run.smithi182:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-29T11:15:08.919 INFO:teuthology.orchestra.run.smithi182.stdout:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:08.920 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:08.920 INFO:teuthology.task.install:The correct ceph version 15.0.0-7809.g656c8e8 is installed. 2019-11-29T11:15:08.920 INFO:teuthology.orchestra.run.smithi114:> sudo lsb_release -is 2019-11-29T11:15:09.069 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS 2019-11-29T11:15:09.071 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-29T11:15:09.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:15:09.252 INFO:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-29T11:15:09.392 INFO:teuthology.orchestra.run.smithi114.stdout:15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:09.393 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7809.g656c8e8.el7 2019-11-29T11:15:09.393 INFO:teuthology.task.install:The correct ceph version 15.0.0-7809.g656c8e8 is installed. 2019-11-29T11:15:09.393 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-29T11:15:09.394 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-29T11:15:09.516 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-29T11:15:09.634 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-29T11:15:09.634 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-29T11:15:09.756 INFO:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-29T11:15:09.851 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-29T11:15:09.972 INFO:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-29T11:15:10.076 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-29T11:15:10.076 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-29T11:15:10.195 INFO:teuthology.orchestra.run.smithi182:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-29T11:15:10.284 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-29T11:15:10.401 INFO:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-29T11:15:10.508 INFO:teuthology.run_tasks:Running task ceph... 2019-11-29T11:15:10.588 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-29T11:15:10.589 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2019-11-29T11:15:10.593 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 777 /var/log/ceph 2019-11-29T11:15:10.709 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-29T11:15:10.709 INFO:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-29T11:15:10.713 INFO:teuthology.orchestra.run.smithi182:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-29T11:15:10.818 INFO:tasks.ceph:Creating extra log directories... 2019-11-29T11:15:10.819 INFO:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-29T11:15:10.823 INFO:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-29T11:15:10.929 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-29T11:15:10.929 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-29T11:15:10.930 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.9215', 'owner': 'scheduled_yuvalif@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi182.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/syInzK708BlfSRmwCWFsQqFmr2r1wLIx3yspbpGwj52q/sfvtpE5sRVvP+EKA8l+ihjGIcWywYcuYO3M4+H+PZ7DamgLTprnLN9bB5KBgRgGoBA4mlEDFyoISxlPsad9UircWf4rd0eVwjJmnuZQ6cDeQhdplEm2t3t8Kv0Zx5zakoRw9qLuBwfhHyaKGz9kddjPtAbFW2ENp8P2Uxuvi3acNL48kzPIQUexxq9UDNSNSpBujqIJcaieaOQjgP6EiQdCj3625xXX8njxkV1M2UyMj91P4txjwcLdQ5/WqprwDsDmbzuMhtst5DIiXbUBNUBVITPtx1I5HW9WNXcL', 'smithi114.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvIcp0CMiKrd60yCdHzQNxCx+pP0sM+l8lSpOGoZTQVqcQpfs2dkxGKwesi/gOUvLghpKBQnbsc8Jyvzbb+4ZcxitWoiflF/6XvMWvudv3TM2lyZV9c0aCPCuMZngxREVND8D9Niy4mLD2rLBNLwHndUxprYTuwuqs9j6DuEnYu7KZli5Q8Zy+QRC5rQNzNd6KgOwnGHzz6/YNBp5hXb0bW7fattH5WwPTezs8Duzxo7MoMFaNyM0rg+EGrsCFfAr+eUVNu8Kqzam+UhqEJJi04/zOldYi2ftp5v6xXDWvtNLf4mnfMuIPALeoIOq/4MXiOtQume3LpW86kpk+cwU1'}, 'job_id': '4552891', 'tube': 'smithi', 'suite_branch': 'wip-yuval-master', 'priority': 100, 'first_in_suite': False, 'branch': 'wip-yuval-master', 'suite': 'rgw:verify', 'email': 'yuvalif@yahoo.com', 'archive_path': '/home/teuthworker/archive/yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi/4552891', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml overrides.yaml proto/http.yaml rgw_pool_type/replicated.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'name': 'yuvalif-2019-11-29_09:46:32-rgw:verify-wip-yuval-master-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'os_type': 'centos', 'overrides': {'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'osd shutdown pgref assert': True, 'debug journal': 20, 'bluestore allocator': 'bitmap', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'osd fast shutdown': False, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64'}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'ec-data-pool': False}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'admin_socket': {'branch': 'wip-yuval-master'}, 'workunit': {'sha1': '656c8e8049c2c1acd363143c842c2edf1fe09b64', 'branch': 'wip-yuval-master'}}} 2019-11-29T11:15:10.930 INFO:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-29T11:15:10.935 INFO:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-29T11:15:11.009 INFO:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2019-11-29T11:15:11.014 INFO:teuthology.orchestra.run.smithi182:> sudo install -d -m0777 -- /var/run/ceph 2019-11-29T11:15:11.187 DEBUG:teuthology.orchestra.remote:smithi182:/scratch_devs is 72B 2019-11-29T11:15:11.278 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T11:15:11.279 INFO:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-29T11:15:11.351 INFO:teuthology.orchestra.run.smithi182.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 106373 Links: 1 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2019-11-29 11:14:04.268439647 +0000 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2019-11-29 11:12:13.047979119 +0000 2019-11-29T11:15:11.352 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2019-11-29 11:12:13.047979119 +0000 2019-11-29T11:15:11.353 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2019-11-29T11:15:11.377 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2019-11-29T11:15:11.378 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2019-11-29T11:15:11.378 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes (512 B) copied, 0.000448601 s, 1.1 MB/s 2019-11-29T11:15:11.382 INFO:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-29T11:15:11.538 INFO:teuthology.orchestra.run.smithi182.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-29T11:15:11.539 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 98894 Links: 1 2019-11-29T11:15:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:11.539 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2019-11-29 11:14:04.268439647 +0000 2019-11-29T11:15:11.540 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2019-11-29 11:12:13.534967257 +0000 2019-11-29T11:15:11.540 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2019-11-29 11:12:13.534967257 +0000 2019-11-29T11:15:11.540 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2019-11-29T11:15:11.569 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2019-11-29T11:15:11.569 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2019-11-29T11:15:11.569 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes (512 B) copied, 0.000475355 s, 1.1 MB/s 2019-11-29T11:15:11.574 INFO:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-29T11:15:11.643 INFO:teuthology.orchestra.run.smithi182.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-29T11:15:11.643 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:11.643 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 106466 Links: 1 2019-11-29T11:15:11.644 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:11.644 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:11.644 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2019-11-29 11:14:04.268439647 +0000 2019-11-29T11:15:11.644 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2019-11-29 11:12:14.047954761 +0000 2019-11-29T11:15:11.644 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2019-11-29 11:12:14.047954761 +0000 2019-11-29T11:15:11.645 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2019-11-29T11:15:11.666 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2019-11-29T11:15:11.666 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2019-11-29T11:15:11.666 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes (512 B) copied, 0.000407125 s, 1.3 MB/s 2019-11-29T11:15:11.670 INFO:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-29T11:15:11.730 INFO:teuthology.orchestra.run.smithi182.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-29T11:15:11.731 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:11.731 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 5h/5d Inode: 98040 Links: 1 2019-11-29T11:15:11.731 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:11.731 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:11.732 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2019-11-29 11:14:04.268439647 +0000 2019-11-29T11:15:11.732 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2019-11-29 11:12:14.530942995 +0000 2019-11-29T11:15:11.732 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2019-11-29 11:12:14.530942995 +0000 2019-11-29T11:15:11.732 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2019-11-29T11:15:11.751 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2019-11-29T11:15:11.751 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2019-11-29T11:15:11.751 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes (512 B) copied, 0.000379529 s, 1.3 MB/s 2019-11-29T11:15:11.755 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-29T11:15:11.755 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T11:15:11.755 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-29T11:15:11.755 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:11.840 DEBUG:teuthology.orchestra.remote:smithi114:/scratch_devs is 72B 2019-11-29T11:15:11.918 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T11:15:11.918 INFO:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-29T11:15:11.994 INFO:teuthology.orchestra.run.smithi114.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-29T11:15:11.995 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 98779 Links: 1 2019-11-29T11:15:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2019-11-29 11:14:01.429568895 +0000 2019-11-29T11:15:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2019-11-29 11:12:12.512093616 +0000 2019-11-29T11:15:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2019-11-29 11:12:12.512093616 +0000 2019-11-29T11:15:11.996 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2019-11-29T11:15:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2019-11-29T11:15:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2019-11-29T11:15:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes (512 B) copied, 0.00038601 s, 1.3 MB/s 2019-11-29T11:15:12.012 INFO:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-29T11:15:12.074 INFO:teuthology.orchestra.run.smithi114.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-29T11:15:12.074 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 106838 Links: 1 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2019-11-29 11:14:01.429568895 +0000 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2019-11-29 11:12:12.966083409 +0000 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2019-11-29 11:12:12.966083409 +0000 2019-11-29T11:15:12.075 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2019-11-29T11:15:12.100 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2019-11-29T11:15:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2019-11-29T11:15:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes (512 B) copied, 0.000361743 s, 1.4 MB/s 2019-11-29T11:15:12.101 INFO:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-29T11:15:12.160 INFO:teuthology.orchestra.run.smithi114.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-29T11:15:12.160 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:12.161 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 93922 Links: 1 2019-11-29T11:15:12.161 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:12.161 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:12.161 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2019-11-29 11:14:01.429568895 +0000 2019-11-29T11:15:12.162 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2019-11-29 11:12:13.388073922 +0000 2019-11-29T11:15:12.162 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2019-11-29 11:12:13.388073922 +0000 2019-11-29T11:15:12.162 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2019-11-29T11:15:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2019-11-29T11:15:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2019-11-29T11:15:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes (512 B) copied, 0.000366686 s, 1.4 MB/s 2019-11-29T11:15:12.177 INFO:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-29T11:15:12.227 INFO:teuthology.orchestra.run.smithi114.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-29T11:15:12.228 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-29T11:15:12.228 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 98819 Links: 1 2019-11-29T11:15:12.228 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-29T11:15:12.229 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2019-11-29T11:15:12.229 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2019-11-29 11:14:01.429568895 +0000 2019-11-29T11:15:12.229 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2019-11-29 11:12:13.848063581 +0000 2019-11-29T11:15:12.229 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2019-11-29 11:12:13.848063581 +0000 2019-11-29T11:15:12.230 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2019-11-29T11:15:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2019-11-29T11:15:12.246 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2019-11-29T11:15:12.247 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes (512 B) copied, 0.000443189 s, 1.2 MB/s 2019-11-29T11:15:12.249 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-29T11:15:12.249 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-29T11:15:12.249 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-29T11:15:12.249 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:12.250 INFO:tasks.ceph:Generating config... 2019-11-29T11:15:12.251 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-29T11:15:12.251 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-29T11:15:12.251 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-29T11:15:12.251 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-29T11:15:12.251 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-29T11:15:12.252 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-11-29T11:15:12.252 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-29T11:15:12.252 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-11-29T11:15:12.252 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-29T11:15:12.252 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2019-11-29T11:15:12.253 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-11-29T11:15:12.254 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-11-29T11:15:12.254 INFO:tasks.ceph:[osd] bdev async discard = True 2019-11-29T11:15:12.254 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-11-29T11:15:12.254 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-11-29T11:15:12.254 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-29T11:15:12.255 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-11-29T11:15:12.255 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-11-29T11:15:12.255 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-29T11:15:12.255 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-29T11:15:12.255 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-29T11:15:12.255 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-29T11:15:12.255 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-29T11:15:12.255 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-29T11:15:12.256 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-29T11:15:12.256 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-29T11:15:12.256 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-29T11:15:12.256 INFO:tasks.ceph:Setting up mon.a... 2019-11-29T11:15:12.256 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-29T11:15:12.449 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.keyring 2019-11-29T11:15:12.454 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-29T11:15:12.590 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T11:15:12.694 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.182'), ('mon.c', '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]'), ('mon.b', '172.21.15.114')] 2019-11-29T11:15:12.695 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.182 --addv c '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]' --add b 172.21.15.114 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:12.796 INFO:teuthology.orchestra.run.smithi182.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:12.796 INFO:teuthology.orchestra.run.smithi182.stdout:monmaptool: generated fsid 00ee8cfc-acb0-4b96-b021-b112ecfd0c77 2019-11-29T11:15:12.796 INFO:teuthology.orchestra.run.smithi182.stdout:epoch 0 2019-11-29T11:15:12.796 INFO:teuthology.orchestra.run.smithi182.stdout:fsid 00ee8cfc-acb0-4b96-b021-b112ecfd0c77 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:last_changed 2019-11-29T11:15:12.798212+0000 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:created 2019-11-29T11:15:12.798212+0000 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:min_mon_release 0 (unknown) 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:0: [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] mon.a 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.b 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:2: [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] mon.c 2019-11-29T11:15:12.797 INFO:teuthology.orchestra.run.smithi182.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-29T11:15:12.799 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 00ee8cfc-acb0-4b96-b021-b112ecfd0c77... 2019-11-29T11:15:12.800 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-29T11:15:12.805 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-29T11:15:13.015 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-29T11:15:13.017 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-29T11:15:13.173 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-29T11:15:13.250 DEBUG:teuthology.orchestra.remote:smithi182:/etc/ceph/ceph.keyring is 206B 2019-11-29T11:15:13.413 DEBUG:teuthology.orchestra.remote:smithi182:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-29T11:15:13.488 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:15:13.488 INFO:teuthology.orchestra.run.smithi182:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T11:15:13.591 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:13.648 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:15:13.649 INFO:teuthology.orchestra.run.smithi114:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-29T11:15:13.794 INFO:teuthology.orchestra.run.smithi114:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:13.877 INFO:tasks.ceph:Setting up mon nodes... 2019-11-29T11:15:13.877 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-29T11:15:13.877 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-29T11:15:14.051 INFO:teuthology.orchestra.run.smithi182.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-29T11:15:14.057 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-29T11:15:14.269 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-29T11:15:14.275 INFO:tasks.ceph:Setting up mds nodes... 2019-11-29T11:15:14.275 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-29T11:15:14.275 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-29T11:15:14.430 INFO:teuthology.orchestra.run.smithi182.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-29T11:15:14.466 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-29T11:15:14.625 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-29T11:15:14.655 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-29T11:15:14.655 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi182.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2019-11-29T11:15:14.656 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-29T11:15:14.775 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:14.775 INFO:tasks.ceph:{} 2019-11-29T11:15:14.776 INFO:tasks.ceph:osd.0 2019-11-29T11:15:14.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:15:14.776 INFO:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-29T11:15:15.362 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:15.362 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:15.362 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:15.363 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:15.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2019-11-29T11:15:15.365 INFO:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-29T11:15:15.544 INFO:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-29T11:15:15.651 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-29T11:15:15.752 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:15.752 INFO:tasks.ceph:{} 2019-11-29T11:15:15.753 INFO:tasks.ceph:osd.1 2019-11-29T11:15:15.753 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:15:15.753 INFO:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-29T11:15:16.312 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:16.313 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:16.318 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:16.318 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:16.319 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:16.327 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:16.328 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:16.328 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:16.328 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:16.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2019-11-29T11:15:16.329 INFO:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-29T11:15:16.501 INFO:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-29T11:15:16.628 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-29T11:15:16.790 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:16.790 INFO:tasks.ceph:{} 2019-11-29T11:15:16.791 INFO:tasks.ceph:osd.2 2019-11-29T11:15:16.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:15:16.791 INFO:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-29T11:15:17.405 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:17.405 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:17.405 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:17.405 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:17.406 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:17.406 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:17.406 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:17.406 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:17.406 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:17.409 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2019-11-29T11:15:17.409 INFO:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-29T11:15:17.593 INFO:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-29T11:15:17.687 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-29T11:15:17.771 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:17.771 INFO:tasks.ceph:{} 2019-11-29T11:15:17.771 INFO:tasks.ceph:osd.3 2019-11-29T11:15:17.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:15:17.772 INFO:teuthology.orchestra.run.smithi182:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-29T11:15:18.328 INFO:teuthology.orchestra.run.smithi182.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:18.328 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:18.329 INFO:teuthology.orchestra.run.smithi182.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:18.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi182.front.sepia.ceph.com -o noatime 2019-11-29T11:15:18.331 INFO:teuthology.orchestra.run.smithi182:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-29T11:15:18.462 INFO:teuthology.orchestra.run.smithi182:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-29T11:15:18.581 INFO:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:18.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.738+0000 7f93f5041b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-29T11:15:18.738 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.739+0000 7f93f5041b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-29T11:15:18.738 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.739+0000 7f93f5041b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T11:15:18.738 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.739+0000 7f93f5041b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T11:15:18.739 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.739+0000 7f93f5041b40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2019-11-29T11:15:18.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:18.743+0000 7f93f5041b40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2019-11-29T11:15:21.049 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-29T11:15:21.172 INFO:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:21.340 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.341+0000 7fdf00edeb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-29T11:15:21.341 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.342+0000 7fdf00edeb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-29T11:15:21.341 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.342+0000 7fdf00edeb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T11:15:21.342 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.342+0000 7fdf00edeb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T11:15:21.342 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.342+0000 7fdf00edeb40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2019-11-29T11:15:21.343 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:21.343+0000 7fdf00edeb40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2019-11-29T11:15:23.649 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-29T11:15:23.768 INFO:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:23.920 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.921+0000 7f48bcb2bb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-29T11:15:23.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.922+0000 7f48bcb2bb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-29T11:15:23.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.922+0000 7f48bcb2bb40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T11:15:23.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.922+0000 7f48bcb2bb40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T11:15:23.922 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.922+0000 7f48bcb2bb40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2019-11-29T11:15:23.922 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:23.924+0000 7f48bcb2bb40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2019-11-29T11:15:26.235 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-29T11:15:26.365 INFO:teuthology.orchestra.run.smithi182:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:26.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.519+0000 7f2faf872b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-29T11:15:26.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.520+0000 7f2faf872b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-29T11:15:26.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.520+0000 7f2faf872b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T11:15:26.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.520+0000 7f2faf872b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T11:15:26.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.520+0000 7f2faf872b40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2019-11-29T11:15:26.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:15:26.521+0000 7f2faf872b40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2019-11-29T11:15:28.827 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-29T11:15:28.946 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-29T11:15:29.084 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:29.084 INFO:tasks.ceph:{} 2019-11-29T11:15:29.084 INFO:tasks.ceph:osd.4 2019-11-29T11:15:29.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:15:29.084 INFO:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-29T11:15:29.682 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:29.682 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:29.682 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:29.682 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:29.682 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:29.683 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:29.683 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:29.683 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:29.683 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:29.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2019-11-29T11:15:29.685 INFO:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-29T11:15:29.865 INFO:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-29T11:15:29.991 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-29T11:15:30.085 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:30.085 INFO:tasks.ceph:{} 2019-11-29T11:15:30.085 INFO:tasks.ceph:osd.5 2019-11-29T11:15:30.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:15:30.086 INFO:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-29T11:15:30.646 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:30.646 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:30.646 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:30.646 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:30.647 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:30.647 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:30.647 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:30.647 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:30.647 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:30.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2019-11-29T11:15:30.649 INFO:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-29T11:15:30.812 INFO:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-29T11:15:30.931 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-29T11:15:31.036 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:31.037 INFO:tasks.ceph:{} 2019-11-29T11:15:31.037 INFO:tasks.ceph:osd.6 2019-11-29T11:15:31.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:15:31.037 INFO:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-29T11:15:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:31.650 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:31.650 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:31.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2019-11-29T11:15:31.652 INFO:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-29T11:15:31.816 INFO:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-29T11:15:31.916 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-29T11:15:31.992 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-29T11:15:31.992 INFO:tasks.ceph:{} 2019-11-29T11:15:31.992 INFO:tasks.ceph:osd.7 2019-11-29T11:15:31.993 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:15:31.993 INFO:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-29T11:15:32.559 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=0, sparse=0 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-29T11:15:32.560 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-29T11:15:32.561 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-29T11:15:32.562 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2019-11-29T11:15:32.562 INFO:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-29T11:15:32.703 INFO:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-29T11:15:32.799 INFO:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:32.921 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.922+0000 7f68997d5b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-29T11:15:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.927+0000 7f68997d5b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-29T11:15:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.927+0000 7f68997d5b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T11:15:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.927+0000 7f68997d5b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T11:15:32.926 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.927+0000 7f68997d5b40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2019-11-29T11:15:32.930 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:32.931+0000 7f68997d5b40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2019-11-29T11:15:35.240 INFO:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-29T11:15:35.359 INFO:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:35.496 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.497+0000 7fbfe10aab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-29T11:15:35.497 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.498+0000 7fbfe10aab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-29T11:15:35.497 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.498+0000 7fbfe10aab40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T11:15:35.498 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.498+0000 7fbfe10aab40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T11:15:35.498 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.498+0000 7fbfe10aab40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2019-11-29T11:15:35.498 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:35.499+0000 7fbfe10aab40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2019-11-29T11:15:37.809 INFO:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-29T11:15:37.929 INFO:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:38.080 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.082+0000 7fdd54f87b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-29T11:15:38.081 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.082+0000 7fdd54f87b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-29T11:15:38.081 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.082+0000 7fdd54f87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T11:15:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.082+0000 7fdd54f87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T11:15:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.082+0000 7fdd54f87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2019-11-29T11:15:38.082 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:38.084+0000 7fdd54f87b40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2019-11-29T11:15:40.392 INFO:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-29T11:15:40.517 INFO:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.657+0000 7f9c6e9ceb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-29T11:15:40.657 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.658+0000 7f9c6e9ceb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-29T11:15:40.657 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.658+0000 7f9c6e9ceb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T11:15:40.657 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.658+0000 7f9c6e9ceb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T11:15:40.657 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.658+0000 7f9c6e9ceb40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2019-11-29T11:15:40.658 INFO:teuthology.orchestra.run.smithi114.stderr:2019-11-29T11:15:40.660+0000 7f9c6e9ceb40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2019-11-29T11:15:42.971 INFO:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-29T11:15:43.092 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-29T11:15:43.093 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:15:43.183 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.8NJMhaQ8yb 2019-11-29T11:15:43.184 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.8NJMhaQ8yb 2019-11-29T11:15:43.289 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.8NJMhaQ8yb 2019-11-29T11:15:43.469 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.8NJMhaQ8yb is 56B 2019-11-29T11:15:43.538 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.8NJMhaQ8yb 2019-11-29T11:15:43.596 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:15:43.671 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.4pdSIBcdNC 2019-11-29T11:15:43.671 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.4pdSIBcdNC 2019-11-29T11:15:43.768 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.4pdSIBcdNC 2019-11-29T11:15:43.916 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.4pdSIBcdNC is 56B 2019-11-29T11:15:43.987 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.4pdSIBcdNC 2019-11-29T11:15:44.042 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:15:44.183 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.g1pgiO9hn7 2019-11-29T11:15:44.184 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.g1pgiO9hn7 2019-11-29T11:15:44.287 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.g1pgiO9hn7 2019-11-29T11:15:44.557 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.g1pgiO9hn7 is 56B 2019-11-29T11:15:44.639 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.g1pgiO9hn7 2019-11-29T11:15:44.720 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:15:44.793 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.0oSJZjWOXn 2019-11-29T11:15:44.793 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.0oSJZjWOXn 2019-11-29T11:15:44.877 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.0oSJZjWOXn 2019-11-29T11:15:45.008 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.0oSJZjWOXn is 56B 2019-11-29T11:15:45.063 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.0oSJZjWOXn 2019-11-29T11:15:45.112 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:15:45.235 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.YNci0KgavX 2019-11-29T11:15:45.235 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.YNci0KgavX 2019-11-29T11:15:45.339 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.YNci0KgavX 2019-11-29T11:15:45.483 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.YNci0KgavX is 56B 2019-11-29T11:15:45.543 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.YNci0KgavX 2019-11-29T11:15:45.595 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:15:45.690 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.0YDEx8kHD2 2019-11-29T11:15:45.690 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.0YDEx8kHD2 2019-11-29T11:15:45.788 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.0YDEx8kHD2 2019-11-29T11:15:45.988 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.0YDEx8kHD2 is 56B 2019-11-29T11:15:46.073 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.0YDEx8kHD2 2019-11-29T11:15:46.144 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:15:46.227 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.jBo59mAYsu 2019-11-29T11:15:46.227 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.jBo59mAYsu 2019-11-29T11:15:46.327 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.jBo59mAYsu 2019-11-29T11:15:46.479 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.jBo59mAYsu is 56B 2019-11-29T11:15:46.544 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.jBo59mAYsu 2019-11-29T11:15:46.600 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:15:46.740 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.OzBFaWJntW 2019-11-29T11:15:46.740 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.OzBFaWJntW 2019-11-29T11:15:46.855 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.OzBFaWJntW 2019-11-29T11:15:47.018 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.OzBFaWJntW is 56B 2019-11-29T11:15:47.087 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.OzBFaWJntW 2019-11-29T11:15:47.140 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:15:47.192 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.xS2qhpkpWz 2019-11-29T11:15:47.192 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.xS2qhpkpWz 2019-11-29T11:15:47.262 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.xS2qhpkpWz 2019-11-29T11:15:47.427 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.xS2qhpkpWz is 56B 2019-11-29T11:15:47.512 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.xS2qhpkpWz 2019-11-29T11:15:47.571 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:15:47.627 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.aeo0PxXN5u 2019-11-29T11:15:47.627 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.aeo0PxXN5u 2019-11-29T11:15:47.738 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.aeo0PxXN5u 2019-11-29T11:15:47.886 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.aeo0PxXN5u is 56B 2019-11-29T11:15:47.945 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.aeo0PxXN5u 2019-11-29T11:15:48.096 DEBUG:teuthology.orchestra.remote:smithi182:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-29T11:15:48.279 DEBUG:teuthology.orchestra.remote:smithi114:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-29T11:15:48.369 INFO:tasks.ceph:Adding keys to all mons... 2019-11-29T11:15:48.369 INFO:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-29T11:15:48.374 INFO:teuthology.orchestra.run.smithi182:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-29T11:15:48.470 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDC/eBdihI3AxAAghL02SadPfzzBrYkMe8mrA== 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDG/eBdW5oaLBAArsbTS1bl3EFdp7U3JICPYw== 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDJ/eBdlt9yFBAAvDK5HNY++FEiFdmPxpW1Ow== 2019-11-29T11:15:48.471 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDL/eBdcmUFNxAANJnJZX4e87ALrwTQKFcT0A== 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDO/eBd+ykJHxAAYPgwxcnPpFCoETusiB633Q== 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDC/eBde4ozEBAAIoH/CWc33hJHnzFwe1J1NQ== 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2019-11-29T11:15:48.472 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDU/eBdKNoONxAA2VQHiXv+HYuoFIPsOL3koA== 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDX/eBdEgy4HRAAicJRVM+bCM6/h1TTuzb0gw== 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDa/eBd1RvxBBAApebB9aoK9I8I9Y3JTV63+w== 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDc/eBdGF5FJxAAn7D2/CPyRjstTyISGzTsBg== 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2019-11-29T11:15:48.473 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDC/eBd1AzDGRAAnWB/QfuXkcotVn/r40RoRA== 2019-11-29T11:15:48.474 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2019-11-29T11:15:48.474 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQDC/eBdbXphJRAALM4jEhWrvxNhL5YCpou7gQ== 2019-11-29T11:15:48.489 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.y] 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDC/eBdihI3AxAAghL02SadPfzzBrYkMe8mrA== 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.0] 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDG/eBdW5oaLBAArsbTS1bl3EFdp7U3JICPYw== 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.1] 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDJ/eBdlt9yFBAAvDK5HNY++FEiFdmPxpW1Ow== 2019-11-29T11:15:48.490 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.2] 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDL/eBdcmUFNxAANJnJZX4e87ALrwTQKFcT0A== 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.3] 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDO/eBd+ykJHxAAYPgwxcnPpFCoETusiB633Q== 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout:[mgr.x] 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDC/eBde4ozEBAAIoH/CWc33hJHnzFwe1J1NQ== 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.4] 2019-11-29T11:15:48.491 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDU/eBdKNoONxAA2VQHiXv+HYuoFIPsOL3koA== 2019-11-29T11:15:48.492 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.5] 2019-11-29T11:15:48.492 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDX/eBdEgy4HRAAicJRVM+bCM6/h1TTuzb0gw== 2019-11-29T11:15:48.496 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.6] 2019-11-29T11:15:48.496 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDa/eBd1RvxBBAApebB9aoK9I8I9Y3JTV63+w== 2019-11-29T11:15:48.496 INFO:teuthology.orchestra.run.smithi182.stdout:[osd.7] 2019-11-29T11:15:48.496 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDc/eBdGF5FJxAAn7D2/CPyRjstTyISGzTsBg== 2019-11-29T11:15:48.498 INFO:teuthology.orchestra.run.smithi182.stdout:[client.0] 2019-11-29T11:15:48.498 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDC/eBd1AzDGRAAnWB/QfuXkcotVn/r40RoRA== 2019-11-29T11:15:48.498 INFO:teuthology.orchestra.run.smithi182.stdout:[client.1] 2019-11-29T11:15:48.498 INFO:teuthology.orchestra.run.smithi182.stdout: key = AQDC/eBdbXphJRAALM4jEhWrvxNhL5YCpou7gQ== 2019-11-29T11:15:48.499 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T11:15:48.509 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T11:15:48.678 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:48.683 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:48.832 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:48.837 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:48.975 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:48.980 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.147 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.153 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.314 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T11:15:49.333 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-29T11:15:49.506 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.511 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.673 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.684 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.847 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:49.851 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:50.014 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:50.020 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-29T11:15:50.174 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T11:15:50.180 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T11:15:50.354 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T11:15:50.359 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-29T11:15:50.526 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-29T11:15:50.526 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-29T11:15:50.636 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T11:15:50.805 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-29T11:15:50.889 INFO:teuthology.orchestra.run.smithi182:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-29T11:15:50.961 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T11:15:51.074 INFO:teuthology.orchestra.run.smithi182:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-29T11:15:51.147 INFO:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-29T11:15:51.269 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-29T11:15:51.460 INFO:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-29T11:15:51.574 INFO:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:51.578 INFO:teuthology.orchestra.run.smithi182:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-29T11:15:51.664 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-29T11:15:51.664 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T11:15:51.664 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-29T11:15:51.664 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-29T11:15:51.669 INFO:tasks.ceph.mon.a:Started 2019-11-29T11:15:51.669 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T11:15:51.669 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-29T11:15:51.669 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-29T11:15:51.674 INFO:tasks.ceph.mon.c:Started 2019-11-29T11:15:51.674 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-29T11:15:51.674 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-29T11:15:51.674 INFO:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-29T11:15:51.679 INFO:tasks.ceph.mon.b:Started 2019-11-29T11:15:51.679 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-29T11:15:51.679 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-29T11:15:51.680 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-29T11:15:51.683 INFO:tasks.ceph.mgr.y:Started 2019-11-29T11:15:51.683 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-29T11:15:51.684 INFO:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-29T11:15:51.691 INFO:tasks.ceph.mgr.x:Started 2019-11-29T11:15:51.691 INFO:tasks.ceph:Setting crush tunables to default 2019-11-29T11:15:51.691 INFO:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd crush tunables default 2019-11-29T11:15:55.628 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:00:03.787 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:15:55.755 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:00:03.896 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:15:55.792 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:00:03.951 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:16:08.711 INFO:teuthology.orchestra.run.smithi182.stderr:adjusted tunables profile to default 2019-11-29T11:16:08.724 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-29T11:16:08.724 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:16:08.774 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.D5X4dAl62v 2019-11-29T11:16:08.775 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.D5X4dAl62v 2019-11-29T11:16:08.842 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.D5X4dAl62v 2019-11-29T11:16:08.946 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.D5X4dAl62v is 37B 2019-11-29T11:16:08.995 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.D5X4dAl62v 2019-11-29T11:16:09.043 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:16:09.168 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.HCR7Z3GmvB 2019-11-29T11:16:09.169 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.HCR7Z3GmvB 2019-11-29T11:16:09.229 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.HCR7Z3GmvB 2019-11-29T11:16:09.342 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.HCR7Z3GmvB is 37B 2019-11-29T11:16:09.392 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.HCR7Z3GmvB 2019-11-29T11:16:09.441 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:16:09.569 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.XFk0rbxqw5 2019-11-29T11:16:09.569 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.XFk0rbxqw5 2019-11-29T11:16:09.646 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.XFk0rbxqw5 2019-11-29T11:16:09.753 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.XFk0rbxqw5 is 37B 2019-11-29T11:16:09.802 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.XFk0rbxqw5 2019-11-29T11:16:09.845 INFO:teuthology.orchestra.run.smithi182:> mktemp 2019-11-29T11:16:09.987 INFO:teuthology.orchestra.run.smithi182.stdout:/tmp/tmp.mkIBNP889w 2019-11-29T11:16:09.987 INFO:teuthology.orchestra.run.smithi182:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.mkIBNP889w 2019-11-29T11:16:10.064 INFO:teuthology.orchestra.run.smithi182:> sudo chmod 0666 /tmp/tmp.mkIBNP889w 2019-11-29T11:16:10.129 INFO:tasks.ceph.mgr.x.smithi114.stderr:2019-11-29T11:16:10.131+0000 7fddf37fe700 -1 mgr handle_mgr_map I was active but no longer am 2019-11-29T11:16:10.176 DEBUG:teuthology.orchestra.remote:smithi182:/tmp/tmp.mkIBNP889w is 37B 2019-11-29T11:16:10.227 INFO:teuthology.orchestra.run.smithi182:> rm -fr /tmp/tmp.mkIBNP889w 2019-11-29T11:16:10.270 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:16:10.360 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.GXycwjDyfg 2019-11-29T11:16:10.364 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.GXycwjDyfg 2019-11-29T11:16:10.469 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.GXycwjDyfg 2019-11-29T11:16:10.596 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.GXycwjDyfg is 37B 2019-11-29T11:16:10.657 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.GXycwjDyfg 2019-11-29T11:16:10.700 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:16:10.836 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Y0dMg2yf5d 2019-11-29T11:16:10.837 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.Y0dMg2yf5d 2019-11-29T11:16:10.908 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.Y0dMg2yf5d 2019-11-29T11:16:11.023 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.Y0dMg2yf5d is 37B 2019-11-29T11:16:11.081 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.Y0dMg2yf5d 2019-11-29T11:16:11.123 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:16:11.258 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.sgxXCI4Hfv 2019-11-29T11:16:11.259 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.sgxXCI4Hfv 2019-11-29T11:16:11.331 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.sgxXCI4Hfv 2019-11-29T11:16:11.453 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.sgxXCI4Hfv is 37B 2019-11-29T11:16:11.500 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.sgxXCI4Hfv 2019-11-29T11:16:11.540 INFO:teuthology.orchestra.run.smithi114:> mktemp 2019-11-29T11:16:11.655 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.XBOKHMuFAG 2019-11-29T11:16:11.655 INFO:teuthology.orchestra.run.smithi114:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.XBOKHMuFAG 2019-11-29T11:16:11.711 INFO:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.XBOKHMuFAG 2019-11-29T11:16:11.808 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.XBOKHMuFAG is 37B 2019-11-29T11:16:11.883 INFO:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.XBOKHMuFAG 2019-11-29T11:16:11.928 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 248c9479-6097-4b92-81e9-7e5b5caf5d97 0 2019-11-29T11:16:12.967 INFO:teuthology.orchestra.run.smithi114.stdout:0 2019-11-29T11:16:12.987 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new ca404171-e2e7-41e9-9eb1-e63a917176a6 1 2019-11-29T11:16:14.404 INFO:teuthology.orchestra.run.smithi114.stdout:1 2019-11-29T11:16:14.418 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 149c52bd-183c-4e0d-97a6-8cfbb0a34f54 2 2019-11-29T11:16:15.415 INFO:teuthology.orchestra.run.smithi114.stdout:2 2019-11-29T11:16:15.437 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 3eee4d72-9178-4de2-a0a7-60502556f204 3 2019-11-29T11:16:16.567 INFO:teuthology.orchestra.run.smithi114.stdout:3 2019-11-29T11:16:16.591 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new f3dff3c8-71a1-48d7-ac55-5d438c0d646a 4 2019-11-29T11:16:17.673 INFO:teuthology.orchestra.run.smithi114.stdout:4 2019-11-29T11:16:17.695 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 7394b94d-f88f-4682-bb77-3b8d991eb169 5 2019-11-29T11:16:18.688 INFO:teuthology.orchestra.run.smithi114.stdout:5 2019-11-29T11:16:18.708 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 46d4d240-b25e-43e4-8bc6-7dc3d38b621d 6 2019-11-29T11:16:19.741 INFO:teuthology.orchestra.run.smithi114.stdout:6 2019-11-29T11:16:19.764 INFO:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52 7 2019-11-29T11:16:20.791 INFO:teuthology.orchestra.run.smithi114.stdout:7 2019-11-29T11:16:20.817 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.817 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-29T11:16:20.817 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-29T11:16:20.823 INFO:tasks.ceph.osd.0:Started 2019-11-29T11:16:20.824 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.824 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-29T11:16:20.824 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-29T11:16:20.838 INFO:tasks.ceph.osd.1:Started 2019-11-29T11:16:20.838 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.839 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-29T11:16:20.839 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-29T11:16:20.853 INFO:tasks.ceph.osd.2:Started 2019-11-29T11:16:20.855 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.855 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-29T11:16:20.855 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-29T11:16:20.865 INFO:tasks.ceph.osd.3:Started 2019-11-29T11:16:20.865 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.866 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-29T11:16:20.866 INFO:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-29T11:16:20.876 INFO:tasks.ceph.osd.4:Started 2019-11-29T11:16:20.876 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.876 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-29T11:16:20.877 INFO:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-29T11:16:20.885 INFO:tasks.ceph.osd.5:Started 2019-11-29T11:16:20.905 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.905 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-29T11:16:20.906 INFO:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-29T11:16:20.911 INFO:tasks.ceph.osd.6:Started 2019-11-29T11:16:20.911 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-29T11:16:20.911 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-29T11:16:20.912 INFO:teuthology.orchestra.run.smithi114:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-29T11:16:20.916 INFO:tasks.ceph.osd.7:Started 2019-11-29T11:16:20.916 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-29T11:16:21.725 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:22.829 INFO:teuthology.misc.health.smithi182.stdout: 2019-11-29T11:16:22.829 INFO:teuthology.misc.health.smithi182.stdout:{"epoch":10,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:20.628886+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:22.843 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-29T11:16:24.678 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:03.665 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.679 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:03.714 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.734 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:03.722 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.750 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:03.712 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.769 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:03.756 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.769 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:03.805 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.791 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:03.809 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.817 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:03.768 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.829 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:03.812 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.849 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:03.865 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.849 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:03.816 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:24.905 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:03.872 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.014 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:04.060 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.092 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:04.138 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.290 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:04.351 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.344 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T11:16:25.324+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.350 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:04.411 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T11:16:25.334+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.386 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T11:16:25.374+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T11:16:25.416+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T11:16:25.431+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T11:16:25.478+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.534 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:04.522 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.585 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:04.620 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.614 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:04.576 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.652 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:04.640 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.667 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:04.685 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T11:16:25.657+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:25.695 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:04.657 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.896 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:04.938 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.936 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:04.924 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.948 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:04.936 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:25.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T11:16:25.964+0000 9b10800 -1 Falling back to public interface 2019-11-29T11:16:26.003 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:05.033 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.003 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:04.959 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.009 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:04.970 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.012 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:05.048 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.043 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:05.029 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.044 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:05.060 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.054 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:05.042 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.057 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:05.075 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.081 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:05.043 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.091 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:05.058 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.196 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:05.258 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.242 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:05.287 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.254 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:05.299 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.580 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:05.637 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:26.592 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:05.653 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:28.816 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:07.834 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:28.826 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:07.839 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.085 INFO:tasks.ceph.osd.3.smithi182.stderr:==00:00:00:08.102 9956== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.345 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:08.370 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.348 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:08.384 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.399 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:08.460 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.407 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:08.468 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.468 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:08.430 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.479 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:08.440 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.497 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:08.542 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.503 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:08.549 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.571 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:08.537 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.583 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:08.550 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.624 INFO:tasks.ceph.osd.1.smithi182.stderr:==00:00:00:08.658 9955== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.650 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:29.673 INFO:tasks.ceph.osd.0.smithi182.stderr:==00:00:00:08.734 9950== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.741 INFO:tasks.ceph.osd.7.smithi114.stderr:==00:00:00:08.703 10009== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.767 INFO:tasks.ceph.osd.2.smithi182.stderr:==00:00:00:08.812 9952== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.845 INFO:tasks.ceph.osd.6.smithi114.stderr:==00:00:00:08.813 10008== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.910 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:08.897 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:29.913 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:08.902 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:30.175 INFO:tasks.ceph.osd.4.smithi114.stderr:==00:00:00:09.163 10005== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:30.373 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:09.360 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:30.383 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:09.371 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:30.401 INFO:teuthology.misc.health.smithi182.stdout: 2019-11-29T11:16:30.401 INFO:teuthology.misc.health.smithi182.stdout:{"epoch":10,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:20.628886+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:30.416 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-29T11:16:30.639 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T11:16:30.639+0000 9b10800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-29T11:16:30.644 INFO:tasks.ceph.osd.5.smithi114.stderr:==00:00:00:09.632 10004== Warning: unimplemented fcntl command: 1038 2019-11-29T11:16:31.165 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T11:16:31.164+0000 9b10800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-29T11:16:31.167 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T11:16:31.167+0000 9b10800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-29T11:16:31.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T11:16:31.233+0000 9b10800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-29T11:16:31.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T11:16:31.260+0000 9b10800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-29T11:16:31.270 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T11:16:31.269+0000 9b10800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-29T11:16:31.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T11:16:31.510+0000 9b10800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-29T11:16:31.995 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T11:16:31.995+0000 9b10800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-29T11:16:33.025 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T11:16:33.006+0000 2776f700 -1 osd.7 0 waiting for initial osdmap 2019-11-29T11:16:33.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T11:16:33.057+0000 2476b700 -1 osd.6 0 waiting for initial osdmap 2019-11-29T11:16:33.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T11:16:33.067+0000 2776f700 -1 osd.2 0 waiting for initial osdmap 2019-11-29T11:16:33.098 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T11:16:33.091+0000 2776f700 -1 osd.0 0 waiting for initial osdmap 2019-11-29T11:16:33.098 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T11:16:33.091+0000 2776f700 -1 osd.1 0 waiting for initial osdmap 2019-11-29T11:16:33.108 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T11:16:33.106+0000 2476b700 -1 osd.3 0 waiting for initial osdmap 2019-11-29T11:16:34.138 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T11:16:34.137+0000 2776f700 -1 osd.4 0 waiting for initial osdmap 2019-11-29T11:16:34.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T11:16:34.254+0000 2476b700 -1 osd.5 0 waiting for initial osdmap 2019-11-29T11:16:37.227 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:37.970 INFO:teuthology.misc.health.smithi182.stdout: 2019-11-29T11:16:37.971 INFO:teuthology.misc.health.smithi182.stdout:{"epoch":15,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:36.290249+0000","last_up_change":"2019-11-29T11:16:35.064922+0000","last_in_change":"2019-11-29T11:16:35.064922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":9950},{"type":"v1","addr":"172.21.15.182:6825","nonce":9950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":9950},{"type":"v1","addr":"172.21.15.182:6827","nonce":9950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":9950},{"type":"v1","addr":"172.21.15.182:6831","nonce":9950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":9950},{"type":"v1","addr":"172.21.15.182:6829","nonce":9950}]},"public_addr":"172.21.15.182:6825/9950","cluster_addr":"172.21.15.182:6827/9950","heartbeat_back_addr":"172.21.15.182:6831/9950","heartbeat_front_addr":"172.21.15.182:6829/9950","state":["exists","up"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":9955},{"type":"v1","addr":"172.21.15.182:6801","nonce":9955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":9955},{"type":"v1","addr":"172.21.15.182:6803","nonce":9955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":9955},{"type":"v1","addr":"172.21.15.182:6807","nonce":9955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":9955},{"type":"v1","addr":"172.21.15.182:6805","nonce":9955}]},"public_addr":"172.21.15.182:6801/9955","cluster_addr":"172.21.15.182:6803/9955","heartbeat_back_addr":"172.21.15.182:6807/9955","heartbeat_front_addr":"172.21.15.182:6805/9955","state":["exists","up"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":9952},{"type":"v1","addr":"172.21.15.182:6817","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":9952},{"type":"v1","addr":"172.21.15.182:6819","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":9952},{"type":"v1","addr":"172.21.15.182:6823","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":9952},{"type":"v1","addr":"172.21.15.182:6821","nonce":9952}]},"public_addr":"172.21.15.182:6817/9952","cluster_addr":"172.21.15.182:6819/9952","heartbeat_back_addr":"172.21.15.182:6823/9952","heartbeat_front_addr":"172.21.15.182:6821/9952","state":["exists","up"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":9956},{"type":"v1","addr":"172.21.15.182:6809","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":9956},{"type":"v1","addr":"172.21.15.182:6811","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":9956},{"type":"v1","addr":"172.21.15.182:6815","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":9956},{"type":"v1","addr":"172.21.15.182:6813","nonce":9956}]},"public_addr":"172.21.15.182:6809/9956","cluster_addr":"172.21.15.182:6811/9956","heartbeat_back_addr":"172.21.15.182:6815/9956","heartbeat_front_addr":"172.21.15.182:6813/9956","state":["exists","up"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":10005},{"type":"v1","addr":"172.21.15.114:6803","nonce":10005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":10005},{"type":"v1","addr":"172.21.15.114:6805","nonce":10005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":10005},{"type":"v1","addr":"172.21.15.114:6809","nonce":10005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":10005},{"type":"v1","addr":"172.21.15.114:6807","nonce":10005}]},"public_addr":"172.21.15.114:6803/10005","cluster_addr":"172.21.15.114:6805/10005","heartbeat_back_addr":"172.21.15.114:6809/10005","heartbeat_front_addr":"172.21.15.114:6807/10005","state":["exists","up"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":10004},{"type":"v1","addr":"172.21.15.114:6819","nonce":10004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":10004},{"type":"v1","addr":"172.21.15.114:6821","nonce":10004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":10004},{"type":"v1","addr":"172.21.15.114:6825","nonce":10004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":10004},{"type":"v1","addr":"172.21.15.114:6823","nonce":10004}]},"public_addr":"172.21.15.114:6819/10004","cluster_addr":"172.21.15.114:6821/10004","heartbeat_back_addr":"172.21.15.114:6825/10004","heartbeat_front_addr":"172.21.15.114:6823/10004","state":["exists","up"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":10008},{"type":"v1","addr":"172.21.15.114:6827","nonce":10008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":10008},{"type":"v1","addr":"172.21.15.114:6829","nonce":10008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":10008},{"type":"v1","addr":"172.21.15.114:6833","nonce":10008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":10008},{"type":"v1","addr":"172.21.15.114:6831","nonce":10008}]},"public_addr":"172.21.15.114:6827/10008","cluster_addr":"172.21.15.114:6829/10008","heartbeat_back_addr":"172.21.15.114:6833/10008","heartbeat_front_addr":"172.21.15.114:6831/10008","state":["exists","up"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":10009},{"type":"v1","addr":"172.21.15.114:6811","nonce":10009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":10009},{"type":"v1","addr":"172.21.15.114:6813","nonce":10009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":10009},{"type":"v1","addr":"172.21.15.114:6817","nonce":10009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":10009},{"type":"v1","addr":"172.21.15.114:6815","nonce":10009}]},"public_addr":"172.21.15.114:6811/10009","cluster_addr":"172.21.15.114:6813/10009","heartbeat_back_addr":"172.21.15.114:6817/10009","heartbeat_front_addr":"172.21.15.114:6815/10009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.260662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.232597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.311093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:31.693886+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.640706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:33.027902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.422172+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.348730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:37.989 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-29T11:16:37.989 INFO:tasks.ceph:Creating RBD pool 2019-11-29T11:16:37.990 INFO:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-29T11:16:40.259 INFO:teuthology.orchestra.run.smithi182.stderr:pool 'rbd' created 2019-11-29T11:16:40.278 INFO:teuthology.orchestra.run.smithi182:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-29T11:16:41.630 INFO:teuthology.orchestra.run.smithi182.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-29T11:16:41.641 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-29T11:16:41.641 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:41.642 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-29T11:16:42.461 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:42.462 INFO:teuthology.orchestra.run.smithi182.stdout:{"epoch":17,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:41.320627+0000","last_up_change":"2019-11-29T11:16:35.064922+0000","last_in_change":"2019-11-29T11:16:35.064922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T11:16:39.025591+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":9950},{"type":"v1","addr":"172.21.15.182:6825","nonce":9950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":9950},{"type":"v1","addr":"172.21.15.182:6827","nonce":9950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":9950},{"type":"v1","addr":"172.21.15.182:6831","nonce":9950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":9950},{"type":"v1","addr":"172.21.15.182:6829","nonce":9950}]},"public_addr":"172.21.15.182:6825/9950","cluster_addr":"172.21.15.182:6827/9950","heartbeat_back_addr":"172.21.15.182:6831/9950","heartbeat_front_addr":"172.21.15.182:6829/9950","state":["exists","up"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":9955},{"type":"v1","addr":"172.21.15.182:6801","nonce":9955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":9955},{"type":"v1","addr":"172.21.15.182:6803","nonce":9955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":9955},{"type":"v1","addr":"172.21.15.182:6807","nonce":9955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":9955},{"type":"v1","addr":"172.21.15.182:6805","nonce":9955}]},"public_addr":"172.21.15.182:6801/9955","cluster_addr":"172.21.15.182:6803/9955","heartbeat_back_addr":"172.21.15.182:6807/9955","heartbeat_front_addr":"172.21.15.182:6805/9955","state":["exists","up"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":9952},{"type":"v1","addr":"172.21.15.182:6817","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":9952},{"type":"v1","addr":"172.21.15.182:6819","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":9952},{"type":"v1","addr":"172.21.15.182:6823","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":9952},{"type":"v1","addr":"172.21.15.182:6821","nonce":9952}]},"public_addr":"172.21.15.182:6817/9952","cluster_addr":"172.21.15.182:6819/9952","heartbeat_back_addr":"172.21.15.182:6823/9952","heartbeat_front_addr":"172.21.15.182:6821/9952","state":["exists","up"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":9956},{"type":"v1","addr":"172.21.15.182:6809","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":9956},{"type":"v1","addr":"172.21.15.182:6811","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":9956},{"type":"v1","addr":"172.21.15.182:6815","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":9956},{"type":"v1","addr":"172.21.15.182:6813","nonce":9956}]},"public_addr":"172.21.15.182:6809/9956","cluster_addr":"172.21.15.182:6811/9956","heartbeat_back_addr":"172.21.15.182:6815/9956","heartbeat_front_addr":"172.21.15.182:6813/9956","state":["exists","up"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":10005},{"type":"v1","addr":"172.21.15.114:6803","nonce":10005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":10005},{"type":"v1","addr":"172.21.15.114:6805","nonce":10005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":10005},{"type":"v1","addr":"172.21.15.114:6809","nonce":10005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":10005},{"type":"v1","addr":"172.21.15.114:6807","nonce":10005}]},"public_addr":"172.21.15.114:6803/10005","cluster_addr":"172.21.15.114:6805/10005","heartbeat_back_addr":"172.21.15.114:6809/10005","heartbeat_front_addr":"172.21.15.114:6807/10005","state":["exists","up"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":10004},{"type":"v1","addr":"172.21.15.114:6819","nonce":10004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":10004},{"type":"v1","addr":"172.21.15.114:6821","nonce":10004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":10004},{"type":"v1","addr":"172.21.15.114:6825","nonce":10004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":10004},{"type":"v1","addr":"172.21.15.114:6823","nonce":10004}]},"public_addr":"172.21.15.114:6819/10004","cluster_addr":"172.21.15.114:6821/10004","heartbeat_back_addr":"172.21.15.114:6825/10004","heartbeat_front_addr":"172.21.15.114:6823/10004","state":["exists","up"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":10008},{"type":"v1","addr":"172.21.15.114:6827","nonce":10008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":10008},{"type":"v1","addr":"172.21.15.114:6829","nonce":10008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":10008},{"type":"v1","addr":"172.21.15.114:6833","nonce":10008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":10008},{"type":"v1","addr":"172.21.15.114:6831","nonce":10008}]},"public_addr":"172.21.15.114:6827/10008","cluster_addr":"172.21.15.114:6829/10008","heartbeat_back_addr":"172.21.15.114:6833/10008","heartbeat_front_addr":"172.21.15.114:6831/10008","state":["exists","up"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":10009},{"type":"v1","addr":"172.21.15.114:6811","nonce":10009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":10009},{"type":"v1","addr":"172.21.15.114:6813","nonce":10009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":10009},{"type":"v1","addr":"172.21.15.114:6817","nonce":10009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":10009},{"type":"v1","addr":"172.21.15.114:6815","nonce":10009}]},"public_addr":"172.21.15.114:6811/10009","cluster_addr":"172.21.15.114:6813/10009","heartbeat_back_addr":"172.21.15.114:6817/10009","heartbeat_front_addr":"172.21.15.114:6815/10009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.260662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.232597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.311093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:31.693886+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.640706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:33.027902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.422172+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.348730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:42.489 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-29T11:16:39.025591+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-29T11:16:42.490 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-29T11:16:43.248 INFO:teuthology.orchestra.run.smithi182.stdout:pg_num: 8 2019-11-29T11:16:43.264 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-29T11:16:43.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-29T11:16:43.264 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-29T11:16:44.268 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:44.282 INFO:teuthology.orchestra.run.smithi182.stdout:{"epoch":5,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":8580},{"type":"v1","addr":"172.21.15.114:6801","nonce":8580}]},"active_addr":"172.21.15.114:6801/8580","active_change":"2019-11-29T11:16:11.870427+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-29T11:16:44.290 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-29T11:16:44.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-29T11:16:44.291 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:45.072 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:45.073 INFO:teuthology.orchestra.run.smithi182.stdout:{"epoch":18,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:42.494523+0000","last_up_change":"2019-11-29T11:16:35.064922+0000","last_in_change":"2019-11-29T11:16:35.064922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T11:16:39.025591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":9950},{"type":"v1","addr":"172.21.15.182:6825","nonce":9950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":9950},{"type":"v1","addr":"172.21.15.182:6827","nonce":9950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":9950},{"type":"v1","addr":"172.21.15.182:6831","nonce":9950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":9950},{"type":"v1","addr":"172.21.15.182:6829","nonce":9950}]},"public_addr":"172.21.15.182:6825/9950","cluster_addr":"172.21.15.182:6827/9950","heartbeat_back_addr":"172.21.15.182:6831/9950","heartbeat_front_addr":"172.21.15.182:6829/9950","state":["exists","up"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":9955},{"type":"v1","addr":"172.21.15.182:6801","nonce":9955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":9955},{"type":"v1","addr":"172.21.15.182:6803","nonce":9955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":9955},{"type":"v1","addr":"172.21.15.182:6807","nonce":9955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":9955},{"type":"v1","addr":"172.21.15.182:6805","nonce":9955}]},"public_addr":"172.21.15.182:6801/9955","cluster_addr":"172.21.15.182:6803/9955","heartbeat_back_addr":"172.21.15.182:6807/9955","heartbeat_front_addr":"172.21.15.182:6805/9955","state":["exists","up"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":9952},{"type":"v1","addr":"172.21.15.182:6817","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":9952},{"type":"v1","addr":"172.21.15.182:6819","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":9952},{"type":"v1","addr":"172.21.15.182:6823","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":9952},{"type":"v1","addr":"172.21.15.182:6821","nonce":9952}]},"public_addr":"172.21.15.182:6817/9952","cluster_addr":"172.21.15.182:6819/9952","heartbeat_back_addr":"172.21.15.182:6823/9952","heartbeat_front_addr":"172.21.15.182:6821/9952","state":["exists","up"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":9956},{"type":"v1","addr":"172.21.15.182:6809","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":9956},{"type":"v1","addr":"172.21.15.182:6811","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":9956},{"type":"v1","addr":"172.21.15.182:6815","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":9956},{"type":"v1","addr":"172.21.15.182:6813","nonce":9956}]},"public_addr":"172.21.15.182:6809/9956","cluster_addr":"172.21.15.182:6811/9956","heartbeat_back_addr":"172.21.15.182:6815/9956","heartbeat_front_addr":"172.21.15.182:6813/9956","state":["exists","up"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":10005},{"type":"v1","addr":"172.21.15.114:6803","nonce":10005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":10005},{"type":"v1","addr":"172.21.15.114:6805","nonce":10005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":10005},{"type":"v1","addr":"172.21.15.114:6809","nonce":10005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":10005},{"type":"v1","addr":"172.21.15.114:6807","nonce":10005}]},"public_addr":"172.21.15.114:6803/10005","cluster_addr":"172.21.15.114:6805/10005","heartbeat_back_addr":"172.21.15.114:6809/10005","heartbeat_front_addr":"172.21.15.114:6807/10005","state":["exists","up"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":10004},{"type":"v1","addr":"172.21.15.114:6819","nonce":10004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":10004},{"type":"v1","addr":"172.21.15.114:6821","nonce":10004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":10004},{"type":"v1","addr":"172.21.15.114:6825","nonce":10004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":10004},{"type":"v1","addr":"172.21.15.114:6823","nonce":10004}]},"public_addr":"172.21.15.114:6819/10004","cluster_addr":"172.21.15.114:6821/10004","heartbeat_back_addr":"172.21.15.114:6825/10004","heartbeat_front_addr":"172.21.15.114:6823/10004","state":["exists","up"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":10008},{"type":"v1","addr":"172.21.15.114:6827","nonce":10008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":10008},{"type":"v1","addr":"172.21.15.114:6829","nonce":10008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":10008},{"type":"v1","addr":"172.21.15.114:6833","nonce":10008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":10008},{"type":"v1","addr":"172.21.15.114:6831","nonce":10008}]},"public_addr":"172.21.15.114:6827/10008","cluster_addr":"172.21.15.114:6829/10008","heartbeat_back_addr":"172.21.15.114:6833/10008","heartbeat_front_addr":"172.21.15.114:6831/10008","state":["exists","up"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":10009},{"type":"v1","addr":"172.21.15.114:6811","nonce":10009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":10009},{"type":"v1","addr":"172.21.15.114:6813","nonce":10009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":10009},{"type":"v1","addr":"172.21.15.114:6817","nonce":10009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":10009},{"type":"v1","addr":"172.21.15.114:6815","nonce":10009}]},"public_addr":"172.21.15.114:6811/10009","cluster_addr":"172.21.15.114:6813/10009","heartbeat_back_addr":"172.21.15.114:6817/10009","heartbeat_front_addr":"172.21.15.114:6815/10009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.260662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.232597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.311093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:31.693886+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.640706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:33.027902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.422172+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.348730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:45.092 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-29T11:16:45.093 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-29T11:16:45.766 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:45.767 INFO:teuthology.orchestra.run.smithi182.stdout:{"epoch":18,"fsid":"00ee8cfc-acb0-4b96-b021-b112ecfd0c77","created":"2019-11-29T11:16:05.431516+0000","modified":"2019-11-29T11:16:42.494523+0000","last_up_change":"2019-11-29T11:16:35.064922+0000","last_in_change":"2019-11-29T11:16:35.064922+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-29T11:16:39.025591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"248c9479-6097-4b92-81e9-7e5b5caf5d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6824","nonce":9950},{"type":"v1","addr":"172.21.15.182:6825","nonce":9950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6826","nonce":9950},{"type":"v1","addr":"172.21.15.182:6827","nonce":9950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6830","nonce":9950},{"type":"v1","addr":"172.21.15.182:6831","nonce":9950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6828","nonce":9950},{"type":"v1","addr":"172.21.15.182:6829","nonce":9950}]},"public_addr":"172.21.15.182:6825/9950","cluster_addr":"172.21.15.182:6827/9950","heartbeat_back_addr":"172.21.15.182:6831/9950","heartbeat_front_addr":"172.21.15.182:6829/9950","state":["exists","up"]},{"osd":1,"uuid":"ca404171-e2e7-41e9-9eb1-e63a917176a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6800","nonce":9955},{"type":"v1","addr":"172.21.15.182:6801","nonce":9955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6802","nonce":9955},{"type":"v1","addr":"172.21.15.182:6803","nonce":9955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6806","nonce":9955},{"type":"v1","addr":"172.21.15.182:6807","nonce":9955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6804","nonce":9955},{"type":"v1","addr":"172.21.15.182:6805","nonce":9955}]},"public_addr":"172.21.15.182:6801/9955","cluster_addr":"172.21.15.182:6803/9955","heartbeat_back_addr":"172.21.15.182:6807/9955","heartbeat_front_addr":"172.21.15.182:6805/9955","state":["exists","up"]},{"osd":2,"uuid":"149c52bd-183c-4e0d-97a6-8cfbb0a34f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6816","nonce":9952},{"type":"v1","addr":"172.21.15.182:6817","nonce":9952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6818","nonce":9952},{"type":"v1","addr":"172.21.15.182:6819","nonce":9952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6822","nonce":9952},{"type":"v1","addr":"172.21.15.182:6823","nonce":9952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6820","nonce":9952},{"type":"v1","addr":"172.21.15.182:6821","nonce":9952}]},"public_addr":"172.21.15.182:6817/9952","cluster_addr":"172.21.15.182:6819/9952","heartbeat_back_addr":"172.21.15.182:6823/9952","heartbeat_front_addr":"172.21.15.182:6821/9952","state":["exists","up"]},{"osd":3,"uuid":"3eee4d72-9178-4de2-a0a7-60502556f204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6808","nonce":9956},{"type":"v1","addr":"172.21.15.182:6809","nonce":9956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6810","nonce":9956},{"type":"v1","addr":"172.21.15.182:6811","nonce":9956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6814","nonce":9956},{"type":"v1","addr":"172.21.15.182:6815","nonce":9956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:6812","nonce":9956},{"type":"v1","addr":"172.21.15.182:6813","nonce":9956}]},"public_addr":"172.21.15.182:6809/9956","cluster_addr":"172.21.15.182:6811/9956","heartbeat_back_addr":"172.21.15.182:6815/9956","heartbeat_front_addr":"172.21.15.182:6813/9956","state":["exists","up"]},{"osd":4,"uuid":"f3dff3c8-71a1-48d7-ac55-5d438c0d646a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":10005},{"type":"v1","addr":"172.21.15.114:6803","nonce":10005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":10005},{"type":"v1","addr":"172.21.15.114:6805","nonce":10005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":10005},{"type":"v1","addr":"172.21.15.114:6809","nonce":10005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":10005},{"type":"v1","addr":"172.21.15.114:6807","nonce":10005}]},"public_addr":"172.21.15.114:6803/10005","cluster_addr":"172.21.15.114:6805/10005","heartbeat_back_addr":"172.21.15.114:6809/10005","heartbeat_front_addr":"172.21.15.114:6807/10005","state":["exists","up"]},{"osd":5,"uuid":"7394b94d-f88f-4682-bb77-3b8d991eb169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":10004},{"type":"v1","addr":"172.21.15.114:6819","nonce":10004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":10004},{"type":"v1","addr":"172.21.15.114:6821","nonce":10004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":10004},{"type":"v1","addr":"172.21.15.114:6825","nonce":10004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":10004},{"type":"v1","addr":"172.21.15.114:6823","nonce":10004}]},"public_addr":"172.21.15.114:6819/10004","cluster_addr":"172.21.15.114:6821/10004","heartbeat_back_addr":"172.21.15.114:6825/10004","heartbeat_front_addr":"172.21.15.114:6823/10004","state":["exists","up"]},{"osd":6,"uuid":"46d4d240-b25e-43e4-8bc6-7dc3d38b621d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":10008},{"type":"v1","addr":"172.21.15.114:6827","nonce":10008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":10008},{"type":"v1","addr":"172.21.15.114:6829","nonce":10008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":10008},{"type":"v1","addr":"172.21.15.114:6833","nonce":10008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6830","nonce":10008},{"type":"v1","addr":"172.21.15.114:6831","nonce":10008}]},"public_addr":"172.21.15.114:6827/10008","cluster_addr":"172.21.15.114:6829/10008","heartbeat_back_addr":"172.21.15.114:6833/10008","heartbeat_front_addr":"172.21.15.114:6831/10008","state":["exists","up"]},{"osd":7,"uuid":"6d9c8d5d-3262-4d88-80bd-4dc6b7e0ee52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":10009},{"type":"v1","addr":"172.21.15.114:6811","nonce":10009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":10009},{"type":"v1","addr":"172.21.15.114:6813","nonce":10009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":10009},{"type":"v1","addr":"172.21.15.114:6817","nonce":10009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":10009},{"type":"v1","addr":"172.21.15.114:6815","nonce":10009}]},"public_addr":"172.21.15.114:6811/10009","cluster_addr":"172.21.15.114:6813/10009","heartbeat_back_addr":"172.21.15.114:6817/10009","heartbeat_front_addr":"172.21.15.114:6815/10009","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.260662+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.232597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.311093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:31.693886+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.640706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:33.027902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.422172+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-29T11:16:32.348730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-29T11:16:45.785 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-29T11:16:46.287 INFO:teuthology.orchestra.run.smithi182.stdout:55834574853 2019-11-29T11:16:46.288 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-29T11:16:46.768 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:46.769 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-29T11:16:47.275 INFO:teuthology.orchestra.run.smithi182.stdout:55834574853 2019-11-29T11:16:47.275 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-29T11:16:47.800 INFO:teuthology.orchestra.run.smithi182.stdout:55834574853 2019-11-29T11:16:47.801 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-29T11:16:48.385 INFO:teuthology.orchestra.run.smithi182.stdout:60129542150 2019-11-29T11:16:48.385 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-29T11:16:48.962 INFO:teuthology.orchestra.run.smithi182.stdout:60129542150 2019-11-29T11:16:48.962 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-29T11:16:49.531 INFO:teuthology.orchestra.run.smithi182.stdout:55834574853 2019-11-29T11:16:49.531 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-29T11:16:50.154 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:50.154 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-29T11:16:51.033 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:51.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2019-11-29T11:16:51.049 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-29T11:16:51.847 INFO:teuthology.orchestra.run.smithi182.stdout:55834574855 2019-11-29T11:16:51.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2019-11-29T11:16:51.862 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-29T11:16:52.680 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:52.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2019-11-29T11:16:52.695 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-29T11:16:53.520 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:53.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2019-11-29T11:16:53.534 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-29T11:16:54.308 INFO:teuthology.orchestra.run.smithi182.stdout:60129542151 2019-11-29T11:16:54.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2019-11-29T11:16:54.326 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-29T11:16:55.223 INFO:teuthology.orchestra.run.smithi182.stdout:60129542151 2019-11-29T11:16:55.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2019-11-29T11:16:55.236 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-29T11:16:55.956 INFO:teuthology.orchestra.run.smithi182.stdout:55834574854 2019-11-29T11:16:55.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2019-11-29T11:16:55.969 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-29T11:16:56.648 INFO:teuthology.orchestra.run.smithi182.stdout:55834574855 2019-11-29T11:16:56.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2019-11-29T11:16:56.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-29T11:16:56.668 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-29T11:16:57.528 INFO:teuthology.orchestra.run.smithi182.stderr:dumped all 2019-11-29T11:16:57.529 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:57.538 INFO:teuthology.orchestra.run.smithi182.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2019-11-29T11:16:56.745713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390044,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584676,"statfs":{"total":773094113280,"available":764502708224,"internally_reserved":8589934592,"allocated":1404928,"data_stored":443310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.111897+0000","last_change":"2019-11-29T11:16:42.088172+0000","last_active":"2019-11-29T11:16:42.111897+0000","last_peered":"2019-11-29T11:16:42.111897+0000","last_clean":"2019-11-29T11:16:42.111897+0000","last_became_active":"2019-11-29T11:16:42.062556+0000","last_became_peered":"2019-11-29T11:16:42.062556+0000","last_unstale":"2019-11-29T11:16:42.111897+0000","last_undegraded":"2019-11-29T11:16:42.111897+0000","last_fullsized":"2019-11-29T11:16:42.111897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.276301+0000","last_change":"2019-11-29T11:16:42.263209+0000","last_active":"2019-11-29T11:16:42.276301+0000","last_peered":"2019-11-29T11:16:42.276301+0000","last_clean":"2019-11-29T11:16:42.276301+0000","last_became_active":"2019-11-29T11:16:42.241653+0000","last_became_peered":"2019-11-29T11:16:42.241653+0000","last_unstale":"2019-11-29T11:16:42.276301+0000","last_undegraded":"2019-11-29T11:16:42.276301+0000","last_fullsized":"2019-11-29T11:16:42.276301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.360625+0000","last_change":"2019-11-29T11:16:42.342436+0000","last_active":"2019-11-29T11:16:42.360625+0000","last_peered":"2019-11-29T11:16:42.360625+0000","last_clean":"2019-11-29T11:16:42.360625+0000","last_became_active":"2019-11-29T11:16:42.298310+0000","last_became_peered":"2019-11-29T11:16:42.298310+0000","last_unstale":"2019-11-29T11:16:42.360625+0000","last_undegraded":"2019-11-29T11:16:42.360625+0000","last_fullsized":"2019-11-29T11:16:42.360625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.013392+0000","last_change":"2019-11-29T11:16:41.946552+0000","last_active":"2019-11-29T11:16:42.013392+0000","last_peered":"2019-11-29T11:16:42.013392+0000","last_clean":"2019-11-29T11:16:42.013392+0000","last_became_active":"2019-11-29T11:16:41.884160+0000","last_became_peered":"2019-11-29T11:16:41.884160+0000","last_unstale":"2019-11-29T11:16:42.013392+0000","last_undegraded":"2019-11-29T11:16:42.013392+0000","last_fullsized":"2019-11-29T11:16:42.013392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.390152+0000","last_change":"2019-11-29T11:16:42.376198+0000","last_active":"2019-11-29T11:16:42.390152+0000","last_peered":"2019-11-29T11:16:42.390152+0000","last_clean":"2019-11-29T11:16:42.390152+0000","last_became_active":"2019-11-29T11:16:42.354877+0000","last_became_peered":"2019-11-29T11:16:42.354877+0000","last_unstale":"2019-11-29T11:16:42.390152+0000","last_undegraded":"2019-11-29T11:16:42.390152+0000","last_fullsized":"2019-11-29T11:16:42.390152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.325477+0000","last_change":"2019-11-29T11:16:42.296520+0000","last_active":"2019-11-29T11:16:42.325477+0000","last_peered":"2019-11-29T11:16:42.325477+0000","last_clean":"2019-11-29T11:16:42.325477+0000","last_became_active":"2019-11-29T11:16:42.260393+0000","last_became_peered":"2019-11-29T11:16:42.260393+0000","last_unstale":"2019-11-29T11:16:42.325477+0000","last_undegraded":"2019-11-29T11:16:42.325477+0000","last_fullsized":"2019-11-29T11:16:42.325477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.386552+0000","last_change":"2019-11-29T11:16:42.339123+0000","last_active":"2019-11-29T11:16:42.386552+0000","last_peered":"2019-11-29T11:16:42.386552+0000","last_clean":"2019-11-29T11:16:42.386552+0000","last_became_active":"2019-11-29T11:16:42.288945+0000","last_became_peered":"2019-11-29T11:16:42.288945+0000","last_unstale":"2019-11-29T11:16:42.386552+0000","last_undegraded":"2019-11-29T11:16:42.386552+0000","last_fullsized":"2019-11-29T11:16:42.386552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.048331+0000","last_change":"2019-11-29T11:16:42.028743+0000","last_active":"2019-11-29T11:16:42.048331+0000","last_peered":"2019-11-29T11:16:42.048331+0000","last_clean":"2019-11-29T11:16:42.048331+0000","last_became_active":"2019-11-29T11:16:41.979363+0000","last_became_peered":"2019-11-29T11:16:41.979363+0000","last_unstale":"2019-11-29T11:16:42.048331+0000","last_undegraded":"2019-11-29T11:16:42.048331+0000","last_fullsized":"2019-11-29T11:16:42.048331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":54908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.646}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.981}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.763}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.714}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.900}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.855}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.423}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.338}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.449}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.537}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.153}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.259}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.724}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.541}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.797}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.485}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.406}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.968}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.917}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.617}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.217}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.779}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.400}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.778}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.695}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.784}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.067}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.498}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.154}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.964}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.336}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.956}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.660}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.454}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.854}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.405}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.491}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.142}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.615}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.550}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.071}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.825}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.560}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.889}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.029}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.695}]}]}]}} 2019-11-29T11:16:57.541 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-29T11:16:58.232 INFO:teuthology.orchestra.run.smithi182.stderr:dumped all 2019-11-29T11:16:58.232 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:58.248 INFO:teuthology.orchestra.run.smithi182.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2019-11-29T11:16:56.745713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390044,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584676,"statfs":{"total":773094113280,"available":764502708224,"internally_reserved":8589934592,"allocated":1404928,"data_stored":443310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.111897+0000","last_change":"2019-11-29T11:16:42.088172+0000","last_active":"2019-11-29T11:16:42.111897+0000","last_peered":"2019-11-29T11:16:42.111897+0000","last_clean":"2019-11-29T11:16:42.111897+0000","last_became_active":"2019-11-29T11:16:42.062556+0000","last_became_peered":"2019-11-29T11:16:42.062556+0000","last_unstale":"2019-11-29T11:16:42.111897+0000","last_undegraded":"2019-11-29T11:16:42.111897+0000","last_fullsized":"2019-11-29T11:16:42.111897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.276301+0000","last_change":"2019-11-29T11:16:42.263209+0000","last_active":"2019-11-29T11:16:42.276301+0000","last_peered":"2019-11-29T11:16:42.276301+0000","last_clean":"2019-11-29T11:16:42.276301+0000","last_became_active":"2019-11-29T11:16:42.241653+0000","last_became_peered":"2019-11-29T11:16:42.241653+0000","last_unstale":"2019-11-29T11:16:42.276301+0000","last_undegraded":"2019-11-29T11:16:42.276301+0000","last_fullsized":"2019-11-29T11:16:42.276301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.360625+0000","last_change":"2019-11-29T11:16:42.342436+0000","last_active":"2019-11-29T11:16:42.360625+0000","last_peered":"2019-11-29T11:16:42.360625+0000","last_clean":"2019-11-29T11:16:42.360625+0000","last_became_active":"2019-11-29T11:16:42.298310+0000","last_became_peered":"2019-11-29T11:16:42.298310+0000","last_unstale":"2019-11-29T11:16:42.360625+0000","last_undegraded":"2019-11-29T11:16:42.360625+0000","last_fullsized":"2019-11-29T11:16:42.360625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.013392+0000","last_change":"2019-11-29T11:16:41.946552+0000","last_active":"2019-11-29T11:16:42.013392+0000","last_peered":"2019-11-29T11:16:42.013392+0000","last_clean":"2019-11-29T11:16:42.013392+0000","last_became_active":"2019-11-29T11:16:41.884160+0000","last_became_peered":"2019-11-29T11:16:41.884160+0000","last_unstale":"2019-11-29T11:16:42.013392+0000","last_undegraded":"2019-11-29T11:16:42.013392+0000","last_fullsized":"2019-11-29T11:16:42.013392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.390152+0000","last_change":"2019-11-29T11:16:42.376198+0000","last_active":"2019-11-29T11:16:42.390152+0000","last_peered":"2019-11-29T11:16:42.390152+0000","last_clean":"2019-11-29T11:16:42.390152+0000","last_became_active":"2019-11-29T11:16:42.354877+0000","last_became_peered":"2019-11-29T11:16:42.354877+0000","last_unstale":"2019-11-29T11:16:42.390152+0000","last_undegraded":"2019-11-29T11:16:42.390152+0000","last_fullsized":"2019-11-29T11:16:42.390152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.325477+0000","last_change":"2019-11-29T11:16:42.296520+0000","last_active":"2019-11-29T11:16:42.325477+0000","last_peered":"2019-11-29T11:16:42.325477+0000","last_clean":"2019-11-29T11:16:42.325477+0000","last_became_active":"2019-11-29T11:16:42.260393+0000","last_became_peered":"2019-11-29T11:16:42.260393+0000","last_unstale":"2019-11-29T11:16:42.325477+0000","last_undegraded":"2019-11-29T11:16:42.325477+0000","last_fullsized":"2019-11-29T11:16:42.325477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.386552+0000","last_change":"2019-11-29T11:16:42.339123+0000","last_active":"2019-11-29T11:16:42.386552+0000","last_peered":"2019-11-29T11:16:42.386552+0000","last_clean":"2019-11-29T11:16:42.386552+0000","last_became_active":"2019-11-29T11:16:42.288945+0000","last_became_peered":"2019-11-29T11:16:42.288945+0000","last_unstale":"2019-11-29T11:16:42.386552+0000","last_undegraded":"2019-11-29T11:16:42.386552+0000","last_fullsized":"2019-11-29T11:16:42.386552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"17","state":"active+clean","last_fresh":"2019-11-29T11:16:42.048331+0000","last_change":"2019-11-29T11:16:42.028743+0000","last_active":"2019-11-29T11:16:42.048331+0000","last_peered":"2019-11-29T11:16:42.048331+0000","last_clean":"2019-11-29T11:16:42.048331+0000","last_became_active":"2019-11-29T11:16:41.979363+0000","last_became_peered":"2019-11-29T11:16:41.979363+0000","last_unstale":"2019-11-29T11:16:42.048331+0000","last_undegraded":"2019-11-29T11:16:42.048331+0000","last_fullsized":"2019-11-29T11:16:42.048331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-29T11:16:39.828851+0000","last_clean_scrub_stamp":"2019-11-29T11:16:39.828851+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":54908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.646}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.149}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.981}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.763}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.714}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.900}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.855}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.423}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.338}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.449}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.537}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.153}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.259}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.724}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.541}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.797}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.485}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.406}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.968}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.917}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.617}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.217}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.779}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.400}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.778}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.695}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.784}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.067}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.498}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.154}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.964}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.336}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.956}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.636}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.268}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.660}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.454}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.854}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.405}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.491}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.142}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.615}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.550}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":55486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.071}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.825}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.560}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.889}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.029}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.695}]}]}]}} 2019-11-29T11:16:58.251 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-29T11:16:58.251 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-29T11:16:58.251 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-29T11:16:58.251 INFO:teuthology.orchestra.run.smithi182:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-29T11:16:59.079 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:16:59.092 INFO:teuthology.orchestra.run.smithi182.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-29T11:16:59.092 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-29T11:16:59.092 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-29T11:16:59.249 INFO:teuthology.run_tasks:Running task rgw... 2019-11-29T11:16:59.315 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-29T11:16:59.315 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-29T11:16:59.315 INFO:tasks.rgw:Creating data pools 2019-11-29T11:16:59.315 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-29T11:16:59.315 INFO:teuthology.orchestra.run.smithi182:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2019-11-29T11:17:01.241 INFO:teuthology.orchestra.run.smithi182.stderr:pool 'default.rgw.buckets.data' created 2019-11-29T11:17:01.259 INFO:teuthology.orchestra.run.smithi182:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-29T11:17:02.692 INFO:teuthology.orchestra.run.smithi182.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-29T11:17:02.714 INFO:teuthology.orchestra.run.smithi182:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-29T11:17:03.768 INFO:teuthology.orchestra.run.smithi182.stderr:pool 'default.rgw.buckets.index' created 2019-11-29T11:17:03.781 INFO:teuthology.orchestra.run.smithi182:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-29T11:17:04.896 INFO:teuthology.orchestra.run.smithi182.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-29T11:17:04.913 DEBUG:tasks.rgw:Pools created 2019-11-29T11:17:04.913 INFO:tasks.rgw:Configuring compression type = random 2019-11-29T11:17:04.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-29T11:17:04.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-29T11:17:04.914 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-29T11:17:05.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:05.077+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:07.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.820+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:07.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.820+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:07.916 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.919+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:07.916 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.919+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:07.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.924+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:07.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.924+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:07.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:07.929+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.953+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:09.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.960+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.960+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:09.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.968+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.966 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.968+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:09.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.975+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.975+0000 7f6001592ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:17:09.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.975+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:09.978 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.981+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.978 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.981+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:09.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.988+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:09.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.988+0000 7f6001592ec0 10 Creating default zonegroup 2019-11-29T11:17:09.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.988+0000 7f6001592ec0 20 get_system_obj_state: rctx=0x7fff4e70b2c0 obj=:.pools.avail state=0x557d98238a60 s->prefetch_data=0 2019-11-29T11:17:09.988 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:09.991+0000 7f6001592ec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-29T11:17:10.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:10.191+0000 7f6001592ec0 10 WARNING: store->list_zones() returned r=-2 2019-11-29T11:17:10.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:10.191+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:10.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:10.199+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:11.364 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.366+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:11.373 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.374+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:11.373 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.374+0000 7f6001592ec0 10 could not read realm id: (2) No such file or directory 2019-11-29T11:17:11.373 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.374+0000 7f6001592ec0 10 WARNING: failed to set zone as default, r=-22 2019-11-29T11:17:11.373 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.374+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:11.381 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:11.384+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:12.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.004+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:12.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.057+0000 7f6001592ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T11:17:12.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.058+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:12.108 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.110+0000 7f6001592ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T11:17:12.108 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.110+0000 7f6001592ec0 20 zonegroup default 2019-11-29T11:17:12.108 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.110+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:12.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.121+0000 7f6001592ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:12.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.121+0000 7f6001592ec0 10 Cannot find current period zone using local zone 2019-11-29T11:17:12.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.121+0000 7f6001592ec0 10 Using default name default 2019-11-29T11:17:12.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.121+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:12.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.154+0000 7f5fe7fff700 0 -- 172.21.15.182:0/2895707278 >> [v2:172.21.15.182:6800/9955,v1:172.21.15.182:6801/9955] conn(0x557d98232760 msgr2=0x557d98234b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:17:12.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.154+0000 7f6001592ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:12.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.154+0000 7f6001592ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:12.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.173+0000 7f6001592ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T11:17:12.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.173+0000 7f6001592ec0 20 zone default found 2019-11-29T11:17:12.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.173+0000 7f6001592ec0 20 started sync module instance, tier type = 2019-11-29T11:17:12.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:12.173+0000 7f6001592ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:17:15.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:15.151+0000 7f5feefc0700 0 -- 172.21.15.182:0/2895707278 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x557d98226c00 msgr2=0x557d98229020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=0 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=1 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=2 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=3 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=4 2019-11-29T11:17:16.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=5 2019-11-29T11:17:16.748 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.750+0000 7f6001592ec0 20 add_watcher() i=6 2019-11-29T11:17:16.847 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.850+0000 7f6001592ec0 20 add_watcher() i=7 2019-11-29T11:17:16.848 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.850+0000 7f6001592ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:17:16.848 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:16.850+0000 7f5fbefdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:17:20.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:20.796+0000 7f6001592ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-29T11:17:25.158 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:25.161+0000 7f6001592ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-29T11:17:29.515 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.518+0000 7f5f257fa700 20 reqs_thread_entry: start 2019-11-29T11:17:29.516 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.519+0000 7f5f1effd700 20 reqs_thread_entry: start 2019-11-29T11:17:29.516 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.519+0000 7f6001592ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:17:29.517 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.520+0000 7f5f1d7fa700 20 reqs_thread_entry: start 2019-11-29T11:17:29.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.970+0000 7f6001592ec0 20 remove_watcher() i=0 2019-11-29T11:17:29.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:29.970+0000 7f6001592ec0 2 removed watcher, disabling cache 2019-11-29T11:17:30.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.038+0000 7f6001592ec0 20 remove_watcher() i=1 2019-11-29T11:17:30.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.074+0000 7f6001592ec0 20 remove_watcher() i=2 2019-11-29T11:17:30.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.167+0000 7f6001592ec0 20 remove_watcher() i=3 2019-11-29T11:17:30.248 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.251+0000 7f6001592ec0 20 remove_watcher() i=4 2019-11-29T11:17:30.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.327+0000 7f6001592ec0 20 remove_watcher() i=5 2019-11-29T11:17:30.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.415+0000 7f6001592ec0 20 remove_watcher() i=6 2019-11-29T11:17:30.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.467+0000 7f6001592ec0 20 remove_watcher() i=7 2019-11-29T11:17:30.473 INFO:teuthology.orchestra.run.smithi182.stdout:[] 2019-11-29T11:17:30.473 DEBUG:tasks.util.rgw: json result: [] 2019-11-29T11:17:30.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-29T11:17:30.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-29T11:17:30.474 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-29T11:17:30.736 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.738+0000 7f4993fff700 20 reqs_thread_entry: start 2019-11-29T11:17:30.736 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.738+0000 7f4a631dfec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:30.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.752+0000 7f4a631dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:30.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.752+0000 7f4a631dfec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:30.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.773+0000 7f4a631dfec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-29T11:17:30.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.773+0000 7f4a631dfec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:30.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.777+0000 7f4a631dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:30.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.777+0000 7f4a631dfec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:30.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.785+0000 7f4a631dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:30.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.785+0000 7f4a631dfec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:30.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:30.808+0000 7f4a631dfec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T11:17:30.965 INFO:teuthology.orchestra.run.smithi182.stdout:{"id":"9baad822-b080-4db2-b995-bf7cc78f9da0","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T11:17:30.966 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'9baad822-b080-4db2-b995-bf7cc78f9da0', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T11:17:30.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-29T11:17:30.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-29T11:17:30.966 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-29T11:17:31.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.164+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.189+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.189+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.197 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.200+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.200+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.206+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.206+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.214+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:31.482 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.485+0000 7efe40dbcec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:17:31.482 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.485+0000 7efe40dbcec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:17:31.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.485+0000 7efe40dbcec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:17:31.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.485+0000 7efe40dbcec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:17:31.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.485+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.501+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:31.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.501+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.524+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T11:17:31.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.524+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.536 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.539+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:31.536 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.539+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.556 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.559+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T11:17:31.556 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.559+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.566 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.570+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.570+0000 7efe40dbcec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:17:31.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.570+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.575 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.578+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.578+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.595+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:31.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.595+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.616+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T11:17:31.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.616+0000 7efe40dbcec0 20 zonegroup default 2019-11-29T11:17:31.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.616+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.624 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.627+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.624 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.627+0000 7efe40dbcec0 10 Cannot find current period zone using local zone 2019-11-29T11:17:31.624 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.627+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.636+0000 7efe40dbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:31.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.636+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.652+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:31.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.652+0000 7efe40dbcec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:31.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.670+0000 7efe40dbcec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T11:17:31.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.670+0000 7efe40dbcec0 20 zone default found 2019-11-29T11:17:31.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.670+0000 7efe40dbcec0 20 started sync module instance, tier type = 2019-11-29T11:17:31.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:31.670+0000 7efe40dbcec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:17:32.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=0 2019-11-29T11:17:32.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=1 2019-11-29T11:17:32.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=2 2019-11-29T11:17:32.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=3 2019-11-29T11:17:32.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=4 2019-11-29T11:17:32.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.120+0000 7efe40dbcec0 20 add_watcher() i=5 2019-11-29T11:17:32.127 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.130+0000 7efe40dbcec0 20 add_watcher() i=6 2019-11-29T11:17:32.158 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.162+0000 7efe40dbcec0 20 add_watcher() i=7 2019-11-29T11:17:32.159 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.162+0000 7efe40dbcec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:17:32.159 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.162+0000 7efdfe7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:17:32.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.166+0000 7efe2d7e8700 0 -- 172.21.15.182:0/1959862894 >> v1:172.21.15.182:6789/0 conn(0x5586fb376e10 legacy=0x5586fb379320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:17:32.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:32.212+0000 7efe2e7ea700 0 -- 172.21.15.182:0/4081262064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd700026d0 msgr2=0x7efd70002ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:17:34.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.820+0000 7efd74ff9700 20 reqs_thread_entry: start 2019-11-29T11:17:34.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.820+0000 7efd6e7fc700 20 reqs_thread_entry: start 2019-11-29T11:17:34.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.820+0000 7efe40dbcec0 20 init_complete bucket index max shards: 0 2019-11-29T11:17:34.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.821+0000 7efd6cff9700 20 reqs_thread_entry: start 2019-11-29T11:17:34.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.972+0000 7efe40dbcec0 20 remove_watcher() i=0 2019-11-29T11:17:34.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:34.972+0000 7efe40dbcec0 2 removed watcher, disabling cache 2019-11-29T11:17:35.029 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.030+0000 7efe40dbcec0 20 remove_watcher() i=1 2019-11-29T11:17:35.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.077+0000 7efe40dbcec0 20 remove_watcher() i=2 2019-11-29T11:17:35.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.105+0000 7efe40dbcec0 20 remove_watcher() i=3 2019-11-29T11:17:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.154+0000 7efe40dbcec0 20 remove_watcher() i=4 2019-11-29T11:17:35.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.190+0000 7efe40dbcec0 20 remove_watcher() i=5 2019-11-29T11:17:35.239 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.241+0000 7efe40dbcec0 20 remove_watcher() i=6 2019-11-29T11:17:35.279 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.281+0000 7efe40dbcec0 20 remove_watcher() i=7 2019-11-29T11:17:35.287 INFO:teuthology.orchestra.run.smithi182.stdout:[] 2019-11-29T11:17:35.287 DEBUG:tasks.util.rgw: json result: [] 2019-11-29T11:17:35.288 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-29T11:17:35.288 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-29T11:17:35.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-29T11:17:35.288 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-29T11:17:35.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.531+0000 7f4927fff700 20 reqs_thread_entry: start 2019-11-29T11:17:35.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.531+0000 7f49f74bdec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:35.539 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.542+0000 7f49f74bdec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:35.540 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.542+0000 7f49f74bdec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:35.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.550+0000 7f49f74bdec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:35.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.550+0000 7f49f74bdec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:35.575 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.578+0000 7f49f74bdec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-29T11:17:35.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.578+0000 7f49f74bdec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:35.601 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:35.603+0000 7f49f74bdec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T11:17:35.788 INFO:teuthology.orchestra.run.smithi182.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-29T11:17:35.789 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-29T11:17:35.789 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-29T11:17:35.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-29T11:17:35.789 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-29T11:17:36.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.066+0000 7f1aa8459ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.066+0000 7f19fd7fa700 20 reqs_thread_entry: start 2019-11-29T11:17:36.080 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.082+0000 7f1aa8459ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:36.080 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.083+0000 7f1aa8459ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.100+0000 7f1aa8459ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-29T11:17:36.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.100+0000 7f1aa8459ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.106+0000 7f1aa8459ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:36.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.106+0000 7f1aa8459ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.116+0000 7f1aa8459ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:36.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.116+0000 7f1aa8459ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.350+0000 7f1aa8459ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-29T11:17:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:{"id":"9baad822-b080-4db2-b995-bf7cc78f9da0","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T11:17:36.431 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'9baad822-b080-4db2-b995-bf7cc78f9da0', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T11:17:36.432 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-29T11:17:36.432 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-29T11:17:36.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-29T11:17:36.433 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-29T11:17:36.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.689+0000 7f68627fc700 20 reqs_thread_entry: start 2019-11-29T11:17:36.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.689+0000 7f692d33aec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.697 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.699+0000 7f692d33aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:36.698 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.699+0000 7f692d33aec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.709+0000 7f692d33aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:36.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.709+0000 7f692d33aec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.731 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.733+0000 7f692d33aec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-29T11:17:36.731 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.733+0000 7f692d33aec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:36.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:36.759+0000 7f692d33aec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-29T11:17:36.835 INFO:teuthology.orchestra.run.smithi182.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-29T11:17:36.835 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-29T11:17:36.836 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-29T11:17:36.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-29T11:17:36.836 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-29T11:17:37.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.074+0000 7f182d7fa700 20 reqs_thread_entry: start 2019-11-29T11:17:37.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.074+0000 7f18f0553ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:37.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.089+0000 7f18f0553ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:37.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.089+0000 7f18f0553ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:37.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.105+0000 7f18f0553ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-29T11:17:37.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.106+0000 7f18f0553ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:37.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.109+0000 7f18f0553ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:17:37.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.109+0000 7f18f0553ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:37.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.117+0000 7f18f0553ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:17:37.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.117+0000 7f18f0553ec0 20 rados->read ofs=0 len=0 2019-11-29T11:17:37.127 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:17:37.130+0000 7f18f0553ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:17:37.181 INFO:teuthology.orchestra.run.smithi182.stdout:{"id":"9baad822-b080-4db2-b995-bf7cc78f9da0","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-29T11:17:37.181 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'9baad822-b080-4db2-b995-bf7cc78f9da0', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-29T11:17:37.182 INFO:tasks.rgw:Starting rgw... 2019-11-29T11:17:37.182 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-29T11:17:37.182 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-11-29T11:17:37.182 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-29T11:17:37.182 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-29T11:17:37.183 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-29T11:17:37.187 INFO:tasks.rgw.client.0:Started 2019-11-29T11:17:37.187 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:37.187 INFO:teuthology.orchestra.run.smithi182:> curl http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:37.269 INFO:teuthology.orchestra.run.smithi182.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T11:17:37.269 INFO:teuthology.orchestra.run.smithi182.stderr: Dload Upload Total Spent Left Speed 2019-11-29T11:17:37.274 INFO:teuthology.orchestra.run.smithi182.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi182.front.sepia.ceph.com:80; Connection refused 2019-11-29T11:17:37.274 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T11:17:38.275 INFO:teuthology.orchestra.run.smithi182:> curl http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:38.354 INFO:teuthology.orchestra.run.smithi182.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T11:17:38.354 INFO:teuthology.orchestra.run.smithi182.stderr: Dload Upload Total Spent Left Speed 2019-11-29T11:17:38.357 INFO:teuthology.orchestra.run.smithi182.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi182.front.sepia.ceph.com:80; Connection refused 2019-11-29T11:17:38.358 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T11:17:40.358 INFO:teuthology.orchestra.run.smithi182:> curl http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:40.451 INFO:teuthology.orchestra.run.smithi182.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T11:17:40.451 INFO:teuthology.orchestra.run.smithi182.stderr: Dload Upload Total Spent Left Speed 2019-11-29T11:17:40.455 INFO:teuthology.orchestra.run.smithi182.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi182.front.sepia.ceph.com:80; Connection refused 2019-11-29T11:17:40.455 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T11:17:44.457 INFO:teuthology.orchestra.run.smithi182:> curl http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:44.541 INFO:teuthology.orchestra.run.smithi182.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T11:17:44.697 INFO:teuthology.orchestra.run.smithi182.stderr: Dload Upload Total Spent Left Speed 2019-11-29T11:17:44.699 INFO:teuthology.orchestra.run.smithi182.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi182.front.sepia.ceph.com:80; Connection refused 2019-11-29T11:17:44.699 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-29T11:17:52.700 INFO:teuthology.orchestra.run.smithi182:> curl http://smithi182.front.sepia.ceph.com:80/ 2019-11-29T11:17:52.746 INFO:teuthology.orchestra.run.smithi182.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-29T11:17:52.747 INFO:teuthology.orchestra.run.smithi182.stderr: Dload Upload Total Spent Left Speed 2019-11-29T11:17:53.384 INFO:teuthology.orchestra.run.smithi182.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 335 0 --:--:-- --:--:-- --:--:-- 334 2019-11-29T11:17:53.385 INFO:teuthology.orchestra.run.smithi182.stdout:anonymous 2019-11-29T11:17:53.385 INFO:teuthology.run_tasks:Running task workunit... 2019-11-29T11:17:53.401 INFO:tasks.workunit:Pulling workunits from ref 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:17:53.401 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-29T11:17:53.402 INFO:teuthology.orchestra.run.smithi182:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-29T11:17:53.454 INFO:teuthology.orchestra.run.smithi182.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-29T11:17:53.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T11:17:53.455 INFO:teuthology.orchestra.run.smithi182:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-29T11:17:53.503 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-29T11:17:53.503 INFO:teuthology.orchestra.run.smithi182:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-29T11:17:53.559 INFO:tasks.workunit:timeout=3h 2019-11-29T11:17:53.559 INFO:tasks.workunit:cleanup=True 2019-11-29T11:17:53.559 INFO:teuthology.orchestra.run.smithi182:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 656c8e8049c2c1acd363143c842c2edf1fe09b64 2019-11-29T11:17:53.843 INFO:tasks.workunit.client.0.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-29T11:18:55.662 INFO:tasks.workunit.client.0.smithi182.stderr:Note: checking out '656c8e8049c2c1acd363143c842c2edf1fe09b64'. 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr: 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr:state without impacting any branches by performing another checkout. 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr: 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-29T11:18:55.663 INFO:tasks.workunit.client.0.smithi182.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-29T11:18:55.664 INFO:tasks.workunit.client.0.smithi182.stderr: 2019-11-29T11:18:55.664 INFO:tasks.workunit.client.0.smithi182.stderr: git checkout -b new_branch_name 2019-11-29T11:18:55.664 INFO:tasks.workunit.client.0.smithi182.stderr: 2019-11-29T11:18:55.664 INFO:tasks.workunit.client.0.smithi182.stderr:HEAD is now at 656c8e8... Merge pull request #31856 from rzarzynski/wip-crimson-errorator-handle_error 2019-11-29T11:18:55.665 INFO:teuthology.orchestra.run.smithi182:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-29T11:18:55.717 INFO:tasks.workunit.client.0.smithi182.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-29T11:18:55.720 INFO:tasks.workunit.client.0.smithi182.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-29T11:18:55.720 INFO:tasks.workunit.client.0.smithi182.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-29T11:18:56.201 INFO:tasks.workunit.client.0.smithi182.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-29T11:18:56.290 INFO:tasks.workunit.client.0.smithi182.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-29T11:18:56.342 INFO:tasks.workunit.client.0.smithi182.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-29T11:18:56.345 INFO:tasks.workunit.client.0.smithi182.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-29T11:18:56.345 INFO:tasks.workunit.client.0.smithi182.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-29T11:18:56.396 INFO:tasks.workunit.client.0.smithi182.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-29T11:18:56.453 DEBUG:teuthology.orchestra.remote:smithi182:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-29T11:18:56.511 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-29T11:18:56.511 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-29T11:18:56.512 INFO:teuthology.orchestra.run.smithi182:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-29T11:18:56.578 INFO:tasks.workunit.client.0.smithi182.stdout:Running main() from gmock_main.cc 2019-11-29T11:18:56.579 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-29T11:18:56.579 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment set-up. 2019-11-29T11:18:56.579 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 11 tests from ClsLock 2019-11-29T11:18:56.579 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-29T11:18:58.598 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:18:58.598 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: exclusive 2019-11-29T11:18:58.598 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:18:58.598 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:18:58.599 INFO:tasks.workunit.client.0.smithi182.stdout: client.4364 expiration=2019-11-29T11:20:58.449872+0000 addr=v1:172.21.15.182:0/2554388415 cookie= 2019-11-29T11:18:58.726 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:18:58.726 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: shared 2019-11-29T11:18:58.726 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:18:58.726 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:18:58.727 INFO:tasks.workunit.client.0.smithi182.stdout: client.4364 expiration=2019-11-29T11:20:58.686741+0000 addr=v1:172.21.15.182:0/2554388415 cookie= 2019-11-29T11:18:58.727 INFO:tasks.workunit.client.0.smithi182.stdout: client.4540 expiration=0.000000 addr=v1:172.21.15.182:0/3703783337 cookie= 2019-11-29T11:18:58.770 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:18:58.770 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: shared 2019-11-29T11:18:58.770 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:18:58.770 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:18:58.770 INFO:tasks.workunit.client.0.smithi182.stdout: client.4540 expiration=0.000000 addr=v1:172.21.15.182:0/3703783337 cookie= 2019-11-29T11:18:59.152 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestMultiLocking (2581 ms) 2019-11-29T11:18:59.153 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestMeta 2019-11-29T11:19:01.835 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:19:01.835 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: shared 2019-11-29T11:19:01.836 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:19:01.836 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:19:01.836 INFO:tasks.workunit.client.0.smithi182.stdout: client.4539 expiration=0.000000 addr=v1:172.21.15.182:0/695894761 cookie= 2019-11-29T11:19:01.917 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:19:01.917 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: exclusive 2019-11-29T11:19:01.918 INFO:tasks.workunit.client.0.smithi182.stdout: tag: new_tag 2019-11-29T11:19:01.918 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:19:01.918 INFO:tasks.workunit.client.0.smithi182.stdout: client.4536 expiration=0.000000 addr=v1:172.21.15.182:0/2528767248 cookie= 2019-11-29T11:19:02.496 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestMeta (3342 ms) 2019-11-29T11:19:02.496 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestCookie 2019-11-29T11:19:05.341 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:19:05.341 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: exclusive 2019-11-29T11:19:05.341 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:19:05.341 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:19:05.416 INFO:tasks.workunit.client.0.smithi182.stdout:lock: mylock 2019-11-29T11:19:05.417 INFO:tasks.workunit.client.0.smithi182.stdout: lock_type: shared 2019-11-29T11:19:05.417 INFO:tasks.workunit.client.0.smithi182.stdout: tag: 2019-11-29T11:19:05.417 INFO:tasks.workunit.client.0.smithi182.stdout: lockers: 2019-11-29T11:19:05.417 INFO:tasks.workunit.client.0.smithi182.stdout: client.4552 expiration=0.000000 addr=v1:172.21.15.182:0/227260899 cookie= 2019-11-29T11:19:05.417 INFO:tasks.workunit.client.0.smithi182.stdout: client.4552 expiration=0.000000 addr=v1:172.21.15.182:0/227260899 cookie=new cookie 2019-11-29T11:19:05.844 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestCookie (3350 ms) 2019-11-29T11:19:05.844 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-29T11:19:09.446 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestMultipleLocks (3602 ms) 2019-11-29T11:19:09.447 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-29T11:19:18.140 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestLockDuration (8694 ms) 2019-11-29T11:19:18.141 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-29T11:19:21.600 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestAssertLocked (3460 ms) 2019-11-29T11:19:21.600 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-29T11:19:25.006 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestSetCookie (3407 ms) 2019-11-29T11:19:25.007 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestRenew 2019-11-29T11:19:46.523 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestRenew (21516 ms) 2019-11-29T11:19:46.523 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-29T11:19:53.907 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7385 ms) 2019-11-29T11:19:53.907 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-29T11:20:02.788 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8880 ms) 2019-11-29T11:20:02.789 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-29T11:20:11.896 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (9108 ms) 2019-11-29T11:20:11.896 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 11 tests from ClsLock (75325 ms total) 2019-11-29T11:20:11.896 INFO:tasks.workunit.client.0.smithi182.stdout: 2019-11-29T11:20:11.896 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment tear-down 2019-11-29T11:20:11.896 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] 11 tests from 1 test suite ran. (75325 ms total) 2019-11-29T11:20:11.897 INFO:tasks.workunit.client.0.smithi182.stdout:[ PASSED ] 11 tests. 2019-11-29T11:20:11.898 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T11:20:11.898 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T11:20:12.082 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-29T11:20:12.083 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-29T11:20:12.083 INFO:teuthology.orchestra.run.smithi182:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-29T11:20:12.153 INFO:tasks.workunit.client.0.smithi182.stdout:Running main() from gmock_main.cc 2019-11-29T11:20:12.153 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-29T11:20:12.153 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment set-up. 2019-11-29T11:20:12.153 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 4 tests from cls_log 2019-11-29T11:20:12.153 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-29T11:20:15.323 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_log.test_log_add_same_time (3171 ms) 2019-11-29T11:20:15.323 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-29T11:20:18.763 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_log.test_log_add_different_time (3441 ms) 2019-11-29T11:20:18.763 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_log.trim_by_time 2019-11-29T11:20:23.985 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_log.trim_by_time (5222 ms) 2019-11-29T11:20:23.986 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-29T11:20:27.425 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_log.trim_by_marker (3438 ms) 2019-11-29T11:20:27.433 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 4 tests from cls_log (15272 ms total) 2019-11-29T11:20:27.433 INFO:tasks.workunit.client.0.smithi182.stdout: 2019-11-29T11:20:27.434 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment tear-down 2019-11-29T11:20:27.434 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] 4 tests from 1 test suite ran. (15272 ms total) 2019-11-29T11:20:27.434 INFO:tasks.workunit.client.0.smithi182.stdout:[ PASSED ] 4 tests. 2019-11-29T11:20:27.436 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T11:20:27.448 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T11:20:27.536 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-29T11:20:27.537 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-29T11:20:27.537 INFO:teuthology.orchestra.run.smithi182:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-29T11:20:27.600 INFO:tasks.workunit.client.0.smithi182.stdout:Running main() from gmock_main.cc 2019-11-29T11:20:27.600 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-29T11:20:27.600 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment set-up. 2019-11-29T11:20:27.601 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 5 tests from cls_rgw 2019-11-29T11:20:27.601 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-29T11:20:30.878 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.test_implicit (3281 ms) 2019-11-29T11:20:30.878 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-29T11:20:34.414 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3536 ms) 2019-11-29T11:20:34.414 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-29T11:20:43.741 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T11:20:43.733+0000 38791700 -1 osd.2 pg_epoch: 99 pg[25.6( v 98'4 (0'0,98'4] local-lis/les=94/95 n=2 ec=94/94 lis/c=94/94 les/c/f=95/95/0 sis=94) [2,1] r=0 lpr=94 crt=97'3 lcod 97'3 mlcod 97'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-29T11:20:45.518 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.test_put_snap (11104 ms) 2019-11-29T11:20:45.518 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-29T11:20:49.083 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.test_explicit (3562 ms) 2019-11-29T11:20:49.083 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.set 2019-11-29T11:20:52.497 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.set (3414 ms) 2019-11-29T11:20:52.497 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 5 tests from cls_rgw (24897 ms total) 2019-11-29T11:20:52.497 INFO:tasks.workunit.client.0.smithi182.stdout: 2019-11-29T11:20:52.498 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment tear-down 2019-11-29T11:20:52.498 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] 5 tests from 1 test suite ran. (24897 ms total) 2019-11-29T11:20:52.498 INFO:tasks.workunit.client.0.smithi182.stdout:[ PASSED ] 5 tests. 2019-11-29T11:20:52.498 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T11:20:52.498 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T11:20:52.567 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-29T11:20:52.568 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-29T11:20:52.569 INFO:teuthology.orchestra.run.smithi182:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-29T11:20:52.624 INFO:tasks.workunit.client.0.smithi182.stdout:Running main() from gmock_main.cc 2019-11-29T11:20:52.624 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-29T11:20:52.625 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment set-up. 2019-11-29T11:20:52.625 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 13 tests from cls_rgw 2019-11-29T11:20:54.712 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.index_basic 2019-11-29T11:20:57.335 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.index_basic (2631 ms) 2019-11-29T11:20:57.335 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-29T11:20:59.037 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1701 ms) 2019-11-29T11:20:59.037 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-29T11:21:01.256 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.index_remove_object (2220 ms) 2019-11-29T11:21:01.257 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-29T11:21:28.353 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.index_suggest (27096 ms) 2019-11-29T11:21:28.353 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.index_list 2019-11-29T11:21:30.013 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.index_list (1660 ms) 2019-11-29T11:21:30.013 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.bi_list 2019-11-29T11:21:33.268 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.bi_list (3255 ms) 2019-11-29T11:21:33.268 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.gc_set 2019-11-29T11:21:33.937 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.gc_set (632 ms) 2019-11-29T11:21:33.937 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.gc_list 2019-11-29T11:21:34.547 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.gc_list (648 ms) 2019-11-29T11:21:34.548 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-29T11:21:42.895 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.gc_defer (8347 ms) 2019-11-29T11:21:42.895 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-29T11:21:51.453 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.usage_basic (8559 ms) 2019-11-29T11:21:51.453 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-29T11:21:51.510 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.usage_clear_no_obj (56 ms) 2019-11-29T11:21:51.510 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-29T11:22:04.240 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.usage_clear (12731 ms) 2019-11-29T11:22:04.241 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-29T11:22:06.308 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] cls_rgw.bi_log_trim (2067 ms) 2019-11-29T11:22:06.480 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 13 tests from cls_rgw (71604 ms total) 2019-11-29T11:22:06.481 INFO:tasks.workunit.client.0.smithi182.stdout: 2019-11-29T11:22:06.481 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment tear-down 2019-11-29T11:22:06.481 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] 13 tests from 1 test suite ran. (73857 ms total) 2019-11-29T11:22:06.481 INFO:tasks.workunit.client.0.smithi182.stdout:[ PASSED ] 13 tests. 2019-11-29T11:22:06.482 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T11:22:06.483 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T11:22:06.552 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-29T11:22:06.552 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-29T11:22:06.553 INFO:teuthology.orchestra.run.smithi182:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=656c8e8049c2c1acd363143c842c2edf1fe09b64 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-29T11:22:06.632 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-29T11:22:06.632 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment set-up. 2019-11-29T11:22:08.880 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 6 tests from rgw_gc_log 2019-11-29T11:22:08.893 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-29T11:22:09.453 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.init_existing_queue (576 ms) 2019-11-29T11:22:09.453 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-29T11:22:09.547 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.init_existing_omap (92 ms) 2019-11-29T11:22:09.572 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-29T11:22:09.645 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (99 ms) 2019-11-29T11:22:09.645 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-29T11:22:09.724 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (80 ms) 2019-11-29T11:22:09.724 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-29T11:22:09.839 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.defer1_after_init (115 ms) 2019-11-29T11:22:09.840 INFO:tasks.workunit.client.0.smithi182.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-29T11:22:10.074 INFO:tasks.workunit.client.0.smithi182.stdout:[ OK ] rgw_gc_log.defer2_before_init (235 ms) 2019-11-29T11:22:10.075 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] 6 tests from rgw_gc_log (1197 ms total) 2019-11-29T11:22:10.075 INFO:tasks.workunit.client.0.smithi182.stdout: 2019-11-29T11:22:10.075 INFO:tasks.workunit.client.0.smithi182.stdout:[----------] Global test environment tear-down 2019-11-29T11:22:11.040 INFO:tasks.workunit.client.0.smithi182.stdout:[==========] 6 tests from 1 test suite ran. (4408 ms total) 2019-11-29T11:22:11.040 INFO:tasks.workunit.client.0.smithi182.stdout:[ PASSED ] 6 tests. 2019-11-29T11:22:11.051 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-29T11:22:11.051 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-29T11:22:11.138 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-29T11:22:11.139 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-29T11:22:11.410 DEBUG:teuthology.parallel:result is None 2019-11-29T11:22:11.411 INFO:teuthology.orchestra.run.smithi182:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T11:22:11.477 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T11:22:11.477 INFO:teuthology.orchestra.run.smithi182:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-29T11:22:11.531 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-29T11:22:11.531 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-29T11:22:11.550 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-29T11:22:11.550 INFO:tasks.ragweed:Downloading ragweed... 2019-11-29T11:22:11.551 INFO:tasks.ragweed:Using branch 'wip-yuval-master' for ragweed 2019-11-29T11:22:11.551 INFO:teuthology.orchestra.run.smithi182:> git clone -b wip-yuval-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-29T11:22:11.613 INFO:teuthology.orchestra.run.smithi182.stderr:fatal: Remote branch wip-yuval-master not found in upstream origin 2019-11-29T11:22:11.614 INFO:teuthology.orchestra.run.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-29T11:22:11.614 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-29T11:22:11.614 INFO:teuthology.orchestra.run.smithi182:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-29T11:22:11.719 INFO:teuthology.orchestra.run.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-29T11:22:11.868 INFO:tasks.ragweed:Creating rgw users... 2019-11-29T11:22:11.868 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-29T11:22:11.869 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key LLVEVIGWFNSGUTPBCKPZ --secret Jbc63r6RgriHyBgom14OMpCErMXsB0bhnuJAUk8AvSFAyjYjMOU4NQ== --email sysuser.client.0+test@test.test --system true 2019-11-29T11:22:12.004 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.011+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.025 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.031+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.025 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.032+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.038 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.045+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.038 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.045+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.059+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.059+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.061 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.068+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:12.231 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.238+0000 7fded3f9eec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:22:12.232 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.238+0000 7fded3f9eec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:22:12.232 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.238+0000 7fded3f9eec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:22:12.232 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.238+0000 7fded3f9eec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:22:12.232 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.238+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.245+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:12.239 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.245+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.256+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:22:12.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.256+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.256 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.263+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:12.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.263+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.268 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.274+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:22:12.268 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.274+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.282+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.282+0000 7fded3f9eec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.282+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.287+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.287+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.294+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:12.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.294+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.316+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:22:12.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.316+0000 7fded3f9eec0 20 zonegroup default 2019-11-29T11:22:12.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.316+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.322+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.322+0000 7fded3f9eec0 10 Cannot find current period zone using local zone 2019-11-29T11:22:12.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.322+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.323 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.327+0000 7fded3f9eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:12.323 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.327+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.336 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.334+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:12.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.334+0000 7fded3f9eec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:12.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.345+0000 7fded3f9eec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:22:12.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.345+0000 7fded3f9eec0 20 zone default found 2019-11-29T11:22:12.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.345+0000 7fded3f9eec0 20 started sync module instance, tier type = 2019-11-29T11:22:12.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.345+0000 7fded3f9eec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:22:12.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=0 2019-11-29T11:22:12.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=1 2019-11-29T11:22:12.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=2 2019-11-29T11:22:12.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=3 2019-11-29T11:22:12.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=4 2019-11-29T11:22:12.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=5 2019-11-29T11:22:12.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.707+0000 7fded3f9eec0 20 add_watcher() i=6 2019-11-29T11:22:12.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.745+0000 7fded3f9eec0 20 add_watcher() i=7 2019-11-29T11:22:12.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.745+0000 7fded3f9eec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:22:12.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.745+0000 7fde91fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:22:12.761 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.768+0000 7fdeb89ca700 0 -- 172.21.15.182:0/3743848417 >> v1:172.21.15.182:6789/0 conn(0x559fc038b860 legacy=0x559fc038dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:22:12.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:12.887+0000 7fdec11cb700 0 -- 172.21.15.182:0/3743848417 >> [v2:172.21.15.182:6800/9955,v1:172.21.15.182:6801/9955] conn(0x559fc0390050 msgr2=0x559fc03a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:22:14.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.631+0000 7fde03fff700 20 reqs_thread_entry: start 2019-11-29T11:22:14.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.631+0000 7fde01ffb700 20 reqs_thread_entry: start 2019-11-29T11:22:14.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.631+0000 7fded3f9eec0 20 init_complete bucket index max shards: 0 2019-11-29T11:22:14.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.632+0000 7fddeffff700 20 reqs_thread_entry: start 2019-11-29T11:22:14.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.632+0000 7fded3f9eec0 20 get_system_obj_state: rctx=0x7fffa80059d8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x559fc04045e0 s->prefetch_data=0 2019-11-29T11:22:14.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.632+0000 7fded3f9eec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.652+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.652+0000 7fded3f9eec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.652+0000 7fded3f9eec0 20 get_system_obj_state: rctx=0x7fffa80059e8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x559fc0406370 s->prefetch_data=0 2019-11-29T11:22:14.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.652+0000 7fded3f9eec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-29T11:22:14.669 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.666+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-29T11:22:14.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.666+0000 7fded3f9eec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T11:22:14.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.666+0000 7fded3f9eec0 20 get_system_obj_state: rctx=0x7fffa80059e8 obj=default.rgw.meta:users.keys:LLVEVIGWFNSGUTPBCKPZ state=0x559fc0406370 s->prefetch_data=0 2019-11-29T11:22:14.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.666+0000 7fded3f9eec0 10 cache get: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ : miss 2019-11-29T11:22:14.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.689+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ info.flags=0x0 2019-11-29T11:22:14.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.689+0000 7fded3f9eec0 10 adding default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ to cache LRU end 2019-11-29T11:22:14.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.689+0000 7fded3f9eec0 20 get_system_obj_state: rctx=0x7fffa80055f8 obj=default.rgw.meta:users.keys:LLVEVIGWFNSGUTPBCKPZ state=0x559fc0406370 s->prefetch_data=0 2019-11-29T11:22:14.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.689+0000 7fded3f9eec0 10 cache get: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ : type miss (requested=0x6, cached=0x0) 2019-11-29T11:22:14.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.706+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ info.flags=0x0 2019-11-29T11:22:14.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.706+0000 7fded3f9eec0 10 moving default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ to cache LRU end 2019-11-29T11:22:14.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.706+0000 7fded3f9eec0 20 get_system_obj_state: rctx=0x7fffa8005778 obj=default.rgw.meta:users.keys:LLVEVIGWFNSGUTPBCKPZ state=0x559fc0406370 s->prefetch_data=0 2019-11-29T11:22:14.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.706+0000 7fded3f9eec0 10 cache get: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ : type miss (requested=0x6, cached=0x0) 2019-11-29T11:22:14.710 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.717+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ info.flags=0x0 2019-11-29T11:22:14.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.717+0000 7fded3f9eec0 10 moving default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ to cache LRU end 2019-11-29T11:22:14.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.791+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-29T11:22:14.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.791+0000 7fded3f9eec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T11:22:14.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.791+0000 7fded3f9eec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-29T11:22:14.819 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.826+0000 7fdea27fc700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94144612961696 notifier 4457 bl.length()=637 2019-11-29T11:22:14.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.826+0000 7fdea27fc700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-29T11:22:14.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:14.826+0000 7fdea27fc700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T11:22:15.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.352+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-29T11:22:15.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.352+0000 7fded3f9eec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T11:22:15.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.352+0000 7fded3f9eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-29T11:22:15.390 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.397+0000 7fdea27fc700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94144612979792 notifier 4457 bl.length()=202 2019-11-29T11:22:15.391 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.397+0000 7fdea27fc700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-29T11:22:15.391 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.397+0000 7fdea27fc700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-29T11:22:15.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.500+0000 7fded3f9eec0 10 cache put: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ info.flags=0x7 2019-11-29T11:22:15.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.500+0000 7fded3f9eec0 10 moving default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ to cache LRU end 2019-11-29T11:22:15.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.500+0000 7fded3f9eec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=190 2019-11-29T11:22:15.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.529+0000 7fdea27fc700 10 RGWWatcher::handle_notify() notify_id 515396075521 cookie 94144612979792 notifier 4457 bl.length()=190 2019-11-29T11:22:15.523 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.529+0000 7fdea27fc700 10 cache put: name=default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ info.flags=0x7 2019-11-29T11:22:15.523 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.529+0000 7fdea27fc700 10 moving default.rgw.meta+users.keys+LLVEVIGWFNSGUTPBCKPZ to cache LRU end 2019-11-29T11:22:15.842 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T11:22:15.842 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "sysuser.client.0", 2019-11-29T11:22:15.842 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T11:22:15.843 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "sysuser.client.0", 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "LLVEVIGWFNSGUTPBCKPZ", 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "Jbc63r6RgriHyBgom14OMpCErMXsB0bhnuJAUk8AvSFAyjYjMOU4NQ==" 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T11:22:15.844 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T11:22:15.845 INFO:teuthology.orchestra.run.smithi182.stdout: "system": "true", 2019-11-29T11:22:15.845 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T11:22:15.845 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T11:22:15.845 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T11:22:15.846 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T11:22:15.846 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:22:15.847 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:22:15.847 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:22:15.847 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:22:15.848 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T11:22:15.849 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:15.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.937+0000 7fded3f9eec0 20 remove_watcher() i=0 2019-11-29T11:22:15.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.937+0000 7fded3f9eec0 2 removed watcher, disabling cache 2019-11-29T11:22:15.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:15.986+0000 7fded3f9eec0 20 remove_watcher() i=1 2019-11-29T11:22:16.035 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.042+0000 7fded3f9eec0 20 remove_watcher() i=2 2019-11-29T11:22:16.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.112+0000 7fded3f9eec0 20 remove_watcher() i=3 2019-11-29T11:22:16.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.157+0000 7fded3f9eec0 20 remove_watcher() i=4 2019-11-29T11:22:16.201 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.203+0000 7fded3f9eec0 20 remove_watcher() i=5 2019-11-29T11:22:16.270 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.276+0000 7fded3f9eec0 20 remove_watcher() i=6 2019-11-29T11:22:16.327 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.334+0000 7fded3f9eec0 20 remove_watcher() i=7 2019-11-29T11:22:16.337 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-29T11:22:16.337 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PYWCBLGCXRYMAEDSTLFV --secret cDzIDCqZGLGZYokqY0BpNweJz/yy575R9CRrred5hjr6cqO7Qio7mQ== --email ragweed.client.0+test@test.test --system false 2019-11-29T11:22:16.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.528+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.554+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.554+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.565+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.565+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.571+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.571+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.579+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:16.809 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.814+0000 7f830f8ebec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:22:16.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.814+0000 7f830f8ebec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:22:16.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.814+0000 7f830f8ebec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:22:16.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.814+0000 7f830f8ebec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:22:16.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.814+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.828+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:16.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.828+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.839 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.845+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:22:16.839 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.845+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.857+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:16.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.857+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.875+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:22:16.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.875+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.882+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.882+0000 7f830f8ebec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:22:16.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.882+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.891+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.891+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.901+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:16.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.901+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.917+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:22:16.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.917+0000 7f830f8ebec0 20 zonegroup default 2019-11-29T11:22:16.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.917+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.924+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.924+0000 7f830f8ebec0 10 Cannot find current period zone using local zone 2019-11-29T11:22:16.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.924+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.936+0000 7f830f8ebec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:22:16.931 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.936+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.948+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:22:16.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.948+0000 7f830f8ebec0 20 rados->read ofs=0 len=0 2019-11-29T11:22:16.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.965+0000 7f830f8ebec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:22:16.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.965+0000 7f830f8ebec0 20 zone default found 2019-11-29T11:22:16.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.965+0000 7f830f8ebec0 20 started sync module instance, tier type = 2019-11-29T11:22:16.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:16.965+0000 7f830f8ebec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:22:17.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=0 2019-11-29T11:22:17.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=1 2019-11-29T11:22:17.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=2 2019-11-29T11:22:17.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=3 2019-11-29T11:22:17.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=4 2019-11-29T11:22:17.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.312+0000 7f830f8ebec0 20 add_watcher() i=5 2019-11-29T11:22:17.327 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.333+0000 7f830f8ebec0 20 add_watcher() i=6 2019-11-29T11:22:17.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.353+0000 7f830f8ebec0 20 add_watcher() i=7 2019-11-29T11:22:17.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.353+0000 7f830f8ebec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:22:17.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.353+0000 7f82cd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:22:17.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.356+0000 7f82fcb18700 0 -- 172.21.15.182:0/1004574801 >> v2:172.21.15.114:3300/0 conn(0x55af34c27e00 msgr2=0x55af34c2e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:22:17.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:17.408+0000 7f82fd319700 0 -- 172.21.15.182:0/4105560147 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7f82400175b0 msgr2=0x7f8240019a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T11:22:18.743 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.746+0000 7f823f7fe700 20 reqs_thread_entry: start 2019-11-29T11:22:18.743 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.746+0000 7f823d7fa700 20 reqs_thread_entry: start 2019-11-29T11:22:18.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.746+0000 7f830f8ebec0 20 init_complete bucket index max shards: 0 2019-11-29T11:22:18.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.747+0000 7f822b7fe700 20 reqs_thread_entry: start 2019-11-29T11:22:18.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.747+0000 7f830f8ebec0 20 get_system_obj_state: rctx=0x7ffc6da3a258 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55af34caca80 s->prefetch_data=0 2019-11-29T11:22:18.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.747+0000 7f830f8ebec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-29T11:22:18.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.753+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-29T11:22:18.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.753+0000 7f830f8ebec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T11:22:18.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.753+0000 7f830f8ebec0 20 get_system_obj_state: rctx=0x7ffc6da3a268 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x55af34cae810 s->prefetch_data=0 2019-11-29T11:22:18.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.753+0000 7f830f8ebec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-29T11:22:18.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.763+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-29T11:22:18.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.763+0000 7f830f8ebec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T11:22:18.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.764+0000 7f830f8ebec0 20 get_system_obj_state: rctx=0x7ffc6da3a268 obj=default.rgw.meta:users.keys:PYWCBLGCXRYMAEDSTLFV state=0x55af34cae810 s->prefetch_data=0 2019-11-29T11:22:18.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.764+0000 7f830f8ebec0 10 cache get: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV : miss 2019-11-29T11:22:18.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.797+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV info.flags=0x0 2019-11-29T11:22:18.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.797+0000 7f830f8ebec0 10 adding default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV to cache LRU end 2019-11-29T11:22:18.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.797+0000 7f830f8ebec0 20 get_system_obj_state: rctx=0x7ffc6da39e78 obj=default.rgw.meta:users.keys:PYWCBLGCXRYMAEDSTLFV state=0x55af34cae810 s->prefetch_data=0 2019-11-29T11:22:18.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.797+0000 7f830f8ebec0 10 cache get: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV : type miss (requested=0x6, cached=0x0) 2019-11-29T11:22:18.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.810+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV info.flags=0x0 2019-11-29T11:22:18.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.810+0000 7f830f8ebec0 10 moving default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV to cache LRU end 2019-11-29T11:22:18.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.810+0000 7f830f8ebec0 20 get_system_obj_state: rctx=0x7ffc6da39ff8 obj=default.rgw.meta:users.keys:PYWCBLGCXRYMAEDSTLFV state=0x55af34cae810 s->prefetch_data=0 2019-11-29T11:22:18.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.810+0000 7f830f8ebec0 10 cache get: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV : type miss (requested=0x6, cached=0x0) 2019-11-29T11:22:18.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.821+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV info.flags=0x0 2019-11-29T11:22:18.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.821+0000 7f830f8ebec0 10 moving default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV to cache LRU end 2019-11-29T11:22:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.887+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-29T11:22:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.887+0000 7f830f8ebec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T11:22:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.887+0000 7f830f8ebec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-29T11:22:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.896+0000 7f82e27fc700 10 RGWWatcher::handle_notify() notify_id 515396075522 cookie 94210992728608 notifier 4681 bl.length()=637 2019-11-29T11:22:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.896+0000 7f82e27fc700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-29T11:22:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:18.896+0000 7f82e27fc700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T11:22:19.197 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.204+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-29T11:22:19.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.204+0000 7f830f8ebec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T11:22:19.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.204+0000 7f830f8ebec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-29T11:22:19.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.215+0000 7f82e27fc700 10 RGWWatcher::handle_notify() notify_id 515396075521 cookie 94210992709312 notifier 4681 bl.length()=202 2019-11-29T11:22:19.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.215+0000 7f82e27fc700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-29T11:22:19.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.215+0000 7f82e27fc700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-29T11:22:19.418 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.423+0000 7f830f8ebec0 10 cache put: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV info.flags=0x7 2019-11-29T11:22:19.418 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.423+0000 7f830f8ebec0 10 moving default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV to cache LRU end 2019-11-29T11:22:19.418 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.423+0000 7f830f8ebec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=190 2019-11-29T11:22:19.471 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.462+0000 7f82e27fc700 10 RGWWatcher::handle_notify() notify_id 515396075520 cookie 94210992715296 notifier 4681 bl.length()=190 2019-11-29T11:22:19.472 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.462+0000 7f82e27fc700 10 cache put: name=default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV info.flags=0x7 2019-11-29T11:22:19.472 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.462+0000 7f82e27fc700 10 moving default.rgw.meta+users.keys+PYWCBLGCXRYMAEDSTLFV to cache LRU end 2019-11-29T11:22:19.874 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T11:22:19.874 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "ragweed.client.0", 2019-11-29T11:22:19.874 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-29T11:22:19.875 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-29T11:22:19.875 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T11:22:19.876 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T11:22:19.876 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T11:22:19.876 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T11:22:19.876 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T11:22:19.876 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "ragweed.client.0", 2019-11-29T11:22:19.877 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "PYWCBLGCXRYMAEDSTLFV", 2019-11-29T11:22:19.877 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "cDzIDCqZGLGZYokqY0BpNweJz/yy575R9CRrred5hjr6cqO7Qio7mQ==" 2019-11-29T11:22:19.877 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T11:22:19.878 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T11:22:19.878 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T11:22:19.878 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T11:22:19.878 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T11:22:19.878 INFO:teuthology.orchestra.run.smithi182.stdout: "system": "true", 2019-11-29T11:22:19.879 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T11:22:19.879 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T11:22:19.880 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T11:22:19.880 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T11:22:19.880 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:22:19.880 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:22:19.880 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:22:19.881 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:22:19.881 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:22:19.881 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:22:19.882 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:22:19.883 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:22:19.884 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T11:22:19.884 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T11:22:19.884 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T11:22:19.884 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T11:22:19.884 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:19.937 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.944+0000 7f830f8ebec0 20 remove_watcher() i=0 2019-11-29T11:22:19.938 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:19.944+0000 7f830f8ebec0 2 removed watcher, disabling cache 2019-11-29T11:22:19.993 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.000+0000 7f830f8ebec0 20 remove_watcher() i=1 2019-11-29T11:22:20.042 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.049+0000 7f830f8ebec0 20 remove_watcher() i=2 2019-11-29T11:22:20.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.124+0000 7f830f8ebec0 20 remove_watcher() i=3 2019-11-29T11:22:20.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.190+0000 7f830f8ebec0 20 remove_watcher() i=4 2019-11-29T11:22:20.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.242+0000 7f830f8ebec0 20 remove_watcher() i=5 2019-11-29T11:22:20.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.301+0000 7f830f8ebec0 20 remove_watcher() i=6 2019-11-29T11:22:20.340 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:22:20.347+0000 7f830f8ebec0 20 remove_watcher() i=7 2019-11-29T11:22:20.349 INFO:tasks.ragweed:Configuring ragweed... 2019-11-29T11:22:20.350 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-29T11:22:27.299 INFO:teuthology.orchestra.run.smithi182.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-29T11:22:27.404 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T11:22:27.442 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T11:22:27.442 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T11:22:27.443 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T11:22:28.233 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T11:22:28.625 INFO:teuthology.orchestra.run.smithi182.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-29T11:22:29.505 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T11:22:29.505 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:22:29.505 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-29T11:22:29.505 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-29T11:22:29.512 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-29T11:22:29.540 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-29T11:22:29.541 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-29T11:22:29.544 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-29T11:22:29.552 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:22:29.553 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-29T11:22:29.553 INFO:teuthology.orchestra.run.smithi182.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-29T11:22:29.553 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-29T11:22:29.553 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T11:22:29.553 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-29T11:22:29.943 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T11:22:30.142 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:30.143 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T11:22:30.144 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:30.144 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:22:30.144 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T11:22:30.144 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:22:30.144 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T11:22:30.145 INFO:teuthology.orchestra.run.smithi182.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-29T11:22:30.145 INFO:teuthology.orchestra.run.smithi182.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-29T11:22:30.145 INFO:teuthology.orchestra.run.smithi182.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-29T11:22:30.145 INFO:teuthology.orchestra.run.smithi182.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-29T11:22:30.145 INFO:teuthology.orchestra.run.smithi182.stdout:Installing for dependencies: 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-29T11:22:30.146 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:30.147 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 1.7 M 2019-11-29T11:22:30.147 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 12 M 2019-11-29T11:22:30.147 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T11:22:30.359 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2019-11-29T11:22:30.359 INFO:teuthology.orchestra.run.smithi182.stdout:Total 7.8 MB/s | 1.7 MB 00:00 2019-11-29T11:22:30.369 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T11:22:30.384 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T11:22:30.454 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T11:22:30.455 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T11:22:31.015 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-29T11:22:31.350 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-29T11:22:31.598 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-29T11:22:32.385 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-29T11:22:32.764 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-29T11:22:33.086 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-29T11:22:33.318 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-29T11:22:33.408 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-29T11:22:33.550 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-29T11:22:33.678 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-29T11:22:33.801 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-29T11:22:33.901 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-29T11:22:34.002 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-29T11:22:34.447 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-29T11:22:34.447 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:34.447 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T11:22:34.447 INFO:teuthology.orchestra.run.smithi182.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout:Dependency Installed: 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-29T11:22:34.448 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:34.449 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T11:22:34.663 INFO:teuthology.orchestra.run.smithi182.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-29T11:22:36.021 INFO:teuthology.orchestra.run.smithi182.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T11:22:36.526 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting pip 2019-11-29T11:22:36.625 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-29T11:22:36.847 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: pip 2019-11-29T11:22:36.847 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: pip 9.0.1 2019-11-29T11:22:36.913 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling pip-9.0.1: 2019-11-29T11:22:36.951 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T11:22:37.560 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed pip-19.3.1 2019-11-29T11:22:38.325 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T11:22:38.406 INFO:teuthology.orchestra.run.smithi182.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-29T11:22:39.193 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T11:22:39.357 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting nose 2019-11-29T11:22:39.404 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-29T11:22:39.504 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: nose 2019-11-29T11:22:39.579 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed nose-1.3.7 2019-11-29T11:22:40.143 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T11:22:40.705 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting setuptools==32.3.1 2019-11-29T11:22:40.745 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-29T11:22:40.909 INFO:teuthology.orchestra.run.smithi182.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-29T11:22:40.909 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: setuptools 2019-11-29T11:22:40.910 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T11:22:40.910 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T11:22:40.910 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T11:22:41.029 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed setuptools-32.3.1 2019-11-29T11:22:41.548 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T11:22:41.843 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting PyYAML 2019-11-29T11:22:41.883 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-29T11:22:42.587 INFO:teuthology.orchestra.run.smithi182.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-29T11:22:42.783 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-29T11:22:42.797 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-29T11:22:43.084 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting bunch>=1.0.0 2019-11-29T11:22:43.104 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-29T11:22:43.777 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting gevent>=1.0 2019-11-29T11:22:43.792 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-29T11:22:44.291 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting httplib2 2019-11-29T11:22:44.303 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-29T11:22:45.682 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting lxml 2019-11-29T11:22:45.700 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-29T11:22:46.134 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T11:22:46.142 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T11:22:46.206 INFO:teuthology.orchestra.run.smithi182.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-29T11:22:46.206 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for PyYAML (setup.py): started 2019-11-29T11:22:47.091 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-29T11:22:47.091 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=45fa70a9ed7b07a593d50225e06e03a583df4b4ba6fe5752c77d4ed28fd3abc1 2019-11-29T11:22:47.092 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-29T11:22:47.120 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for bunch (setup.py): started 2019-11-29T11:22:47.403 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-29T11:22:47.404 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=8e6cc175142ddeb6902854002821b64eca9319aea93a2f78502298fd64644c2d 2019-11-29T11:22:47.404 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-29T11:22:47.408 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for httplib2 (setup.py): started 2019-11-29T11:22:47.784 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-29T11:22:47.784 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=a8b94cd3aba72a34c908c6c1897a94cc7bab5b075e1a2d00be2e68fe2db7c49c 2019-11-29T11:22:47.785 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-29T11:22:47.793 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully built PyYAML bunch httplib2 2019-11-29T11:22:47.929 INFO:teuthology.orchestra.run.smithi182.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-29T11:22:47.930 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-29T11:22:47.930 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: PyYAML 3.10 2019-11-29T11:22:47.930 INFO:teuthology.orchestra.run.smithi182.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-29T11:22:47.930 INFO:teuthology.orchestra.run.smithi182.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-29T11:22:48.943 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: lxml 3.2.1 2019-11-29T11:22:48.944 INFO:teuthology.orchestra.run.smithi182.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-29T11:22:48.945 INFO:teuthology.orchestra.run.smithi182.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-29T11:22:49.044 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-11-29T11:22:49.428 INFO:teuthology.orchestra.run.smithi182.stdout:running develop 2019-11-29T11:22:49.492 INFO:teuthology.orchestra.run.smithi182.stdout:running egg_info 2019-11-29T11:22:49.492 INFO:teuthology.orchestra.run.smithi182.stdout:creating ragweed.egg-info 2019-11-29T11:22:49.492 INFO:teuthology.orchestra.run.smithi182.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-29T11:22:49.492 INFO:teuthology.orchestra.run.smithi182.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-29T11:22:49.493 INFO:teuthology.orchestra.run.smithi182.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-29T11:22:49.493 INFO:teuthology.orchestra.run.smithi182.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-29T11:22:49.493 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T11:22:49.493 INFO:teuthology.orchestra.run.smithi182.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T11:22:49.493 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-29T11:22:49.494 INFO:teuthology.orchestra.run.smithi182.stdout:running build_ext 2019-11-29T11:22:49.494 INFO:teuthology.orchestra.run.smithi182.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-29T11:22:49.494 INFO:teuthology.orchestra.run.smithi182.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-29T11:22:49.495 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:49.495 INFO:teuthology.orchestra.run.smithi182.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-29T11:22:49.496 INFO:teuthology.orchestra.run.smithi182.stdout:Processing dependencies for ragweed==0.0.1 2019-11-29T11:22:49.499 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for isodate>=0.4.4 2019-11-29T11:22:49.499 INFO:teuthology.orchestra.run.smithi182.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-29T11:22:49.609 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-29T11:22:49.668 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: isodate 0.6.0 2019-11-29T11:22:49.668 INFO:teuthology.orchestra.run.smithi182.stdout:Processing isodate-0.6.0.tar.gz 2019-11-29T11:22:49.685 INFO:teuthology.orchestra.run.smithi182.stdout:Writing /tmp/easy_install-FrIGIw/isodate-0.6.0/setup.cfg 2019-11-29T11:22:49.686 INFO:teuthology.orchestra.run.smithi182.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-FrIGIw/isodate-0.6.0/egg-dist-tmp-9oslkc 2019-11-29T11:22:50.010 INFO:teuthology.orchestra.run.smithi182.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-29T11:22:50.023 INFO:teuthology.orchestra.run.smithi182.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.028 INFO:teuthology.orchestra.run.smithi182.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-29T11:22:50.030 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.035 INFO:teuthology.orchestra.run.smithi182.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-29T11:22:50.058 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for gevent==1.4.0 2019-11-29T11:22:50.059 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: gevent 1.4.0 2019-11-29T11:22:50.060 INFO:teuthology.orchestra.run.smithi182.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-29T11:22:50.061 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.061 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.062 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for bunch==1.0.1 2019-11-29T11:22:50.062 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: bunch 1.0.1 2019-11-29T11:22:50.063 INFO:teuthology.orchestra.run.smithi182.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-29T11:22:50.064 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.065 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.065 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for PyYAML==5.1.2 2019-11-29T11:22:50.066 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: PyYAML 5.1.2 2019-11-29T11:22:50.067 INFO:teuthology.orchestra.run.smithi182.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-29T11:22:50.067 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for boto==2.49.0 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: boto 2.49.0 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.068 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.069 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for six==1.9.0 2019-11-29T11:22:50.069 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: six 1.9.0 2019-11-29T11:22:50.069 INFO:teuthology.orchestra.run.smithi182.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-29T11:22:50.069 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.069 INFO:teuthology.orchestra.run.smithi182.stdout:Using /usr/lib/python2.7/site-packages 2019-11-29T11:22:50.070 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for greenlet==0.4.15 2019-11-29T11:22:50.070 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: greenlet 0.4.15 2019-11-29T11:22:50.070 INFO:teuthology.orchestra.run.smithi182.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-29T11:22:50.071 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:22:50.071 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-29T11:22:50.071 INFO:teuthology.orchestra.run.smithi182.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-29T11:22:50.084 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-29T11:22:50.148 INFO:tasks.ragweed:Configuring boto... 2019-11-29T11:22:50.148 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-29T11:22:50.256 INFO:teuthology.orchestra.run.smithi182:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-29T11:23:21.323 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-29T11:23:47.340 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-29T11:24:14.760 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-29T11:24:35.442 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-29T11:25:02.366 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-29T11:25:04.002 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:09:12.149 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.068 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:09:12.231 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.068 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:09:12.217 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.081 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:09:12.248 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.158 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:09:12.321 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.166 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:09:12.333 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.700 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:09:12.866 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.794 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:09:12.961 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:25:04.861 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:09:13.010 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:26:05.977 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-29T11:27:03.067 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-29T11:27:11.807 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:11:19.958 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.814 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:11:19.965 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.824 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:11:19.993 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.831 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:11:20.001 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.832 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:11:20.001 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.837 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:11:20.006 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.929 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:11:20.098 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.952 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:11:20.103 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:27:11.958 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:11:20.126 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:28:57.898 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-29T11:29:22.213 INFO:teuthology.orchestra.run.smithi182.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-29T11:29:22.213 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T11:29:22.213 INFO:teuthology.orchestra.run.smithi182.stderr:---------------------------------------------------------------------- 2019-11-29T11:29:22.214 INFO:teuthology.orchestra.run.smithi182.stderr:Ran 9 tests in 391.564s 2019-11-29T11:29:22.214 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T11:29:22.214 INFO:teuthology.orchestra.run.smithi182.stderr:OK 2019-11-29T11:29:22.232 INFO:tasks.ragweed:Cleaning up boto... 2019-11-29T11:29:22.232 INFO:teuthology.orchestra.run.smithi182:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-29T11:29:22.282 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-29T11:29:22.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.468+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.490+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.490+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.500+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.500+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.505+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.505+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.499 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.515+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:22.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.770+0000 7f8f1c58bec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:29:22.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.770+0000 7f8f1c58bec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:29:22.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.770+0000 7f8f1c58bec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:29:22.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.770+0000 7f8f1c58bec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:29:22.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.770+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.780+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:22.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.780+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.798+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:29:22.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.798+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.808+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:22.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.808+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.813 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.823+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:29:22.813 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.823+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.817 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.830+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.830+0000 7f8f1c58bec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:29:22.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.830+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.822 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.837+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.822 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.837+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.847+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:22.833 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.847+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.869+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:29:22.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.869+0000 7f8f1c58bec0 20 zonegroup default 2019-11-29T11:29:22.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.869+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.876+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.876+0000 7f8f1c58bec0 10 Cannot find current period zone using local zone 2019-11-29T11:29:22.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.876+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.871 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.884+0000 7f8f1c58bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:22.871 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.884+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.893+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:22.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.893+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:22.891 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.906+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:29:22.891 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.906+0000 7f8f1c58bec0 20 zone default found 2019-11-29T11:29:22.891 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.906+0000 7f8f1c58bec0 20 started sync module instance, tier type = 2019-11-29T11:29:22.892 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:22.906+0000 7f8f1c58bec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:29:23.331 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=0 2019-11-29T11:29:23.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=1 2019-11-29T11:29:23.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=2 2019-11-29T11:29:23.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=3 2019-11-29T11:29:23.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=4 2019-11-29T11:29:23.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=5 2019-11-29T11:29:23.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.346+0000 7f8f1c58bec0 20 add_watcher() i=6 2019-11-29T11:29:23.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.379+0000 7f8f1c58bec0 20 add_watcher() i=7 2019-11-29T11:29:23.364 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.379+0000 7f8f1c58bec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:29:23.364 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.379+0000 7f8ed9fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:29:23.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.401+0000 7f8f09fb9700 0 -- >> v1:172.21.15.182:6789/0 conn(0x5583390f8ec0 legacy=0x5583390fc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T11:29:23.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:23.509+0000 7f8f097b8700 0 -- 172.21.15.182:0/697468267 >> [v2:172.21.15.182:6800/9955,v1:172.21.15.182:6801/9955] conn(0x558339113100 msgr2=0x558339115520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T11:29:25.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.129+0000 7f8e4bfff700 20 reqs_thread_entry: start 2019-11-29T11:29:25.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.129+0000 7f8e49ffb700 20 reqs_thread_entry: start 2019-11-29T11:29:25.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.129+0000 7f8f1c58bec0 20 init_complete bucket index max shards: 0 2019-11-29T11:29:25.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.129+0000 7f8e37fff700 20 reqs_thread_entry: start 2019-11-29T11:29:25.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.130+0000 7f8f1c58bec0 20 get_system_obj_state: rctx=0x7ffd0617bf38 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x558339179bd0 s->prefetch_data=0 2019-11-29T11:29:25.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.130+0000 7f8f1c58bec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-29T11:29:25.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-29T11:29:25.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T11:29:25.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:25.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:25.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T11:29:25.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.145+0000 7f8f1c58bec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:25.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.164+0000 7f8f1c58bec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-29T11:29:25.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.164+0000 7f8f1c58bec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-29T11:29:25.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.164+0000 7f8f1c58bec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-29T11:29:25.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.187+0000 7f8f1c58bec0 10 removing key index: LLVEVIGWFNSGUTPBCKPZ 2019-11-29T11:29:25.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.187+0000 7f8f1c58bec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=170 2019-11-29T11:29:25.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.200+0000 7f8eea7fc700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94022086306944 notifier 4699 bl.length()=170 2019-11-29T11:29:25.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.539+0000 7f8f1c58bec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-29T11:29:25.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.539+0000 7f8f1c58bec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-29T11:29:25.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.568+0000 7f8eea7fc700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94022086306944 notifier 4699 bl.length()=182 2019-11-29T11:29:25.905 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.921+0000 7f8f1c58bec0 10 removing user buckets index 2019-11-29T11:29:25.905 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.921+0000 7f8f1c58bec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-29T11:29:25.947 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:25.962+0000 7f8eea7fc700 10 RGWWatcher::handle_notify() notify_id 554050781184 cookie 94022086288016 notifier 4699 bl.length()=173 2019-11-29T11:29:26.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:26.458+0000 7f8f1c58bec0 10 removing user index: sysuser.client.0 2019-11-29T11:29:26.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:26.458+0000 7f8f1c58bec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-29T11:29:26.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:26.458+0000 7f8f1c58bec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-29T11:29:26.452 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:26.467+0000 7f8eea7fc700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94022086289696 notifier 4699 bl.length()=165 2019-11-29T11:29:28.017 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.033+0000 7f8f1c58bec0 20 remove_watcher() i=0 2019-11-29T11:29:28.018 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.033+0000 7f8f1c58bec0 2 removed watcher, disabling cache 2019-11-29T11:29:28.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.103+0000 7f8f1c58bec0 20 remove_watcher() i=1 2019-11-29T11:29:28.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.157+0000 7f8f1c58bec0 20 remove_watcher() i=2 2019-11-29T11:29:28.202 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.217+0000 7f8f1c58bec0 20 remove_watcher() i=3 2019-11-29T11:29:28.252 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.268+0000 7f8f1c58bec0 20 remove_watcher() i=4 2019-11-29T11:29:28.302 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.318+0000 7f8f1c58bec0 20 remove_watcher() i=5 2019-11-29T11:29:28.394 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.409+0000 7f8f1c58bec0 20 remove_watcher() i=6 2019-11-29T11:29:28.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.491+0000 7f8f1c58bec0 20 remove_watcher() i=7 2019-11-29T11:29:28.489 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-29T11:29:28.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.655+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.675+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:28.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.675+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.685+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:28.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.685+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.703+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:28.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.703+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.721+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:28.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.959+0000 7feef7d74ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:29:28.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.959+0000 7feef7d74ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:29:28.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.959+0000 7feef7d74ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:29:28.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.959+0000 7feef7d74ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:29:28.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.959+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.973+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:28.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.973+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.990+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:29:28.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:28.990+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:28.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.001+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:28.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.001+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.006 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.021+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:29:29.006 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.021+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.030+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:29.015 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.030+0000 7feef7d74ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:29:29.015 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.030+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.026 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.042+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:29.026 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.042+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.043 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.058+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:29.043 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.058+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.078+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:29:29.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.078+0000 7feef7d74ec0 20 zonegroup default 2019-11-29T11:29:29.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.078+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.091+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:29.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.091+0000 7feef7d74ec0 10 Cannot find current period zone using local zone 2019-11-29T11:29:29.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.091+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.102+0000 7feef7d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:29:29.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.102+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.113+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:29:29.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.113+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:29.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.133+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:29:29.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.133+0000 7feef7d74ec0 20 zone default found 2019-11-29T11:29:29.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.133+0000 7feef7d74ec0 20 started sync module instance, tier type = 2019-11-29T11:29:29.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.133+0000 7feef7d74ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:29:29.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=0 2019-11-29T11:29:29.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=1 2019-11-29T11:29:29.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=2 2019-11-29T11:29:29.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=3 2019-11-29T11:29:29.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=4 2019-11-29T11:29:29.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=5 2019-11-29T11:29:29.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.583+0000 7feef7d74ec0 20 add_watcher() i=6 2019-11-29T11:29:29.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.620+0000 7feee4fa1700 0 -- 172.21.15.182:0/2847739718 >> [v2:172.21.15.114:6810/10009,v1:172.21.15.114:6811/10009] conn(0x55af81e9c950 msgr2=0x55af81e9ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:29:29.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.620+0000 7feef7d74ec0 20 add_watcher() i=7 2019-11-29T11:29:29.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.620+0000 7feef7d74ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:29:29.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.620+0000 7feeb57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:29:29.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:29.647+0000 7feee47a0700 0 -- 172.21.15.182:0/3406100804 >> v1:172.21.15.114:6789/0 conn(0x55af81eb8670 legacy=0x55af81ebab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:29:31.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.176+0000 7fee277fe700 20 reqs_thread_entry: start 2019-11-29T11:29:31.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.176+0000 7fee257fa700 20 reqs_thread_entry: start 2019-11-29T11:29:31.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.176+0000 7feef7d74ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:29:31.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.177+0000 7fee137fe700 20 reqs_thread_entry: start 2019-11-29T11:29:31.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.177+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39448 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x55af81f313e0 s->prefetch_data=0 2019-11-29T11:29:31.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.177+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-29T11:29:31.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-29T11:29:31.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T11:29:31.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:31.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:31.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T11:29:31.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.187+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:31.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.203+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-29T11:29:31.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.203+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-29T11:29:31.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.203+0000 7feef7d74ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-29T11:29:31.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.229+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-conf state=0x55af81f32d00 s->prefetch_data=0 2019-11-29T11:29:31.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.229+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-29T11:29:31.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-29T11:29:31.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T11:29:31.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:31.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:31.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:31.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.244+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:31.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.259+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-29T11:29:31.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.259+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-29T11:29:31.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.259+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T11:29:31.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.259+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 state=0x55af81f352d0 s->prefetch_data=0 2019-11-29T11:29:31.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.259+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 : miss 2019-11-29T11:29:31.256 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 info.flags=0x16 2019-11-29T11:29:31.256 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 to cache LRU end 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:31.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:31.258 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.272+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:31.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.291+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-29T11:29:31.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.292+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 info.flags=0x13 2019-11-29T11:29:31.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.292+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 to cache LRU end 2019-11-29T11:29:31.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.292+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:31.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.292+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:31.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.292+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:31.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.305+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-conf[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1]) start [] num_entries 1100 2019-11-29T11:29:31.316 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-29T11:29:31.316 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-29T11:29:31.316 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-29T11:29:31.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-29T11:29:31.318 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.331+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.339+0000 7feef7d74ec0 10 manifest: total_size = 3910 2019-11-29T11:29:31.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.339+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.13 2019-11-29T11:29:31.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.339+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.339+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:31.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.340+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:31.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.459+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.455 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.471+0000 7feef7d74ec0 10 manifest: total_size = 5950 2019-11-29T11:29:31.455 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.471+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.30 2019-11-29T11:29:31.456 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.471+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.456 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.471+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:31.456 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.471+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:31.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.632+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.702+0000 7feef7d74ec0 10 manifest: total_size = 3807 2019-11-29T11:29:31.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.702+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.56 2019-11-29T11:29:31.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.702+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.702+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:31.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.702+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:31.823 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.838+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.869 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.884+0000 7feef7d74ec0 10 manifest: total_size = 5810 2019-11-29T11:29:31.869 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.884+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.72 2019-11-29T11:29:31.869 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.884+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.869 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.884+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:31.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.884+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:31.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.983+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.994+0000 7feef7d74ec0 10 manifest: total_size = 3925 2019-11-29T11:29:31.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.994+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.87 2019-11-29T11:29:31.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.994+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:31.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.994+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:31.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:31.994+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:32.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.119+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:32.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.161+0000 7feef7d74ec0 10 manifest: total_size = 6058 2019-11-29T11:29:32.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.161+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.120 2019-11-29T11:29:32.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.161+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:32.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.161+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:32.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.161+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:32.283 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.298+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:32.299 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.314+0000 7feef7d74ec0 10 manifest: total_size = 4113 2019-11-29T11:29:32.299 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.314+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.189 2019-11-29T11:29:32.299 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.314+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55af81ea18e8 s->prefetch_data=0 2019-11-29T11:29:32.299 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.314+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea18e8 2019-11-29T11:29:32.299 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.314+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:32.465 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.479+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55af81f43508 s->prefetch_data=0 2019-11-29T11:29:32.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.496+0000 7feef7d74ec0 10 manifest: total_size = 4021 2019-11-29T11:29:32.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.496+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.246 2019-11-29T11:29:32.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.496+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55af81f43508 s->prefetch_data=0 2019-11-29T11:29:32.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.496+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f43508 2019-11-29T11:29:32.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.496+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:32.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.630+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55af81f43508 s->prefetch_data=0 2019-11-29T11:29:32.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.638+0000 7feef7d74ec0 10 manifest: total_size = 29155 2019-11-29T11:29:32.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.638+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.322 2019-11-29T11:29:32.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.638+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55af81f43508 s->prefetch_data=0 2019-11-29T11:29:32.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.638+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f43508 2019-11-29T11:29:32.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.638+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 2019-11-29T11:29:32.768 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.783+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-conf[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1]) start _multipart_[] num_entries 1001 2019-11-29T11:29:32.768 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.783+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:32.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.889+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:32.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.969+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-conf state=0x55af81ea0970 s->prefetch_data=0 2019-11-29T11:29:32.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.969+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:32.970 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-29T11:29:32.970 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-29T11:29:32.970 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:32.970 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:32.971 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:32.971 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-29T11:29:32.971 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:32.986+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-29T11:29:33.021 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.037+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781184 cookie 94212287188896 notifier 4711 bl.length()=162 2019-11-29T11:29:33.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.329+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.1 from cache 2019-11-29T11:29:33.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.329+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=219 2019-11-29T11:29:33.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.341+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94212287216224 notifier 4711 bl.length()=219 2019-11-29T11:29:33.579 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.594+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55af81e9fd70 s->prefetch_data=0 2019-11-29T11:29:33.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.594+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:33.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.603+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:33.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.617+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-29T11:29:33.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.617+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-29T11:29:33.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.617+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.617+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 state=0x55af81f39c30 s->prefetch_data=0 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.617+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 : miss 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 info.flags=0x16 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 to cache LRU end 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:33.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:33.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:33.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:33.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:33.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:33.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.632+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:33.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-29T11:29:33.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 info.flags=0x13 2019-11-29T11:29:33.655 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 to cache LRU end 2019-11-29T11:29:33.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:33.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:33.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.652+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 2019-11-29T11:29:33.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.670+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2]) start [] num_entries 1100 2019-11-29T11:29:33.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.691+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T11:29:33.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.691+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.699+0000 7feef7d74ec0 10 manifest: total_size = 26081 2019-11-29T11:29:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.699+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.20 2019-11-29T11:29:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.699+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.699+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.699+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 2019-11-29T11:29:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2019-11-29T11:29:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7670 2019-11-29T11:29:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7673 2019-11-29T11:29:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2019-11-29T11:29:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4201974 part_ofs=7670 rule->part_size=7673 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4209647 part_ofs=15343 rule->part_size=7671 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2019-11-29T11:29:33.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4217318 part_ofs=23014 rule->part_size=3067 2019-11-29T11:29:33.767 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2019-11-29T11:29:33.767 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.780+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.20 2019-11-29T11:29:33.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.843+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2]) start _multipart_[] num_entries 1001 2019-11-29T11:29:33.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.843+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:33.841 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.857+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:33.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.908+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x55af81e9fd70 s->prefetch_data=0 2019-11-29T11:29:33.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.908+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:33.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-29T11:29:33.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-29T11:29:33.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:33.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:33.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:33.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-29T11:29:33.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.918+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-29T11:29:33.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:33.956+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781184 cookie 94212287190864 notifier 4711 bl.length()=191 2019-11-29T11:29:34.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.370+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2 from cache 2019-11-29T11:29:34.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.370+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=248 2019-11-29T11:29:34.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.383+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94212287190864 notifier 4711 bl.length()=248 2019-11-29T11:29:34.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.914+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55af81f3a9c0 s->prefetch_data=0 2019-11-29T11:29:34.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.914+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-29T11:29:34.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-29T11:29:34.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T11:29:34.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:34.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:34.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:34.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.925+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:34.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.941+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-29T11:29:34.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.941+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-29T11:29:34.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.941+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T11:29:34.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.941+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 state=0x55af81e9fd70 s->prefetch_data=0 2019-11-29T11:29:34.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.941+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 : miss 2019-11-29T11:29:34.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 info.flags=0x16 2019-11-29T11:29:34.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 to cache LRU end 2019-11-29T11:29:34.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:34.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.959+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:34.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-29T11:29:34.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 info.flags=0x13 2019-11-29T11:29:34.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 to cache LRU end 2019-11-29T11:29:34.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:34.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:34.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:34.980+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 2019-11-29T11:29:34.992 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.008+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3]) start [] num_entries 1100 2019-11-29T11:29:35.034 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.050+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T11:29:35.035 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.050+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:35.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.069+0000 7feef7d74ec0 10 manifest: total_size = 18874368 2019-11-29T11:29:35.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.069+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.40 2019-11-29T11:29:35.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.069+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:35.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.069+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:35.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.069+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:35.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-11-29T11:29:35.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-11-29T11:29:35.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2019-11-29T11:29:35.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-11-29T11:29:35.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.166+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.40 2019-11-29T11:29:35.236 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.251+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3]) start _multipart_[] num_entries 1001 2019-11-29T11:29:35.236 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.251+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:35.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.265+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:35.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.322+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x55af81e9fd70 s->prefetch_data=0 2019-11-29T11:29:35.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.322+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:35.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-29T11:29:35.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.340+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-29T11:29:35.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.349+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94212287189824 notifier 4711 bl.length()=198 2019-11-29T11:29:35.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.526+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3 from cache 2019-11-29T11:29:35.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.526+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=255 2019-11-29T11:29:35.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:35.537+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94212287188896 notifier 4711 bl.length()=255 2019-11-29T11:29:36.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.073+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55af81f3a9c0 s->prefetch_data=0 2019-11-29T11:29:36.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.073+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-29T11:29:36.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-29T11:29:36.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T11:29:36.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:36.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:36.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:36.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.081+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:36.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.096+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-29T11:29:36.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.096+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-29T11:29:36.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.096+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T11:29:36.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.096+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:36.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.096+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 : miss 2019-11-29T11:29:36.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 info.flags=0x16 2019-11-29T11:29:36.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 to cache LRU end 2019-11-29T11:29:36.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:36.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:36.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:36.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:36.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:36.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:36.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.114+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:36.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-29T11:29:36.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 info.flags=0x13 2019-11-29T11:29:36.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 to cache LRU end 2019-11-29T11:29:36.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:36.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:36.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.132+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.131 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.146+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4]) start [] num_entries 1100 2019-11-29T11:29:36.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.171+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo[F2sOGINwYnSB7oZJ5Rm7HI1WcsLVa1Y] 2019-11-29T11:29:36.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.171+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.189+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:36.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.203+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to fd8a19q5zo8bbp6f5umkkngc8d2l4za6 2019-11-29T11:29:36.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.203+0000 7feef7d74ec0 20 get_obj_state_impl: setting s->olh_tag to ij87zyjyonuav4slrh2gx45ccnfg553k 2019-11-29T11:29:36.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.203+0000 7feef7d74ec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ij87zyjyonuav4slrh2gx45ccnfg553k 2019-11-29T11:29:36.256 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.272+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.359 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.374+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.359 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.374+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.403+0000 7feef7d74ec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-11-29T11:29:36.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.403+0000 7feef7d74ec0 20 olh_log_entry: epoch=3 op=3 key=foo[F2sOGINwYnSB7oZJ5Rm7HI1WcsLVa1Y] 2019-11-29T11:29:36.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.403+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-index-versioning.1:_:F2sOGINwYnSB7oZJ5Rm7HI1WcsLVa1Y_foo state=0x55af81f47548 s->prefetch_data=0 2019-11-29T11:29:36.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.414+0000 7feef7d74ec0 10 manifest: total_size = 18874368 2019-11-29T11:29:36.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.414+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.55 2019-11-29T11:29:36.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.414+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-index-versioning.1:_:F2sOGINwYnSB7oZJ5Rm7HI1WcsLVa1Y_foo state=0x55af81f47548 s->prefetch_data=0 2019-11-29T11:29:36.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.414+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f47548 2019-11-29T11:29:36.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.414+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.517 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:36.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.532+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:36.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-11-29T11:29:36.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-11-29T11:29:36.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2019-11-29T11:29:36.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-11-29T11:29:36.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.533+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.55 2019-11-29T11:29:36.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.636+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.636+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.718+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.775+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 2019-11-29T11:29:36.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.775+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4]) start _multipart_[] num_entries 1001 2019-11-29T11:29:36.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.775+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:36.773 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.788+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:36.845 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.861+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x55af81f3a9c0 s->prefetch_data=0 2019-11-29T11:29:36.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.861+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:36.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-29T11:29:36.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-29T11:29:36.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:36.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:36.855 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:36.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-29T11:29:36.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.870+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-29T11:29:36.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:36.884+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94212287189824 notifier 4711 bl.length()=193 2019-11-29T11:29:37.264 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.279+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4 from cache 2019-11-29T11:29:37.264 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.280+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=250 2019-11-29T11:29:37.274 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.289+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781190 cookie 94212287189824 notifier 4711 bl.length()=250 2019-11-29T11:29:37.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.674+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:37.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.674+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-29T11:29:37.666 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-29T11:29:37.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T11:29:37.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:37.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:37.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:37.667 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.682+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:37.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.692+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T11:29:37.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.692+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-29T11:29:37.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.692+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T11:29:37.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.692+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 state=0x55af81f3a720 s->prefetch_data=0 2019-11-29T11:29:37.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.692+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 : miss 2019-11-29T11:29:37.690 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 info.flags=0x16 2019-11-29T11:29:37.690 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 to cache LRU end 2019-11-29T11:29:37.690 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:37.690 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:37.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:37.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:37.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:37.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:37.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.706+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 info.flags=0x13 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 to cache LRU end 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:37.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.726+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 2019-11-29T11:29:37.725 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.741+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5]) start [] num_entries 1100 2019-11-29T11:29:37.748 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.764+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-29T11:29:37.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.764+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:37.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.779+0000 7feef7d74ec0 10 manifest: total_size = 74198 2019-11-29T11:29:37.763 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.779+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.71 2019-11-29T11:29:37.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.779+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:37.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.779+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:37.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.779+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-29T11:29:37.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-29T11:29:37.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.909+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.71 2019-11-29T11:29:37.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.990+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5]) start _multipart_[] num_entries 1001 2019-11-29T11:29:37.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:37.990+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:38.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.018+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:38.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.098+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55af81ea0510 s->prefetch_data=0 2019-11-29T11:29:38.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.098+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:38.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-29T11:29:38.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-29T11:29:38.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:38.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:38.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:38.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-29T11:29:38.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.116+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-29T11:29:38.118 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.134+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94212287212544 notifier 4711 bl.length()=183 2019-11-29T11:29:38.761 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.776+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5 from cache 2019-11-29T11:29:38.761 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.776+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=240 2019-11-29T11:29:38.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:38.788+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781190 cookie 94212287212544 notifier 4711 bl.length()=240 2019-11-29T11:29:38.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.011+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:38.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.011+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-29T11:29:39.012 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-29T11:29:39.012 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T11:29:39.013 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:39.013 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:39.013 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:39.013 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.028+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:39.029 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.045+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-29T11:29:39.029 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.045+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-29T11:29:39.029 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.045+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T11:29:39.029 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.045+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 state=0x55af81f3a720 s->prefetch_data=0 2019-11-29T11:29:39.030 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.045+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 : miss 2019-11-29T11:29:39.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 info.flags=0x16 2019-11-29T11:29:39.056 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 to cache LRU end 2019-11-29T11:29:39.056 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:39.056 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:39.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:39.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:39.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:39.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:39.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.070+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:39.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-29T11:29:39.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 info.flags=0x13 2019-11-29T11:29:39.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 to cache LRU end 2019-11-29T11:29:39.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:39.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:39.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.097+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:39.110 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.125+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7]) start [] num_entries 1100 2019-11-29T11:29:39.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-29T11:29:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-29T11:29:39.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-29T11:29:39.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T11:29:39.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-29T11:29:39.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-29T11:29:39.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-29T11:29:39.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.162+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.176+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:39.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.176+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.108 2019-11-29T11:29:39.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.176+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.176+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f4c9e8 2019-11-29T11:29:39.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.176+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:39.312 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.328+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.328+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.328+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.328+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.328+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.108 2019-11-29T11:29:39.389 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.405+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.398 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.414+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:39.398 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.414+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.109 2019-11-29T11:29:39.398 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.414+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.398 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.414+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f4c9e8 2019-11-29T11:29:39.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.414+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:39.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.493+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.493+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.478 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.493+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.478 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.493+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.478 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.493+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.109 2019-11-29T11:29:39.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.588+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.604+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:39.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.604+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _1AanYiCm9YP6zVSWHSL5oGizuZ0cO2m 2019-11-29T11:29:39.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.604+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.604+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f4c9e8 2019-11-29T11:29:39.589 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.604+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:39.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.707+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.707+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.707+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.707+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.707+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _1AanYiCm9YP6zVSWHSL5oGizuZ0cO2m 2019-11-29T11:29:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.798+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.794 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.809+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:39.794 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.809+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _ZCNfZX1qtyh_whn91mc7cuO5azaOgTb 2019-11-29T11:29:39.794 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.809+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55af81f4c9e8 s->prefetch_data=0 2019-11-29T11:29:39.794 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.809+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f4c9e8 2019-11-29T11:29:39.795 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.809+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:39.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.979+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:39.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.979+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:39.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:39.979+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _ZCNfZX1qtyh_whn91mc7cuO5azaOgTb 2019-11-29T11:29:40.010 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.025+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55af81ea1638 s->prefetch_data=0 2019-11-29T11:29:40.027 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.043+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:40.028 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.043+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.112 2019-11-29T11:29:40.028 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.043+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55af81ea1638 s->prefetch_data=0 2019-11-29T11:29:40.028 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.043+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1638 2019-11-29T11:29:40.028 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.043+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:40.111 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.127+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.127+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.127+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.127+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.127+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.112 2019-11-29T11:29:40.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.199+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.208+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:40.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.208+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to __1k-PgjSHcdNyJ8Bfthhop6CfOMvRCq 2019-11-29T11:29:40.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.208+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.208+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:40.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.208+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:40.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.322+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.322+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.322+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.322+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.322+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: __1k-PgjSHcdNyJ8Bfthhop6CfOMvRCq 2019-11-29T11:29:40.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.413+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.428+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.428+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.114 2019-11-29T11:29:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.428+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.428+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.428+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:40.514 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.530+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.514 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.530+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.514 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.530+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.515 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.530+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.515 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.530+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.114 2019-11-29T11:29:40.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.647+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.665+0000 7feef7d74ec0 10 manifest: total_size = 5242880 2019-11-29T11:29:40.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.665+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _wcovRgLCS9JrnjnI23tKQqNImxGcnWg 2019-11-29T11:29:40.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.665+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.665+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:40.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.665+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:40.884 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.900+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:40.884 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.900+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-29T11:29:40.884 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.900+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _wcovRgLCS9JrnjnI23tKQqNImxGcnWg 2019-11-29T11:29:40.953 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.968+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.978+0000 7feef7d74ec0 10 manifest: total_size = 2049 2019-11-29T11:29:40.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.978+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.116 2019-11-29T11:29:40.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.978+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:40.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.978+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:40.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:40.978+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:41.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.100+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.151+0000 7feef7d74ec0 10 manifest: total_size = 2049 2019-11-29T11:29:41.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.151+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _wLUv02g8jRPCy_4FyO-3WErJl2kL58i 2019-11-29T11:29:41.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.151+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.151+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:41.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.151+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:41.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.291+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:41.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.291+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=2049 stripe_ofs=2049 part_ofs=0 rule->part_size=0 2019-11-29T11:29:41.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.291+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _wLUv02g8jRPCy_4FyO-3WErJl2kL58i 2019-11-29T11:29:41.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.491+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.502+0000 7feef7d74ec0 10 manifest: total_size = 2049 2019-11-29T11:29:41.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.502+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _LVUgDnoVuqJwQyYIDkzGGPQhegwAtxF 2019-11-29T11:29:41.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.502+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.502+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:41.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.502+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:41.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.609+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:41.594 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.609+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=2049 stripe_ofs=2049 part_ofs=0 rule->part_size=0 2019-11-29T11:29:41.594 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.609+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _LVUgDnoVuqJwQyYIDkzGGPQhegwAtxF 2019-11-29T11:29:41.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.692+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.703 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.719+0000 7feef7d74ec0 10 manifest: total_size = 2049 2019-11-29T11:29:41.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.719+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _gboKuZxPLGDroXAMheoAz5XG0_yYFUG 2019-11-29T11:29:41.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.719+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:41.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.719+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:41.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.719+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 2019-11-29T11:29:41.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.845+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7]) start _multipart_[] num_entries 1001 2019-11-29T11:29:41.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.845+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:41.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.916+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:41.951 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.966+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55af81f4d180 s->prefetch_data=0 2019-11-29T11:29:41.951 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.966+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:41.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-29T11:29:41.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-29T11:29:41.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:41.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:41.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:41.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-29T11:29:41.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.979+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-29T11:29:41.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:41.988+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781191 cookie 94212287189824 notifier 4711 bl.length()=189 2019-11-29T11:29:42.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.117+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7 from cache 2019-11-29T11:29:42.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.117+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=246 2019-11-29T11:29:42.107 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.123+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781192 cookie 94212287189824 notifier 4711 bl.length()=246 2019-11-29T11:29:42.350 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.366+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:42.351 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.366+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-29T11:29:42.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-29T11:29:42.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T11:29:42.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:42.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:42.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:42.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.384+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:42.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.402+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-29T11:29:42.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.402+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-29T11:29:42.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.402+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T11:29:42.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.402+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 state=0x55af81f3a720 s->prefetch_data=0 2019-11-29T11:29:42.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.402+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 : miss 2019-11-29T11:29:42.405 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 info.flags=0x16 2019-11-29T11:29:42.405 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 to cache LRU end 2019-11-29T11:29:42.405 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:42.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.421+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:42.435 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-29T11:29:42.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 info.flags=0x13 2019-11-29T11:29:42.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 to cache LRU end 2019-11-29T11:29:42.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:42.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:42.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.451+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:42.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.464+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9]) start [] num_entries 1100 2019-11-29T11:29:42.488 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T11:29:42.488 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-29T11:29:42.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T11:29:42.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-29T11:29:42.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-29T11:29:42.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-29T11:29:42.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.504+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.516+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:42.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.516+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.224 2019-11-29T11:29:42.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.516+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.516+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:42.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.516+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:42.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:42.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:42.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.629+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.224 2019-11-29T11:29:42.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.716+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.728+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:42.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.728+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.225 2019-11-29T11:29:42.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.728+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.728+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:42.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.728+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:42.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:42.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:42.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:42.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:42.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:42.866+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.225 2019-11-29T11:29:42.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.000+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.010+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:42.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.010+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _oq_k-iSiPZMi5Y5ZR9DFzuA8g3llBEA 2019-11-29T11:29:42.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.010+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:42.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.010+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:42.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.010+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:43.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.130+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _oq_k-iSiPZMi5Y5ZR9DFzuA8g3llBEA 2019-11-29T11:29:43.221 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.237+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:43.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.250+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:43.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.250+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _H2A1iy3mGCb2Mog5kMN7jOsSemfU3yD 2019-11-29T11:29:43.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.250+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:43.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.250+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:43.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.250+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:43.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.465+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.465+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.465+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.465+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.465+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _H2A1iy3mGCb2Mog5kMN7jOsSemfU3yD 2019-11-29T11:29:43.539 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.555+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:43.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.567+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:43.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.567+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.233 2019-11-29T11:29:43.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.567+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55af81ea09c8 s->prefetch_data=0 2019-11-29T11:29:43.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.567+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea09c8 2019-11-29T11:29:43.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.567+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:43.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.650+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.233 2019-11-29T11:29:43.693 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.709+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.717+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:43.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.717+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _D6Qj4XInOFM_zp1CPI6RgqkVUAl91cs 2019-11-29T11:29:43.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.717+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.717+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:43.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.717+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:43.773 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:43.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.789+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _D6Qj4XInOFM_zp1CPI6RgqkVUAl91cs 2019-11-29T11:29:43.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.836+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.844+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:43.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.844+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.235 2019-11-29T11:29:43.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.844+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.844+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:43.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.844+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:43.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:43.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:43.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:43.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:43.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:43.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.915+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.235 2019-11-29T11:29:43.955 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.970+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.978+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:43.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.978+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _Dxud5YNQLTh5snkBt3TtWvBI8GVINuE 2019-11-29T11:29:43.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.978+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:43.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.978+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:43.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:43.978+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:44.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.167+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.167+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.167+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.167+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.167+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _Dxud5YNQLTh5snkBt3TtWvBI8GVINuE 2019-11-29T11:29:44.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.233+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.241+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:44.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.241+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.242 2019-11-29T11:29:44.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.241+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.241+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:44.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.241+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:44.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:44.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:44.298 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.310+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.242 2019-11-29T11:29:44.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.387+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.384 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.400+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:44.384 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.400+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _Vc5iMn9dgtGzWKwg-OEbnsAAFgNwms2 2019-11-29T11:29:44.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.400+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.400+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:44.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.400+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.502 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.516+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _Vc5iMn9dgtGzWKwg-OEbnsAAFgNwms2 2019-11-29T11:29:44.577 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.593+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.605+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:44.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.605+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to _Sx1a5ljXDkXqEo7mxTrXg_E2JYO2u-s 2019-11-29T11:29:44.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.605+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.605+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:44.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.605+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:44.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:44.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-29T11:29:44.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.702+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _Sx1a5ljXDkXqEo7mxTrXg_E2JYO2u-s 2019-11-29T11:29:44.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.753+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.785+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:44.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.785+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.245 2019-11-29T11:29:44.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.785+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:44.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.785+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:44.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.785+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 2019-11-29T11:29:44.892 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.892 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.892 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.892 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:44.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.907+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.245 2019-11-29T11:29:44.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.972+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9]) start _multipart_[] num_entries 1001 2019-11-29T11:29:44.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.972+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:44.980 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:44.996+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:45.035 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.051+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:45.035 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.051+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:45.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-29T11:29:45.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.069+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-29T11:29:45.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.080+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781185 cookie 94212287197616 notifier 4711 bl.length()=199 2019-11-29T11:29:45.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.993+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9 from cache 2019-11-29T11:29:45.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:45.993+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=256 2019-11-29T11:29:45.990 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.006+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94212287197616 notifier 4711 bl.length()=256 2019-11-29T11:29:46.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.204+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:46.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.204+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-29T11:29:46.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-29T11:29:46.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T11:29:46.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:46.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:46.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:46.200 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.212+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:46.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.220+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-29T11:29:46.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.220+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-29T11:29:46.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.220+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T11:29:46.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.220+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 state=0x55af81ea19d0 s->prefetch_data=0 2019-11-29T11:29:46.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.220+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 : miss 2019-11-29T11:29:46.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 info.flags=0x16 2019-11-29T11:29:46.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 to cache LRU end 2019-11-29T11:29:46.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:46.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:46.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:46.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:46.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:46.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:46.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.230+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:46.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-29T11:29:46.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 info.flags=0x13 2019-11-29T11:29:46.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 to cache LRU end 2019-11-29T11:29:46.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:46.231 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:46.231 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.245+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 2019-11-29T11:29:46.241 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.257+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8]) start [] num_entries 1100 2019-11-29T11:29:46.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.277+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T11:29:46.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.277+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T11:29:46.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.277+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T11:29:46.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.277+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.287+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:46.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.287+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.196 2019-11-29T11:29:46.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.287+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.272 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.287+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:46.272 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.287+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 2019-11-29T11:29:46.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:46.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:46.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.362+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.196 2019-11-29T11:29:46.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.463+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.474+0000 7feef7d74ec0 10 manifest: total_size = 11534336 2019-11-29T11:29:46.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.474+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.203 2019-11-29T11:29:46.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.474+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.474+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:46.459 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.474+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 2019-11-29T11:29:46.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-29T11:29:46.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-29T11:29:46.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-29T11:29:46.553 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:46.553 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-29T11:29:46.554 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-29T11:29:46.554 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-29T11:29:46.554 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.565+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.203 2019-11-29T11:29:46.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.630+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.637+0000 7feef7d74ec0 10 manifest: total_size = 45360 2019-11-29T11:29:46.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.637+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.210 2019-11-29T11:29:46.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.637+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:46.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.637+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:46.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.637+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 2019-11-29T11:29:46.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2019-11-29T11:29:46.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2019-11-29T11:29:46.716 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2019-11-29T11:29:46.716 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.730+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.210 2019-11-29T11:29:46.805 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.821+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8]) start _multipart_[] num_entries 1001 2019-11-29T11:29:46.805 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.821+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:46.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.844+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:46.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.922+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55af81f4cdf0 s->prefetch_data=0 2019-11-29T11:29:46.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.922+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:46.924 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-29T11:29:46.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.940+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-29T11:29:46.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:46.960+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781193 cookie 94212287214688 notifier 4711 bl.length()=194 2019-11-29T11:29:47.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:47.989+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8 from cache 2019-11-29T11:29:47.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:47.989+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=251 2019-11-29T11:29:47.992 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.006+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94212287197616 notifier 4711 bl.length()=251 2019-11-29T11:29:48.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.271+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55af81f4cdf0 s->prefetch_data=0 2019-11-29T11:29:48.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.271+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-29T11:29:48.265 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-29T11:29:48.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T11:29:48.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:48.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:48.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:48.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.281+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:48.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.296+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-29T11:29:48.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.296+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-29T11:29:48.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.296+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T11:29:48.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.296+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:48.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.296+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 : miss 2019-11-29T11:29:48.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 info.flags=0x16 2019-11-29T11:29:48.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 to cache LRU end 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:48.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.306+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:48.312 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-29T11:29:48.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 info.flags=0x13 2019-11-29T11:29:48.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 to cache LRU end 2019-11-29T11:29:48.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:48.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:48.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.326+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 2019-11-29T11:29:48.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.342+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6]) start [] num_entries 1100 2019-11-29T11:29:48.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.369+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-29T11:29:48.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.369+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-29T11:29:48.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.369+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-29T11:29:48.355 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.369+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.380+0000 7feef7d74ec0 10 manifest: total_size = 10485760 2019-11-29T11:29:48.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.380+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.84 2019-11-29T11:29:48.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.380+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.380+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:48.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.380+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 2019-11-29T11:29:48.467 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.469 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.472+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.84 2019-11-29T11:29:48.536 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.548+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.562+0000 7feef7d74ec0 10 manifest: total_size = 10485760 2019-11-29T11:29:48.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.562+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.85 2019-11-29T11:29:48.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.562+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.562+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:48.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.562+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 2019-11-29T11:29:48.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.677+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.85 2019-11-29T11:29:48.745 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.761+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.773+0000 7feef7d74ec0 10 manifest: total_size = 10485760 2019-11-29T11:29:48.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.773+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.86 2019-11-29T11:29:48.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.773+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:48.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.773+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:48.758 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.773+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 2019-11-29T11:29:48.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.966+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.966+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.966+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-29T11:29:48.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.966+0000 7feef7d74ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-29T11:29:48.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:48.966+0000 7feef7d74ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.86 2019-11-29T11:29:49.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.048+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6]) start _multipart_[] num_entries 1001 2019-11-29T11:29:49.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.048+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:49.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.081+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:49.168 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.184+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x55af81ea0590 s->prefetch_data=0 2019-11-29T11:29:49.168 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.184+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:49.182 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-29T11:29:49.182 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-29T11:29:49.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:49.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:49.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:49.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-29T11:29:49.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.198+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-29T11:29:49.197 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.212+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781194 cookie 94212287189824 notifier 4711 bl.length()=184 2019-11-29T11:29:49.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.538+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6 from cache 2019-11-29T11:29:49.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.538+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=241 2019-11-29T11:29:49.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.564+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94212287188896 notifier 4711 bl.length()=241 2019-11-29T11:29:49.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.867+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:49.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.867+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-29T11:29:49.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-29T11:29:49.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T11:29:49.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:49.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:49.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:49.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.881+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:49.877 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.893+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T11:29:49.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.893+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-29T11:29:49.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.893+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T11:29:49.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.893+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 state=0x55af81f4d1d0 s->prefetch_data=0 2019-11-29T11:29:49.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.893+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 : miss 2019-11-29T11:29:49.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 info.flags=0x16 2019-11-29T11:29:49.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 to cache LRU end 2019-11-29T11:29:49.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:49.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.905+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:49.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T11:29:49.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 info.flags=0x13 2019-11-29T11:29:49.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 to cache LRU end 2019-11-29T11:29:49.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:49.907 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:49.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.923+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 2019-11-29T11:29:49.920 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.936+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10]) start [] num_entries 1100 2019-11-29T11:29:49.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.977+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T11:29:49.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.977+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T11:29:49.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.977+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T11:29:49.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.977+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T11:29:49.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.977+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:49.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.991+0000 7feef7d74ec0 10 manifest: total_size = 49187 2019-11-29T11:29:49.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.991+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.305 2019-11-29T11:29:49.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.991+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:49.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.991+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:49.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:49.991+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 2019-11-29T11:29:50.078 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.094+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.102+0000 7feef7d74ec0 10 manifest: total_size = 1035 2019-11-29T11:29:50.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.102+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.307 2019-11-29T11:29:50.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.102+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.102+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:50.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.102+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 2019-11-29T11:29:50.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.220+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.228+0000 7feef7d74ec0 10 manifest: total_size = 49187 2019-11-29T11:29:50.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.228+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.306 2019-11-29T11:29:50.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.228+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.228+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:50.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.228+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 2019-11-29T11:29:50.329 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.345+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.353+0000 7feef7d74ec0 10 manifest: total_size = 49187 2019-11-29T11:29:50.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.353+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.304 2019-11-29T11:29:50.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.353+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:50.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.353+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:50.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.353+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 2019-11-29T11:29:50.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.491+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10]) start _multipart_[] num_entries 1001 2019-11-29T11:29:50.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.492+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:50.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.583+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:50.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.705+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55af81f4c990 s->prefetch_data=0 2019-11-29T11:29:50.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.705+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:50.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-29T11:29:50.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-29T11:29:50.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:50.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:50.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:50.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-29T11:29:50.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.721+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T11:29:50.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.798+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94212287190864 notifier 4711 bl.length()=181 2019-11-29T11:29:50.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.980+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.10 from cache 2019-11-29T11:29:50.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.980+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2019-11-29T11:29:50.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:50.991+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781191 cookie 94212287212544 notifier 4711 bl.length()=239 2019-11-29T11:29:51.246 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.256+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:51.246 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.256+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-29T11:29:51.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-29T11:29:51.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T11:29:51.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:51.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:51.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:51.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.265+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:51.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.281+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T11:29:51.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.281+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-29T11:29:51.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.282+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T11:29:51.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.282+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 state=0x55af81f4ce70 s->prefetch_data=0 2019-11-29T11:29:51.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.282+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 : miss 2019-11-29T11:29:51.275 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 info.flags=0x16 2019-11-29T11:29:51.275 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 to cache LRU end 2019-11-29T11:29:51.275 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:51.275 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:51.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:51.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:51.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:51.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:51.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.291+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:51.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T11:29:51.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 info.flags=0x13 2019-11-29T11:29:51.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 to cache LRU end 2019-11-29T11:29:51.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:51.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:51.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.322+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 2019-11-29T11:29:51.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.336+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11]) start [] num_entries 1100 2019-11-29T11:29:51.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.353+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T11:29:51.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.353+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T11:29:51.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.353+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T11:29:51.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.353+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T11:29:51.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.353+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.378+0000 7feef7d74ec0 10 manifest: total_size = 527 2019-11-29T11:29:51.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.378+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.312 2019-11-29T11:29:51.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.378+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.378+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:51.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.378+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 2019-11-29T11:29:51.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.462+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.454 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.470+0000 7feef7d74ec0 10 manifest: total_size = 2078 2019-11-29T11:29:51.454 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.470+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.314 2019-11-29T11:29:51.454 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.470+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.455 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.470+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:51.457 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.470+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 2019-11-29T11:29:51.589 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.605+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.605 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.620+0000 7feeb57e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:29:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.641+0000 7feef7d74ec0 10 manifest: total_size = 524288 2019-11-29T11:29:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.641+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.313 2019-11-29T11:29:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.641+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.641+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:51.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.641+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 2019-11-29T11:29:51.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.845+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.873+0000 7feef7d74ec0 10 manifest: total_size = 2078 2019-11-29T11:29:51.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.873+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.311 2019-11-29T11:29:51.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.873+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55af81ea1288 s->prefetch_data=0 2019-11-29T11:29:51.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.873+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81ea1288 2019-11-29T11:29:51.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.874+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 2019-11-29T11:29:51.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.970+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11]) start _multipart_[] num_entries 1001 2019-11-29T11:29:51.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:51.970+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:52.006 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.022+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:52.059 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.075+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x55af81f3fe70 s->prefetch_data=0 2019-11-29T11:29:52.059 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.075+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:52.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-29T11:29:52.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-29T11:29:52.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:52.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:52.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:52.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-29T11:29:52.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.099+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T11:29:52.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.112+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94212287190864 notifier 4711 bl.length()=181 2019-11-29T11:29:52.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.200+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.11 from cache 2019-11-29T11:29:52.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.200+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2019-11-29T11:29:52.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.212+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781192 cookie 94212287212544 notifier 4711 bl.length()=239 2019-11-29T11:29:52.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.607+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55af81e9ffc0 s->prefetch_data=0 2019-11-29T11:29:52.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.607+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-29T11:29:52.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.627+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-29T11:29:52.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.628+0000 7feef7d74ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T11:29:52.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.628+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:52.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.628+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:52.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.628+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-29T11:29:52.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.628+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:52.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.646+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-29T11:29:52.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.646+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-29T11:29:52.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.646+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T11:29:52.632 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.646+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f39210 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 state=0x55af81f4c990 s->prefetch_data=0 2019-11-29T11:29:52.632 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.646+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 : miss 2019-11-29T11:29:52.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 info.flags=0x16 2019-11-29T11:29:52.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 to cache LRU end 2019-11-29T11:29:52.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:52.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 20 Read xattr: user.rgw.acl 2019-11-29T11:29:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 20 Read xattr: user.rgw.idtag 2019-11-29T11:29:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 : type miss (requested=0x13, cached=0x16) 2019-11-29T11:29:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.666+0000 7feef7d74ec0 20 rados->read ofs=0 len=0 2019-11-29T11:29:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-29T11:29:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 info.flags=0x13 2019-11-29T11:29:52.671 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 to cache LRU end 2019-11-29T11:29:52.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:52.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-29T11:29:52.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.687+0000 7feef7d74ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 2019-11-29T11:29:52.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.717+0000 7feef7d74ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12]) start [] num_entries 1100 2019-11-29T11:29:52.756 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.772+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-29T11:29:52.756 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.772+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-29T11:29:52.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.772+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-29T11:29:52.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.772+0000 7feef7d74ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-29T11:29:52.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.772+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:52.775 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.791+0000 7feef7d74ec0 10 manifest: total_size = 0 2019-11-29T11:29:52.775 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.791+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.319 2019-11-29T11:29:52.775 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.791+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:52.775 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.791+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:52.775 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.791+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 2019-11-29T11:29:52.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.925+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:52.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.942+0000 7feef7d74ec0 10 manifest: total_size = 0 2019-11-29T11:29:52.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.942+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.321 2019-11-29T11:29:52.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.942+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:52.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.942+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:52.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:52.942+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 2019-11-29T11:29:53.125 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.139+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:53.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.154+0000 7feef7d74ec0 10 manifest: total_size = 0 2019-11-29T11:29:53.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.154+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.320 2019-11-29T11:29:53.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.154+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:53.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.154+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:53.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.154+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 2019-11-29T11:29:53.272 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.288+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:53.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.297+0000 7feef7d74ec0 10 manifest: total_size = 0 2019-11-29T11:29:53.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.297+0000 7feef7d74ec0 20 get_obj_state: setting s->obj_tag to 9baad822-b080-4db2-b995-bf7cc78f9da0.4358.318 2019-11-29T11:29:53.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.297+0000 7feef7d74ec0 20 get_obj_state: rctx=0x7ffe93f39230 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55af81f3b428 s->prefetch_data=0 2019-11-29T11:29:53.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.297+0000 7feef7d74ec0 20 prepare_atomic_modification: state is not atomic. state=0x55af81f3b428 2019-11-29T11:29:53.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.297+0000 7feef7d74ec0 20 bucket index object: default.rgw.buckets.index:.dir.9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 2019-11-29T11:29:53.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.467+0000 7feef7d74ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12]) start _multipart_[] num_entries 1001 2019-11-29T11:29:53.452 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.467+0000 7feef7d74ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-29T11:29:53.512 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.528+0000 7feef7d74ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12])"; objs.size()=0; is_truncated=0 2019-11-29T11:29:53.579 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.595+0000 7feef7d74ec0 20 get_system_obj_state: rctx=0x7ffe93f38bc8 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x55af81f4c990 s->prefetch_data=0 2019-11-29T11:29:53.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.595+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-29T11:29:53.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-29T11:29:53.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-29T11:29:53.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T11:29:53.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T11:29:53.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-29T11:29:53.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-29T11:29:53.600 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.614+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-29T11:29:53.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:53.628+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94212287190864 notifier 4711 bl.length()=181 2019-11-29T11:29:54.193 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.209+0000 7feef7d74ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.12 from cache 2019-11-29T11:29:54.193 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.209+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=239 2019-11-29T11:29:54.207 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.223+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781193 cookie 94212287212544 notifier 4711 bl.length()=239 2019-11-29T11:29:54.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.499+0000 7feef7d74ec0 10 removing key index: PYWCBLGCXRYMAEDSTLFV 2019-11-29T11:29:54.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.499+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-29T11:29:54.502 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.518+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781186 cookie 94212287216224 notifier 4711 bl.length()=170 2019-11-29T11:29:54.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.933+0000 7feef7d74ec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-29T11:29:54.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.933+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-29T11:29:54.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:54.943+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781195 cookie 94212287189824 notifier 4711 bl.length()=182 2019-11-29T11:29:55.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.154+0000 7feef7d74ec0 10 removing user buckets index 2019-11-29T11:29:55.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.154+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-29T11:29:55.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.166+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781196 cookie 94212287214688 notifier 4711 bl.length()=173 2019-11-29T11:29:55.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.506+0000 7feef7d74ec0 10 removing user index: ragweed.client.0 2019-11-29T11:29:55.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.506+0000 7feef7d74ec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-29T11:29:55.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.506+0000 7feef7d74ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-29T11:29:55.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:55.516+0000 7feeda7fc700 10 RGWWatcher::handle_notify() notify_id 554050781194 cookie 94212287212544 notifier 4711 bl.length()=165 2019-11-29T11:29:55.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.012+0000 7feef7d74ec0 20 remove_watcher() i=0 2019-11-29T11:29:55.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.012+0000 7feef7d74ec0 2 removed watcher, disabling cache 2019-11-29T11:29:56.049 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.065+0000 7feef7d74ec0 20 remove_watcher() i=1 2019-11-29T11:29:56.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.115+0000 7feef7d74ec0 20 remove_watcher() i=2 2019-11-29T11:29:56.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.154+0000 7feef7d74ec0 20 remove_watcher() i=3 2019-11-29T11:29:56.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.196+0000 7feef7d74ec0 20 remove_watcher() i=4 2019-11-29T11:29:56.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.238+0000 7feef7d74ec0 20 remove_watcher() i=5 2019-11-29T11:29:56.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.270+0000 7feef7d74ec0 20 remove_watcher() i=6 2019-11-29T11:29:56.283 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:29:56.300+0000 7feef7d74ec0 20 remove_watcher() i=7 2019-11-29T11:29:56.294 INFO:tasks.ragweed:Removing ragweed... 2019-11-29T11:29:56.294 INFO:teuthology.orchestra.run.smithi182:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-29T11:29:56.397 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-29T11:29:56.421 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-29T11:29:56.421 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-29T11:29:56.421 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-29T11:29:56.421 INFO:teuthology.orchestra.run.smithi182:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-29T11:29:56.468 INFO:teuthology.orchestra.run.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-29T11:29:59.970 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-29T11:29:59.970 INFO:teuthology.orchestra.run.smithi182:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-29T11:30:02.376 INFO:teuthology.orchestra.run.smithi182.stdout: Gradle will be installed under /opt/gradle 2019-11-29T11:30:02.428 INFO:teuthology.orchestra.run.smithi182.stderr:--2019-11-29 11:30:02-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-29T11:30:02.436 INFO:teuthology.orchestra.run.smithi182.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:bf09, ... 2019-11-29T11:30:02.444 INFO:teuthology.orchestra.run.smithi182.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-11-29T11:30:02.478 INFO:teuthology.orchestra.run.smithi182.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-29T11:30:02.478 INFO:teuthology.orchestra.run.smithi182.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-29T11:30:02.479 INFO:teuthology.orchestra.run.smithi182.stderr:--2019-11-29 11:30:02-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-29T11:30:02.479 INFO:teuthology.orchestra.run.smithi182.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2019-11-29T11:30:02.487 INFO:teuthology.orchestra.run.smithi182.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-11-29T11:30:02.521 INFO:teuthology.orchestra.run.smithi182.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-29T11:30:02.522 INFO:teuthology.orchestra.run.smithi182.stderr:Length: 75323957 (72M) [application/zip] 2019-11-29T11:30:02.522 INFO:teuthology.orchestra.run.smithi182.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-29T11:30:02.523 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T11:30:02.532 INFO:teuthology.orchestra.run.smithi182.stderr: 0K .......... .......... .......... .......... .......... 0% 6.67M 11s 2019-11-29T11:30:02.533 INFO:teuthology.orchestra.run.smithi182.stderr: 50K .......... .......... .......... .......... .......... 0% 157M 6s 2019-11-29T11:30:02.537 INFO:teuthology.orchestra.run.smithi182.stderr: 100K .......... .......... .......... .......... .......... 0% 7.05M 7s 2019-11-29T11:30:02.539 INFO:teuthology.orchestra.run.smithi182.stderr: 150K .......... .......... .......... .......... .......... 0% 80.9M 6s 2019-11-29T11:30:02.542 INFO:teuthology.orchestra.run.smithi182.stderr: 200K .......... .......... .......... .......... .......... 0% 123M 5s 2019-11-29T11:30:02.542 INFO:teuthology.orchestra.run.smithi182.stderr: 250K .......... .......... .......... .......... .......... 0% 113M 4s 2019-11-29T11:30:02.542 INFO:teuthology.orchestra.run.smithi182.stderr: 300K .......... .......... .......... .......... .......... 0% 185M 3s 2019-11-29T11:30:02.546 INFO:teuthology.orchestra.run.smithi182.stderr: 350K .......... .......... .......... .......... .......... 0% 8.12M 4s 2019-11-29T11:30:02.546 INFO:teuthology.orchestra.run.smithi182.stderr: 400K .......... .......... .......... .......... .......... 0% 102M 4s 2019-11-29T11:30:02.549 INFO:teuthology.orchestra.run.smithi182.stderr: 450K .......... .......... .......... .......... .......... 0% 181M 3s 2019-11-29T11:30:02.550 INFO:teuthology.orchestra.run.smithi182.stderr: 500K .......... .......... .......... .......... .......... 0% 112M 3s 2019-11-29T11:30:02.550 INFO:teuthology.orchestra.run.smithi182.stderr: 550K .......... .......... .......... .......... .......... 0% 123M 3s 2019-11-29T11:30:02.550 INFO:teuthology.orchestra.run.smithi182.stderr: 600K .......... .......... .......... .......... .......... 0% 118M 3s 2019-11-29T11:30:02.554 INFO:teuthology.orchestra.run.smithi182.stderr: 650K .......... .......... .......... .......... .......... 0% 76.8M 3s 2019-11-29T11:30:02.554 INFO:teuthology.orchestra.run.smithi182.stderr: 700K .......... .......... .......... .......... .......... 1% 301M 2s 2019-11-29T11:30:02.554 INFO:teuthology.orchestra.run.smithi182.stderr: 750K .......... .......... .......... .......... .......... 1% 133M 2s 2019-11-29T11:30:02.554 INFO:teuthology.orchestra.run.smithi182.stderr: 800K .......... .......... .......... .......... .......... 1% 11.4M 3s 2019-11-29T11:30:02.561 INFO:teuthology.orchestra.run.smithi182.stderr: 850K .......... .......... .......... .......... .......... 1% 114M 2s 2019-11-29T11:30:02.562 INFO:teuthology.orchestra.run.smithi182.stderr: 900K .......... .......... .......... .......... .......... 1% 142M 2s 2019-11-29T11:30:02.562 INFO:teuthology.orchestra.run.smithi182.stderr: 950K .......... .......... .......... .......... .......... 1% 139M 2s 2019-11-29T11:30:02.562 INFO:teuthology.orchestra.run.smithi182.stderr: 1000K .......... .......... .......... .......... .......... 1% 130M 2s 2019-11-29T11:30:02.562 INFO:teuthology.orchestra.run.smithi182.stderr: 1050K .......... .......... .......... .......... .......... 1% 119M 2s 2019-11-29T11:30:02.563 INFO:teuthology.orchestra.run.smithi182.stderr: 1100K .......... .......... .......... .......... .......... 1% 171M 2s 2019-11-29T11:30:02.563 INFO:teuthology.orchestra.run.smithi182.stderr: 1150K .......... .......... .......... .......... .......... 1% 94.9M 2s 2019-11-29T11:30:02.563 INFO:teuthology.orchestra.run.smithi182.stderr: 1200K .......... .......... .......... .......... .......... 1% 131M 2s 2019-11-29T11:30:02.563 INFO:teuthology.orchestra.run.smithi182.stderr: 1250K .......... .......... .......... .......... .......... 1% 160M 2s 2019-11-29T11:30:02.563 INFO:teuthology.orchestra.run.smithi182.stderr: 1300K .......... .......... .......... .......... .......... 1% 131M 2s 2019-11-29T11:30:03.490 INFO:teuthology.orchestra.run.smithi182.stderr: 1350K .......... .......... .......... .......... .......... 1% 149M 2s 2019-11-29T11:30:03.491 INFO:teuthology.orchestra.run.smithi182.stderr: 1400K .......... .......... .......... .......... .......... 1% 128M 2s 2019-11-29T11:30:03.491 INFO:teuthology.orchestra.run.smithi182.stderr: 1450K .......... .......... .......... .......... .......... 2% 127M 2s 2019-11-29T11:30:03.491 INFO:teuthology.orchestra.run.smithi182.stderr: 1500K .......... .......... .......... .......... .......... 2% 17.8M 2s 2019-11-29T11:30:03.491 INFO:teuthology.orchestra.run.smithi182.stderr: 1550K .......... .......... .......... .......... .......... 2% 137M 2s 2019-11-29T11:30:03.491 INFO:teuthology.orchestra.run.smithi182.stderr: 1600K .......... .......... .......... .......... .......... 2% 218M 2s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1650K .......... .......... .......... .......... .......... 2% 175M 2s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1700K .......... .......... .......... .......... .......... 2% 149M 2s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1750K .......... .......... .......... .......... .......... 2% 150M 2s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1800K .......... .......... .......... .......... .......... 2% 139M 2s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1850K .......... .......... .......... .......... .......... 2% 155M 1s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1900K .......... .......... .......... .......... .......... 2% 215M 1s 2019-11-29T11:30:03.492 INFO:teuthology.orchestra.run.smithi182.stderr: 1950K .......... .......... .......... .......... .......... 2% 196M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2000K .......... .......... .......... .......... .......... 2% 289M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2050K .......... .......... .......... .......... .......... 2% 191M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2100K .......... .......... .......... .......... .......... 2% 243M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2150K .......... .......... .......... .......... .......... 2% 168M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2200K .......... .......... .......... .......... .......... 3% 211M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2250K .......... .......... .......... .......... .......... 3% 228M 1s 2019-11-29T11:30:03.493 INFO:teuthology.orchestra.run.smithi182.stderr: 2300K .......... .......... .......... .......... .......... 3% 193M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2350K .......... .......... .......... .......... .......... 3% 179M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2400K .......... .......... .......... .......... .......... 3% 210M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2450K .......... .......... .......... .......... .......... 3% 238M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2500K .......... .......... .......... .......... .......... 3% 209M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2550K .......... .......... .......... .......... .......... 3% 199M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2600K .......... .......... .......... .......... .......... 3% 263M 1s 2019-11-29T11:30:03.494 INFO:teuthology.orchestra.run.smithi182.stderr: 2650K .......... .......... .......... .......... .......... 3% 261M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2700K .......... .......... .......... .......... .......... 3% 216M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2750K .......... .......... .......... .......... .......... 3% 180M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2800K .......... .......... .......... .......... .......... 3% 46.5M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2850K .......... .......... .......... .......... .......... 3% 194M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2900K .......... .......... .......... .......... .......... 4% 205M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 2950K .......... .......... .......... .......... .......... 4% 175M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 3000K .......... .......... .......... .......... .......... 4% 222M 1s 2019-11-29T11:30:03.495 INFO:teuthology.orchestra.run.smithi182.stderr: 3050K .......... .......... .......... .......... .......... 4% 204M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3100K .......... .......... .......... .......... .......... 4% 220M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3150K .......... .......... .......... .......... .......... 4% 194M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3200K .......... .......... .......... .......... .......... 4% 233M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3250K .......... .......... .......... .......... .......... 4% 212M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3300K .......... .......... .......... .......... .......... 4% 342M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3350K .......... .......... .......... .......... .......... 4% 340M 1s 2019-11-29T11:30:03.496 INFO:teuthology.orchestra.run.smithi182.stderr: 3400K .......... .......... .......... .......... .......... 4% 372M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3450K .......... .......... .......... .......... .......... 4% 362M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3500K .......... .......... .......... .......... .......... 4% 390M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3550K .......... .......... .......... .......... .......... 4% 328M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3600K .......... .......... .......... .......... .......... 4% 384M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3650K .......... .......... .......... .......... .......... 5% 383M 1s 2019-11-29T11:30:03.497 INFO:teuthology.orchestra.run.smithi182.stderr: 3700K .......... .......... .......... .......... .......... 5% 390M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 3750K .......... .......... .......... .......... .......... 5% 331M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 3800K .......... .......... .......... .......... .......... 5% 371M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 3850K .......... .......... .......... .......... .......... 5% 381M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 3900K .......... .......... .......... .......... .......... 5% 379M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 3950K .......... .......... .......... .......... .......... 5% 317M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 4000K .......... .......... .......... .......... .......... 5% 380M 1s 2019-11-29T11:30:03.498 INFO:teuthology.orchestra.run.smithi182.stderr: 4050K .......... .......... .......... .......... .......... 5% 370M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4100K .......... .......... .......... .......... .......... 5% 394M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4150K .......... .......... .......... .......... .......... 5% 348M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4200K .......... .......... .......... .......... .......... 5% 383M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4250K .......... .......... .......... .......... .......... 5% 364M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4300K .......... .......... .......... .......... .......... 5% 372M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4350K .......... .......... .......... .......... .......... 5% 327M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4400K .......... .......... .......... .......... .......... 6% 372M 1s 2019-11-29T11:30:03.499 INFO:teuthology.orchestra.run.smithi182.stderr: 4450K .......... .......... .......... .......... .......... 6% 368M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4500K .......... .......... .......... .......... .......... 6% 360M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4550K .......... .......... .......... .......... .......... 6% 329M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4600K .......... .......... .......... .......... .......... 6% 370M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4650K .......... .......... .......... .......... .......... 6% 387M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4700K .......... .......... .......... .......... .......... 6% 396M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4750K .......... .......... .......... .......... .......... 6% 326M 1s 2019-11-29T11:30:03.500 INFO:teuthology.orchestra.run.smithi182.stderr: 4800K .......... .......... .......... .......... .......... 6% 383M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 4850K .......... .......... .......... .......... .......... 6% 385M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 4900K .......... .......... .......... .......... .......... 6% 381M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 4950K .......... .......... .......... .......... .......... 6% 307M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 5000K .......... .......... .......... .......... .......... 6% 380M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 5050K .......... .......... .......... .......... .......... 6% 372M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 5100K .......... .......... .......... .......... .......... 7% 392M 1s 2019-11-29T11:30:03.501 INFO:teuthology.orchestra.run.smithi182.stderr: 5150K .......... .......... .......... .......... .......... 7% 321M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5200K .......... .......... .......... .......... .......... 7% 383M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5250K .......... .......... .......... .......... .......... 7% 371M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5300K .......... .......... .......... .......... .......... 7% 377M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5350K .......... .......... .......... .......... .......... 7% 342M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5400K .......... .......... .......... .......... .......... 7% 375M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5450K .......... .......... .......... .......... .......... 7% 399M 1s 2019-11-29T11:30:03.502 INFO:teuthology.orchestra.run.smithi182.stderr: 5500K .......... .......... .......... .......... .......... 7% 375M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5550K .......... .......... .......... .......... .......... 7% 323M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5600K .......... .......... .......... .......... .......... 7% 391M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5650K .......... .......... .......... .......... .......... 7% 373M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5700K .......... .......... .......... .......... .......... 7% 367M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5750K .......... .......... .......... .......... .......... 7% 324M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5800K .......... .......... .......... .......... .......... 7% 369M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5850K .......... .......... .......... .......... .......... 8% 372M 1s 2019-11-29T11:30:03.503 INFO:teuthology.orchestra.run.smithi182.stderr: 5900K .......... .......... .......... .......... .......... 8% 369M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 5950K .......... .......... .......... .......... .......... 8% 318M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6000K .......... .......... .......... .......... .......... 8% 373M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6050K .......... .......... .......... .......... .......... 8% 356M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6100K .......... .......... .......... .......... .......... 8% 374M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6150K .......... .......... .......... .......... .......... 8% 338M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6200K .......... .......... .......... .......... .......... 8% 382M 1s 2019-11-29T11:30:03.504 INFO:teuthology.orchestra.run.smithi182.stderr: 6250K .......... .......... .......... .......... .......... 8% 373M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6300K .......... .......... .......... .......... .......... 8% 391M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6350K .......... .......... .......... .......... .......... 8% 317M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6400K .......... .......... .......... .......... .......... 8% 357M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6450K .......... .......... .......... .......... .......... 8% 386M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6500K .......... .......... .......... .......... .......... 8% 376M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6550K .......... .......... .......... .......... .......... 8% 329M 1s 2019-11-29T11:30:03.505 INFO:teuthology.orchestra.run.smithi182.stderr: 6600K .......... .......... .......... .......... .......... 9% 394M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6650K .......... .......... .......... .......... .......... 9% 360M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6700K .......... .......... .......... .......... .......... 9% 371M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6750K .......... .......... .......... .......... .......... 9% 294M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6800K .......... .......... .......... .......... .......... 9% 382M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6850K .......... .......... .......... .......... .......... 9% 384M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6900K .......... .......... .......... .......... .......... 9% 384M 1s 2019-11-29T11:30:03.506 INFO:teuthology.orchestra.run.smithi182.stderr: 6950K .......... .......... .......... .......... .......... 9% 343M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7000K .......... .......... .......... .......... .......... 9% 386M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7050K .......... .......... .......... .......... .......... 9% 380M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7100K .......... .......... .......... .......... .......... 9% 397M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7150K .......... .......... .......... .......... .......... 9% 319M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7200K .......... .......... .......... .......... .......... 9% 382M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7250K .......... .......... .......... .......... .......... 9% 381M 1s 2019-11-29T11:30:03.507 INFO:teuthology.orchestra.run.smithi182.stderr: 7300K .......... .......... .......... .......... .......... 9% 384M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7350K .......... .......... .......... .......... .......... 10% 351M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7400K .......... .......... .......... .......... .......... 10% 379M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7450K .......... .......... .......... .......... .......... 10% 383M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7500K .......... .......... .......... .......... .......... 10% 377M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7550K .......... .......... .......... .......... .......... 10% 298M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7600K .......... .......... .......... .......... .......... 10% 386M 1s 2019-11-29T11:30:03.508 INFO:teuthology.orchestra.run.smithi182.stderr: 7650K .......... .......... .......... .......... .......... 10% 397M 1s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7700K .......... .......... .......... .......... .......... 10% 414M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7750K .......... .......... .......... .......... .......... 10% 347M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7800K .......... .......... .......... .......... .......... 10% 404M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7850K .......... .......... .......... .......... .......... 10% 389M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7900K .......... .......... .......... .......... .......... 10% 392M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 7950K .......... .......... .......... .......... .......... 10% 323M 0s 2019-11-29T11:30:03.509 INFO:teuthology.orchestra.run.smithi182.stderr: 8000K .......... .......... .......... .......... .......... 10% 389M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8050K .......... .......... .......... .......... .......... 11% 394M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8100K .......... .......... .......... .......... .......... 11% 396M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8150K .......... .......... .......... .......... .......... 11% 361M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8200K .......... .......... .......... .......... .......... 11% 397M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8250K .......... .......... .......... .......... .......... 11% 405M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8300K .......... .......... .......... .......... .......... 11% 390M 0s 2019-11-29T11:30:03.510 INFO:teuthology.orchestra.run.smithi182.stderr: 8350K .......... .......... .......... .......... .......... 11% 328M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8400K .......... .......... .......... .......... .......... 11% 388M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8450K .......... .......... .......... .......... .......... 11% 378M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8500K .......... .......... .......... .......... .......... 11% 382M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8550K .......... .......... .......... .......... .......... 11% 338M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8600K .......... .......... .......... .......... .......... 11% 386M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8650K .......... .......... .......... .......... .......... 11% 399M 0s 2019-11-29T11:30:03.511 INFO:teuthology.orchestra.run.smithi182.stderr: 8700K .......... .......... .......... .......... .......... 11% 373M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 8750K .......... .......... .......... .......... .......... 11% 315M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 8800K .......... .......... .......... .......... .......... 12% 369M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 8850K .......... .......... .......... .......... .......... 12% 388M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 8900K .......... .......... .......... .......... .......... 12% 412M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 8950K .......... .......... .......... .......... .......... 12% 360M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 9000K .......... .......... .......... .......... .......... 12% 383M 0s 2019-11-29T11:30:03.512 INFO:teuthology.orchestra.run.smithi182.stderr: 9050K .......... .......... .......... .......... .......... 12% 394M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9100K .......... .......... .......... .......... .......... 12% 393M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9150K .......... .......... .......... .......... .......... 12% 300M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9200K .......... .......... .......... .......... .......... 12% 264M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9250K .......... .......... .......... .......... .......... 12% 355M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9300K .......... .......... .......... .......... .......... 12% 402M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9350K .......... .......... .......... .......... .......... 12% 354M 0s 2019-11-29T11:30:03.513 INFO:teuthology.orchestra.run.smithi182.stderr: 9400K .......... .......... .......... .......... .......... 12% 398M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9450K .......... .......... .......... .......... .......... 12% 391M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9500K .......... .......... .......... .......... .......... 12% 390M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9550K .......... .......... .......... .......... .......... 13% 329M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9600K .......... .......... .......... .......... .......... 13% 400M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9650K .......... .......... .......... .......... .......... 13% 392M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9700K .......... .......... .......... .......... .......... 13% 409M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9750K .......... .......... .......... .......... .......... 13% 363M 0s 2019-11-29T11:30:03.514 INFO:teuthology.orchestra.run.smithi182.stderr: 9800K .......... .......... .......... .......... .......... 13% 394M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 9850K .......... .......... .......... .......... .......... 13% 406M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 9900K .......... .......... .......... .......... .......... 13% 402M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 9950K .......... .......... .......... .......... .......... 13% 325M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 10000K .......... .......... .......... .......... .......... 13% 389M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 10050K .......... .......... .......... .......... .......... 13% 399M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 10100K .......... .......... .......... .......... .......... 13% 405M 0s 2019-11-29T11:30:03.515 INFO:teuthology.orchestra.run.smithi182.stderr: 10150K .......... .......... .......... .......... .......... 13% 351M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10200K .......... .......... .......... .......... .......... 13% 389M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10250K .......... .......... .......... .......... .......... 14% 392M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10300K .......... .......... .......... .......... .......... 14% 390M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10350K .......... .......... .......... .......... .......... 14% 358M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10400K .......... .......... .......... .......... .......... 14% 413M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10450K .......... .......... .......... .......... .......... 14% 393M 0s 2019-11-29T11:30:03.516 INFO:teuthology.orchestra.run.smithi182.stderr: 10500K .......... .......... .......... .......... .......... 14% 408M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10550K .......... .......... .......... .......... .......... 14% 333M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10600K .......... .......... .......... .......... .......... 14% 393M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10650K .......... .......... .......... .......... .......... 14% 409M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10700K .......... .......... .......... .......... .......... 14% 406M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10750K .......... .......... .......... .......... .......... 14% 345M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10800K .......... .......... .......... .......... .......... 14% 417M 0s 2019-11-29T11:30:03.517 INFO:teuthology.orchestra.run.smithi182.stderr: 10850K .......... .......... .......... .......... .......... 14% 396M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 10900K .......... .......... .......... .......... .......... 14% 401M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 10950K .......... .......... .......... .......... .......... 14% 335M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11000K .......... .......... .......... .......... .......... 15% 402M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11050K .......... .......... .......... .......... .......... 15% 380M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11100K .......... .......... .......... .......... .......... 15% 393M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11150K .......... .......... .......... .......... .......... 15% 360M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11200K .......... .......... .......... .......... .......... 15% 400M 0s 2019-11-29T11:30:03.518 INFO:teuthology.orchestra.run.smithi182.stderr: 11250K .......... .......... .......... .......... .......... 15% 399M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11300K .......... .......... .......... .......... .......... 15% 372M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11350K .......... .......... .......... .......... .......... 15% 349M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11400K .......... .......... .......... .......... .......... 15% 378M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11450K .......... .......... .......... .......... .......... 15% 415M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11500K .......... .......... .......... .......... .......... 15% 379M 0s 2019-11-29T11:30:03.519 INFO:teuthology.orchestra.run.smithi182.stderr: 11550K .......... .......... .......... .......... .......... 15% 336M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11600K .......... .......... .......... .......... .......... 15% 404M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11650K .......... .......... .......... .......... .......... 15% 406M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11700K .......... .......... .......... .......... .......... 15% 415M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11750K .......... .......... .......... .......... .......... 16% 356M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11800K .......... .......... .......... .......... .......... 16% 405M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11850K .......... .......... .......... .......... .......... 16% 411M 0s 2019-11-29T11:30:03.520 INFO:teuthology.orchestra.run.smithi182.stderr: 11900K .......... .......... .......... .......... .......... 16% 420M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 11950K .......... .......... .......... .......... .......... 16% 345M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12000K .......... .......... .......... .......... .......... 16% 411M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12050K .......... .......... .......... .......... .......... 16% 416M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12100K .......... .......... .......... .......... .......... 16% 417M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12150K .......... .......... .......... .......... .......... 16% 373M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12200K .......... .......... .......... .......... .......... 16% 371M 0s 2019-11-29T11:30:03.521 INFO:teuthology.orchestra.run.smithi182.stderr: 12250K .......... .......... .......... .......... .......... 16% 425M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12300K .......... .......... .......... .......... .......... 16% 436M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12350K .......... .......... .......... .......... .......... 16% 339M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12400K .......... .......... .......... .......... .......... 16% 418M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12450K .......... .......... .......... .......... .......... 16% 425M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12500K .......... .......... .......... .......... .......... 17% 377M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12550K .......... .......... .......... .......... .......... 17% 318M 0s 2019-11-29T11:30:03.522 INFO:teuthology.orchestra.run.smithi182.stderr: 12600K .......... .......... .......... .......... .......... 17% 251M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12650K .......... .......... .......... .......... .......... 17% 268M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12700K .......... .......... .......... .......... .......... 17% 241M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12750K .......... .......... .......... .......... .......... 17% 238M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12800K .......... .......... .......... .......... .......... 17% 333M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12850K .......... .......... .......... .......... .......... 17% 242M 0s 2019-11-29T11:30:03.523 INFO:teuthology.orchestra.run.smithi182.stderr: 12900K .......... .......... .......... .......... .......... 17% 266M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 12950K .......... .......... .......... .......... .......... 17% 209M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13000K .......... .......... .......... .......... .......... 17% 242M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13050K .......... .......... .......... .......... .......... 17% 248M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13100K .......... .......... .......... .......... .......... 17% 252M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13150K .......... .......... .......... .......... .......... 17% 272M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13200K .......... .......... .......... .......... .......... 18% 275M 0s 2019-11-29T11:30:03.524 INFO:teuthology.orchestra.run.smithi182.stderr: 13250K .......... .......... .......... .......... .......... 18% 253M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13300K .......... .......... .......... .......... .......... 18% 291M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13350K .......... .......... .......... .......... .......... 18% 221M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13400K .......... .......... .......... .......... .......... 18% 223M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13450K .......... .......... .......... .......... .......... 18% 219M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13500K .......... .......... .......... .......... .......... 18% 224M 0s 2019-11-29T11:30:03.525 INFO:teuthology.orchestra.run.smithi182.stderr: 13550K .......... .......... .......... .......... .......... 18% 198M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13600K .......... .......... .......... .......... .......... 18% 295M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13650K .......... .......... .......... .......... .......... 18% 283M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13700K .......... .......... .......... .......... .......... 18% 336M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13750K .......... .......... .......... .......... .......... 18% 344M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13800K .......... .......... .......... .......... .......... 18% 287M 0s 2019-11-29T11:30:03.526 INFO:teuthology.orchestra.run.smithi182.stderr: 13850K .......... .......... .......... .......... .......... 18% 324M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 13900K .......... .......... .......... .......... .......... 18% 363M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 13950K .......... .......... .......... .......... .......... 19% 324M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 14000K .......... .......... .......... .......... .......... 19% 414M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 14050K .......... .......... .......... .......... .......... 19% 405M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 14100K .......... .......... .......... .......... .......... 19% 385M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 14150K .......... .......... .......... .......... .......... 19% 331M 0s 2019-11-29T11:30:03.527 INFO:teuthology.orchestra.run.smithi182.stderr: 14200K .......... .......... .......... .......... .......... 19% 406M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14250K .......... .......... .......... .......... .......... 19% 405M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14300K .......... .......... .......... .......... .......... 19% 382M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14350K .......... .......... .......... .......... .......... 19% 318M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14400K .......... .......... .......... .......... .......... 19% 401M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14450K .......... .......... .......... .......... .......... 19% 394M 0s 2019-11-29T11:30:03.528 INFO:teuthology.orchestra.run.smithi182.stderr: 14500K .......... .......... .......... .......... .......... 19% 398M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14550K .......... .......... .......... .......... .......... 19% 356M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14600K .......... .......... .......... .......... .......... 19% 397M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14650K .......... .......... .......... .......... .......... 19% 396M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14700K .......... .......... .......... .......... .......... 20% 388M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14750K .......... .......... .......... .......... .......... 20% 324M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14800K .......... .......... .......... .......... .......... 20% 419M 0s 2019-11-29T11:30:03.529 INFO:teuthology.orchestra.run.smithi182.stderr: 14850K .......... .......... .......... .......... .......... 20% 416M 0s 2019-11-29T11:30:03.530 INFO:teuthology.orchestra.run.smithi182.stderr: 14900K .......... .......... .......... .......... .......... 20% 430M 0s 2019-11-29T11:30:03.530 INFO:teuthology.orchestra.run.smithi182.stderr: 14950K .......... .......... .......... .......... .......... 20% 364M 0s 2019-11-29T11:30:03.530 INFO:teuthology.orchestra.run.smithi182.stderr: 15000K .......... .......... .......... .......... .......... 20% 430M 0s 2019-11-29T11:30:03.530 INFO:teuthology.orchestra.run.smithi182.stderr: 15050K .......... .......... .......... .......... .......... 20% 416M 0s 2019-11-29T11:30:03.530 INFO:teuthology.orchestra.run.smithi182.stderr: 15100K .......... .......... .......... .......... .......... 20% 428M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15150K .......... .......... .......... .......... .......... 20% 362M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15200K .......... .......... .......... .......... .......... 20% 432M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15250K .......... .......... .......... .......... .......... 20% 432M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15300K .......... .......... .......... .......... .......... 20% 422M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15350K .......... .......... .......... .......... .......... 20% 386M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15400K .......... .......... .......... .......... .......... 21% 432M 0s 2019-11-29T11:30:03.531 INFO:teuthology.orchestra.run.smithi182.stderr: 15450K .......... .......... .......... .......... .......... 21% 427M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15500K .......... .......... .......... .......... .......... 21% 422M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15550K .......... .......... .......... .......... .......... 21% 356M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15600K .......... .......... .......... .......... .......... 21% 431M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15650K .......... .......... .......... .......... .......... 21% 419M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15700K .......... .......... .......... .......... .......... 21% 421M 0s 2019-11-29T11:30:03.532 INFO:teuthology.orchestra.run.smithi182.stderr: 15750K .......... .......... .......... .......... .......... 21% 382M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 15800K .......... .......... .......... .......... .......... 21% 405M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 15850K .......... .......... .......... .......... .......... 21% 432M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 15900K .......... .......... .......... .......... .......... 21% 403M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 15950K .......... .......... .......... .......... .......... 21% 333M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 16000K .......... .......... .......... .......... .......... 21% 424M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 16050K .......... .......... .......... .......... .......... 21% 423M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 16100K .......... .......... .......... .......... .......... 21% 425M 0s 2019-11-29T11:30:03.533 INFO:teuthology.orchestra.run.smithi182.stderr: 16150K .......... .......... .......... .......... .......... 22% 383M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16200K .......... .......... .......... .......... .......... 22% 387M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16250K .......... .......... .......... .......... .......... 22% 430M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16300K .......... .......... .......... .......... .......... 22% 391M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16350K .......... .......... .......... .......... .......... 22% 345M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16400K .......... .......... .......... .......... .......... 22% 427M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16450K .......... .......... .......... .......... .......... 22% 415M 0s 2019-11-29T11:30:03.534 INFO:teuthology.orchestra.run.smithi182.stderr: 16500K .......... .......... .......... .......... .......... 22% 400M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16550K .......... .......... .......... .......... .......... 22% 370M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16600K .......... .......... .......... .......... .......... 22% 424M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16650K .......... .......... .......... .......... .......... 22% 437M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16700K .......... .......... .......... .......... .......... 22% 409M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16750K .......... .......... .......... .......... .......... 22% 344M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16800K .......... .......... .......... .......... .......... 22% 424M 0s 2019-11-29T11:30:03.535 INFO:teuthology.orchestra.run.smithi182.stderr: 16850K .......... .......... .......... .......... .......... 22% 413M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 16900K .......... .......... .......... .......... .......... 23% 420M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 16950K .......... .......... .......... .......... .......... 23% 364M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 17000K .......... .......... .......... .......... .......... 23% 401M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 17050K .......... .......... .......... .......... .......... 23% 274M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 17100K .......... .......... .......... .......... .......... 23% 241M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 17150K .......... .......... .......... .......... .......... 23% 203M 0s 2019-11-29T11:30:03.536 INFO:teuthology.orchestra.run.smithi182.stderr: 17200K .......... .......... .......... .......... .......... 23% 277M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17250K .......... .......... .......... .......... .......... 23% 229M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17300K .......... .......... .......... .......... .......... 23% 252M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17350K .......... .......... .......... .......... .......... 23% 224M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17400K .......... .......... .......... .......... .......... 23% 362M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17450K .......... .......... .......... .......... .......... 23% 303M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17500K .......... .......... .......... .......... .......... 23% 356M 0s 2019-11-29T11:30:03.537 INFO:teuthology.orchestra.run.smithi182.stderr: 17550K .......... .......... .......... .......... .......... 23% 362M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17600K .......... .......... .......... .......... .......... 23% 439M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17650K .......... .......... .......... .......... .......... 24% 421M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17700K .......... .......... .......... .......... .......... 24% 401M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17750K .......... .......... .......... .......... .......... 24% 388M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17800K .......... .......... .......... .......... .......... 24% 402M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17850K .......... .......... .......... .......... .......... 24% 391M 0s 2019-11-29T11:30:03.538 INFO:teuthology.orchestra.run.smithi182.stderr: 17900K .......... .......... .......... .......... .......... 24% 425M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 17950K .......... .......... .......... .......... .......... 24% 340M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18000K .......... .......... .......... .......... .......... 24% 331M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18050K .......... .......... .......... .......... .......... 24% 394M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18100K .......... .......... .......... .......... .......... 24% 401M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18150K .......... .......... .......... .......... .......... 24% 370M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18200K .......... .......... .......... .......... .......... 24% 431M 0s 2019-11-29T11:30:03.539 INFO:teuthology.orchestra.run.smithi182.stderr: 18250K .......... .......... .......... .......... .......... 24% 431M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18300K .......... .......... .......... .......... .......... 24% 419M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18350K .......... .......... .......... .......... .......... 25% 360M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18400K .......... .......... .......... .......... .......... 25% 425M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18450K .......... .......... .......... .......... .......... 25% 434M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18500K .......... .......... .......... .......... .......... 25% 406M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18550K .......... .......... .......... .......... .......... 25% 374M 0s 2019-11-29T11:30:03.540 INFO:teuthology.orchestra.run.smithi182.stderr: 18600K .......... .......... .......... .......... .......... 25% 409M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18650K .......... .......... .......... .......... .......... 25% 425M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18700K .......... .......... .......... .......... .......... 25% 407M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18750K .......... .......... .......... .......... .......... 25% 348M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18800K .......... .......... .......... .......... .......... 25% 420M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18850K .......... .......... .......... .......... .......... 25% 433M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18900K .......... .......... .......... .......... .......... 25% 393M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 18950K .......... .......... .......... .......... .......... 25% 345M 0s 2019-11-29T11:30:03.541 INFO:teuthology.orchestra.run.smithi182.stderr: 19000K .......... .......... .......... .......... .......... 25% 392M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19050K .......... .......... .......... .......... .......... 25% 418M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19100K .......... .......... .......... .......... .......... 26% 421M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19150K .......... .......... .......... .......... .......... 26% 340M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19200K .......... .......... .......... .......... .......... 26% 367M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19250K .......... .......... .......... .......... .......... 26% 341M 0s 2019-11-29T11:30:03.542 INFO:teuthology.orchestra.run.smithi182.stderr: 19300K .......... .......... .......... .......... .......... 26% 391M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19350K .......... .......... .......... .......... .......... 26% 368M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19400K .......... .......... .......... .......... .......... 26% 397M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19450K .......... .......... .......... .......... .......... 26% 423M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19500K .......... .......... .......... .......... .......... 26% 421M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19550K .......... .......... .......... .......... .......... 26% 358M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19600K .......... .......... .......... .......... .......... 26% 431M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19650K .......... .......... .......... .......... .......... 26% 423M 0s 2019-11-29T11:30:03.543 INFO:teuthology.orchestra.run.smithi182.stderr: 19700K .......... .......... .......... .......... .......... 26% 407M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 19750K .......... .......... .......... .......... .......... 26% 368M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 19800K .......... .......... .......... .......... .......... 26% 427M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 19850K .......... .......... .......... .......... .......... 27% 446M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 19900K .......... .......... .......... .......... .......... 27% 429M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 19950K .......... .......... .......... .......... .......... 27% 366M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 20000K .......... .......... .......... .......... .......... 27% 418M 0s 2019-11-29T11:30:03.544 INFO:teuthology.orchestra.run.smithi182.stderr: 20050K .......... .......... .......... .......... .......... 27% 422M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20100K .......... .......... .......... .......... .......... 27% 430M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20150K .......... .......... .......... .......... .......... 27% 367M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20200K .......... .......... .......... .......... .......... 27% 403M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20250K .......... .......... .......... .......... .......... 27% 438M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20300K .......... .......... .......... .......... .......... 27% 428M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20350K .......... .......... .......... .......... .......... 27% 345M 0s 2019-11-29T11:30:03.545 INFO:teuthology.orchestra.run.smithi182.stderr: 20400K .......... .......... .......... .......... .......... 27% 401M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20450K .......... .......... .......... .......... .......... 27% 408M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20500K .......... .......... .......... .......... .......... 27% 412M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20550K .......... .......... .......... .......... .......... 28% 254M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20600K .......... .......... .......... .......... .......... 28% 413M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20650K .......... .......... .......... .......... .......... 28% 434M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20700K .......... .......... .......... .......... .......... 28% 412M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20750K .......... .......... .......... .......... .......... 28% 354M 0s 2019-11-29T11:30:03.546 INFO:teuthology.orchestra.run.smithi182.stderr: 20800K .......... .......... .......... .......... .......... 28% 417M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 20850K .......... .......... .......... .......... .......... 28% 210M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 20900K .......... .......... .......... .......... .......... 28% 402M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 20950K .......... .......... .......... .......... .......... 28% 373M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 21000K .......... .......... .......... .......... .......... 28% 420M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 21050K .......... .......... .......... .......... .......... 28% 287M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 21100K .......... .......... .......... .......... .......... 28% 362M 0s 2019-11-29T11:30:03.547 INFO:teuthology.orchestra.run.smithi182.stderr: 21150K .......... .......... .......... .......... .......... 28% 329M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21200K .......... .......... .......... .......... .......... 28% 387M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21250K .......... .......... .......... .......... .......... 28% 412M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21300K .......... .......... .......... .......... .......... 29% 417M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21350K .......... .......... .......... .......... .......... 29% 379M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21400K .......... .......... .......... .......... .......... 29% 423M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21450K .......... .......... .......... .......... .......... 29% 416M 0s 2019-11-29T11:30:03.548 INFO:teuthology.orchestra.run.smithi182.stderr: 21500K .......... .......... .......... .......... .......... 29% 412M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21550K .......... .......... .......... .......... .......... 29% 355M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21600K .......... .......... .......... .......... .......... 29% 433M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21650K .......... .......... .......... .......... .......... 29% 422M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21700K .......... .......... .......... .......... .......... 29% 373M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21750K .......... .......... .......... .......... .......... 29% 328M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21800K .......... .......... .......... .......... .......... 29% 381M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21850K .......... .......... .......... .......... .......... 29% 424M 0s 2019-11-29T11:30:03.549 INFO:teuthology.orchestra.run.smithi182.stderr: 21900K .......... .......... .......... .......... .......... 29% 384M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 21950K .......... .......... .......... .......... .......... 29% 329M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22000K .......... .......... .......... .......... .......... 29% 406M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22050K .......... .......... .......... .......... .......... 30% 412M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22100K .......... .......... .......... .......... .......... 30% 403M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22150K .......... .......... .......... .......... .......... 30% 382M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22200K .......... .......... .......... .......... .......... 30% 425M 0s 2019-11-29T11:30:03.550 INFO:teuthology.orchestra.run.smithi182.stderr: 22250K .......... .......... .......... .......... .......... 30% 410M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22300K .......... .......... .......... .......... .......... 30% 149M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22350K .......... .......... .......... .......... .......... 30% 308M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22400K .......... .......... .......... .......... .......... 30% 424M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22450K .......... .......... .......... .......... .......... 30% 428M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22500K .......... .......... .......... .......... .......... 30% 426M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22550K .......... .......... .......... .......... .......... 30% 387M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22600K .......... .......... .......... .......... .......... 30% 432M 0s 2019-11-29T11:30:03.551 INFO:teuthology.orchestra.run.smithi182.stderr: 22650K .......... .......... .......... .......... .......... 30% 421M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22700K .......... .......... .......... .......... .......... 30% 423M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22750K .......... .......... .......... .......... .......... 30% 359M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22800K .......... .......... .......... .......... .......... 31% 400M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22850K .......... .......... .......... .......... .......... 31% 371M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22900K .......... .......... .......... .......... .......... 31% 378M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 22950K .......... .......... .......... .......... .......... 31% 361M 0s 2019-11-29T11:30:03.552 INFO:teuthology.orchestra.run.smithi182.stderr: 23000K .......... .......... .......... .......... .......... 31% 421M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23050K .......... .......... .......... .......... .......... 31% 415M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23100K .......... .......... .......... .......... .......... 31% 409M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23150K .......... .......... .......... .......... .......... 31% 317M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23200K .......... .......... .......... .......... .......... 31% 379M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23250K .......... .......... .......... .......... .......... 31% 402M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23300K .......... .......... .......... .......... .......... 31% 395M 0s 2019-11-29T11:30:03.553 INFO:teuthology.orchestra.run.smithi182.stderr: 23350K .......... .......... .......... .......... .......... 31% 382M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23400K .......... .......... .......... .......... .......... 31% 366M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23450K .......... .......... .......... .......... .......... 31% 360M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23500K .......... .......... .......... .......... .......... 32% 362M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23550K .......... .......... .......... .......... .......... 32% 294M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23600K .......... .......... .......... .......... .......... 32% 350M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23650K .......... .......... .......... .......... .......... 32% 378M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23700K .......... .......... .......... .......... .......... 32% 356M 0s 2019-11-29T11:30:03.554 INFO:teuthology.orchestra.run.smithi182.stderr: 23750K .......... .......... .......... .......... .......... 32% 325M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 23800K .......... .......... .......... .......... .......... 32% 368M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 23850K .......... .......... .......... .......... .......... 32% 352M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 23900K .......... .......... .......... .......... .......... 32% 404M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 23950K .......... .......... .......... .......... .......... 32% 345M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 24000K .......... .......... .......... .......... .......... 32% 412M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 24050K .......... .......... .......... .......... .......... 32% 342M 0s 2019-11-29T11:30:03.555 INFO:teuthology.orchestra.run.smithi182.stderr: 24100K .......... .......... .......... .......... .......... 32% 360M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24150K .......... .......... .......... .......... .......... 32% 308M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24200K .......... .......... .......... .......... .......... 32% 404M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24250K .......... .......... .......... .......... .......... 33% 430M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24300K .......... .......... .......... .......... .......... 33% 384M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24350K .......... .......... .......... .......... .......... 33% 338M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24400K .......... .......... .......... .......... .......... 33% 361M 0s 2019-11-29T11:30:03.556 INFO:teuthology.orchestra.run.smithi182.stderr: 24450K .......... .......... .......... .......... .......... 33% 394M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24500K .......... .......... .......... .......... .......... 33% 381M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24550K .......... .......... .......... .......... .......... 33% 386M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24600K .......... .......... .......... .......... .......... 33% 400M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24650K .......... .......... .......... .......... .......... 33% 423M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24700K .......... .......... .......... .......... .......... 33% 408M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24750K .......... .......... .......... .......... .......... 33% 349M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24800K .......... .......... .......... .......... .......... 33% 420M 0s 2019-11-29T11:30:03.557 INFO:teuthology.orchestra.run.smithi182.stderr: 24850K .......... .......... .......... .......... .......... 33% 419M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 24900K .......... .......... .......... .......... .......... 33% 437M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 24950K .......... .......... .......... .......... .......... 33% 388M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 25000K .......... .......... .......... .......... .......... 34% 435M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 25050K .......... .......... .......... .......... .......... 34% 390M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 25100K .......... .......... .......... .......... .......... 34% 372M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 25150K .......... .......... .......... .......... .......... 34% 332M 0s 2019-11-29T11:30:03.558 INFO:teuthology.orchestra.run.smithi182.stderr: 25200K .......... .......... .......... .......... .......... 34% 430M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25250K .......... .......... .......... .......... .......... 34% 429M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25300K .......... .......... .......... .......... .......... 34% 164M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25350K .......... .......... .......... .......... .......... 34% 119M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25400K .......... .......... .......... .......... .......... 34% 139M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25450K .......... .......... .......... .......... .......... 34% 161M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25500K .......... .......... .......... .......... .......... 34% 185M 0s 2019-11-29T11:30:03.559 INFO:teuthology.orchestra.run.smithi182.stderr: 25550K .......... .......... .......... .......... .......... 34% 200M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25600K .......... .......... .......... .......... .......... 34% 346M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25650K .......... .......... .......... .......... .......... 34% 334M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25700K .......... .......... .......... .......... .......... 35% 338M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25750K .......... .......... .......... .......... .......... 35% 304M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25800K .......... .......... .......... .......... .......... 35% 333M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25850K .......... .......... .......... .......... .......... 35% 343M 0s 2019-11-29T11:30:03.560 INFO:teuthology.orchestra.run.smithi182.stderr: 25900K .......... .......... .......... .......... .......... 35% 343M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 25950K .......... .......... .......... .......... .......... 35% 278M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26000K .......... .......... .......... .......... .......... 35% 355M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26050K .......... .......... .......... .......... .......... 35% 332M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26100K .......... .......... .......... .......... .......... 35% 337M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26150K .......... .......... .......... .......... .......... 35% 288M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26200K .......... .......... .......... .......... .......... 35% 343M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26250K .......... .......... .......... .......... .......... 35% 357M 0s 2019-11-29T11:30:03.561 INFO:teuthology.orchestra.run.smithi182.stderr: 26300K .......... .......... .......... .......... .......... 35% 349M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26350K .......... .......... .......... .......... .......... 35% 279M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26400K .......... .......... .......... .......... .......... 35% 333M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26450K .......... .......... .......... .......... .......... 36% 335M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26500K .......... .......... .......... .......... .......... 36% 341M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26550K .......... .......... .......... .......... .......... 36% 301M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26600K .......... .......... .......... .......... .......... 36% 348M 0s 2019-11-29T11:30:03.562 INFO:teuthology.orchestra.run.smithi182.stderr: 26650K .......... .......... .......... .......... .......... 36% 343M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26700K .......... .......... .......... .......... .......... 36% 330M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26750K .......... .......... .......... .......... .......... 36% 284M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26800K .......... .......... .......... .......... .......... 36% 350M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26850K .......... .......... .......... .......... .......... 36% 323M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26900K .......... .......... .......... .......... .......... 36% 360M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 26950K .......... .......... .......... .......... .......... 36% 313M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 27000K .......... .......... .......... .......... .......... 36% 340M 0s 2019-11-29T11:30:03.563 INFO:teuthology.orchestra.run.smithi182.stderr: 27050K .......... .......... .......... .......... .......... 36% 340M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27100K .......... .......... .......... .......... .......... 36% 347M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27150K .......... .......... .......... .......... .......... 36% 288M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27200K .......... .......... .......... .......... .......... 37% 330M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27250K .......... .......... .......... .......... .......... 37% 339M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27300K .......... .......... .......... .......... .......... 37% 311M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27350K .......... .......... .......... .......... .......... 37% 205M 0s 2019-11-29T11:30:03.564 INFO:teuthology.orchestra.run.smithi182.stderr: 27400K .......... .......... .......... .......... .......... 37% 235M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27450K .......... .......... .......... .......... .......... 37% 285M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27500K .......... .......... .......... .......... .......... 37% 299M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27550K .......... .......... .......... .......... .......... 37% 262M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27600K .......... .......... .......... .......... .......... 37% 339M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27650K .......... .......... .......... .......... .......... 37% 339M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27700K .......... .......... .......... .......... .......... 37% 294M 0s 2019-11-29T11:30:03.565 INFO:teuthology.orchestra.run.smithi182.stderr: 27750K .......... .......... .......... .......... .......... 37% 289M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 27800K .......... .......... .......... .......... .......... 37% 326M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 27850K .......... .......... .......... .......... .......... 37% 245M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 27900K .......... .......... .......... .......... .......... 37% 232M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 27950K .......... .......... .......... .......... .......... 38% 189M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 28000K .......... .......... .......... .......... .......... 38% 224M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 28050K .......... .......... .......... .......... .......... 38% 227M 0s 2019-11-29T11:30:03.566 INFO:teuthology.orchestra.run.smithi182.stderr: 28100K .......... .......... .......... .......... .......... 38% 223M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28150K .......... .......... .......... .......... .......... 38% 209M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28200K .......... .......... .......... .......... .......... 38% 221M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28250K .......... .......... .......... .......... .......... 38% 226M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28300K .......... .......... .......... .......... .......... 38% 235M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28350K .......... .......... .......... .......... .......... 38% 198M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28400K .......... .......... .......... .......... .......... 38% 249M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28450K .......... .......... .......... .......... .......... 38% 234M 0s 2019-11-29T11:30:03.567 INFO:teuthology.orchestra.run.smithi182.stderr: 28500K .......... .......... .......... .......... .......... 38% 243M 0s 2019-11-29T11:30:03.568 INFO:teuthology.orchestra.run.smithi182.stderr: 28550K .......... .......... .......... .......... .......... 38% 215M 0s 2019-11-29T11:30:03.568 INFO:teuthology.orchestra.run.smithi182.stderr: 28600K .......... .......... .......... .......... .......... 38% 240M 0s 2019-11-29T11:30:03.568 INFO:teuthology.orchestra.run.smithi182.stderr: 28650K .......... .......... .......... .......... .......... 39% 244M 0s 2019-11-29T11:30:03.568 INFO:teuthology.orchestra.run.smithi182.stderr: 28700K .......... .......... .......... .......... .......... 39% 237M 0s 2019-11-29T11:30:03.569 INFO:teuthology.orchestra.run.smithi182.stderr: 28750K .......... .......... .......... .......... .......... 39% 199M 0s 2019-11-29T11:30:03.569 INFO:teuthology.orchestra.run.smithi182.stderr: 28800K .......... .......... .......... .......... .......... 39% 233M 0s 2019-11-29T11:30:03.570 INFO:teuthology.orchestra.run.smithi182.stderr: 28850K .......... .......... .......... .......... .......... 39% 235M 0s 2019-11-29T11:30:03.570 INFO:teuthology.orchestra.run.smithi182.stderr: 28900K .......... .......... .......... .......... .......... 39% 244M 0s 2019-11-29T11:30:03.570 INFO:teuthology.orchestra.run.smithi182.stderr: 28950K .......... .......... .......... .......... .......... 39% 212M 0s 2019-11-29T11:30:03.570 INFO:teuthology.orchestra.run.smithi182.stderr: 29000K .......... .......... .......... .......... .......... 39% 239M 0s 2019-11-29T11:30:03.570 INFO:teuthology.orchestra.run.smithi182.stderr: 29050K .......... .......... .......... .......... .......... 39% 243M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29100K .......... .......... .......... .......... .......... 39% 246M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29150K .......... .......... .......... .......... .......... 39% 184M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29200K .......... .......... .......... .......... .......... 39% 233M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29250K .......... .......... .......... .......... .......... 39% 239M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29300K .......... .......... .......... .......... .......... 39% 225M 0s 2019-11-29T11:30:03.571 INFO:teuthology.orchestra.run.smithi182.stderr: 29350K .......... .......... .......... .......... .......... 39% 199M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29400K .......... .......... .......... .......... .......... 40% 226M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29450K .......... .......... .......... .......... .......... 40% 227M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29500K .......... .......... .......... .......... .......... 40% 221M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29550K .......... .......... .......... .......... .......... 40% 205M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29600K .......... .......... .......... .......... .......... 40% 224M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29650K .......... .......... .......... .......... .......... 40% 232M 0s 2019-11-29T11:30:03.572 INFO:teuthology.orchestra.run.smithi182.stderr: 29700K .......... .......... .......... .......... .......... 40% 242M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 29750K .......... .......... .......... .......... .......... 40% 223M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 29800K .......... .......... .......... .......... .......... 40% 234M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 29850K .......... .......... .......... .......... .......... 40% 243M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 29900K .......... .......... .......... .......... .......... 40% 250M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 29950K .......... .......... .......... .......... .......... 40% 209M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 30000K .......... .......... .......... .......... .......... 40% 251M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 30050K .......... .......... .......... .......... .......... 40% 247M 0s 2019-11-29T11:30:03.573 INFO:teuthology.orchestra.run.smithi182.stderr: 30100K .......... .......... .......... .......... .......... 40% 246M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30150K .......... .......... .......... .......... .......... 41% 223M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30200K .......... .......... .......... .......... .......... 41% 259M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30250K .......... .......... .......... .......... .......... 41% 249M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30300K .......... .......... .......... .......... .......... 41% 246M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30350K .......... .......... .......... .......... .......... 41% 207M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30400K .......... .......... .......... .......... .......... 41% 247M 0s 2019-11-29T11:30:03.574 INFO:teuthology.orchestra.run.smithi182.stderr: 30450K .......... .......... .......... .......... .......... 41% 252M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30500K .......... .......... .......... .......... .......... 41% 261M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30550K .......... .......... .......... .......... .......... 41% 223M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30600K .......... .......... .......... .......... .......... 41% 253M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30650K .......... .......... .......... .......... .......... 41% 234M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30700K .......... .......... .......... .......... .......... 41% 238M 0s 2019-11-29T11:30:03.575 INFO:teuthology.orchestra.run.smithi182.stderr: 30750K .......... .......... .......... .......... .......... 41% 202M 0s 2019-11-29T11:30:03.576 INFO:teuthology.orchestra.run.smithi182.stderr: 30800K .......... .......... .......... .......... .......... 41% 242M 0s 2019-11-29T11:30:03.576 INFO:teuthology.orchestra.run.smithi182.stderr: 30850K .......... .......... .......... .......... .......... 42% 249M 0s 2019-11-29T11:30:03.576 INFO:teuthology.orchestra.run.smithi182.stderr: 30900K .......... .......... .......... .......... .......... 42% 257M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 30950K .......... .......... .......... .......... .......... 42% 232M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31000K .......... .......... .......... .......... .......... 42% 238M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31050K .......... .......... .......... .......... .......... 42% 249M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31100K .......... .......... .......... .......... .......... 42% 251M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31150K .......... .......... .......... .......... .......... 42% 204M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31200K .......... .......... .......... .......... .......... 42% 255M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31250K .......... .......... .......... .......... .......... 42% 260M 0s 2019-11-29T11:30:03.577 INFO:teuthology.orchestra.run.smithi182.stderr: 31300K .......... .......... .......... .......... .......... 42% 242M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31350K .......... .......... .......... .......... .......... 42% 230M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31400K .......... .......... .......... .......... .......... 42% 268M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31450K .......... .......... .......... .......... .......... 42% 259M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31500K .......... .......... .......... .......... .......... 42% 267M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31550K .......... .......... .......... .......... .......... 42% 214M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31600K .......... .......... .......... .......... .......... 43% 256M 0s 2019-11-29T11:30:03.578 INFO:teuthology.orchestra.run.smithi182.stderr: 31650K .......... .......... .......... .......... .......... 43% 257M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31700K .......... .......... .......... .......... .......... 43% 265M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31750K .......... .......... .......... .......... .......... 43% 230M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31800K .......... .......... .......... .......... .......... 43% 244M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31850K .......... .......... .......... .......... .......... 43% 264M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31900K .......... .......... .......... .......... .......... 43% 257M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 31950K .......... .......... .......... .......... .......... 43% 211M 0s 2019-11-29T11:30:03.579 INFO:teuthology.orchestra.run.smithi182.stderr: 32000K .......... .......... .......... .......... .......... 43% 241M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32050K .......... .......... .......... .......... .......... 43% 253M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32100K .......... .......... .......... .......... .......... 43% 259M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32150K .......... .......... .......... .......... .......... 43% 225M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32200K .......... .......... .......... .......... .......... 43% 252M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32250K .......... .......... .......... .......... .......... 43% 252M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32300K .......... .......... .......... .......... .......... 43% 258M 0s 2019-11-29T11:30:03.580 INFO:teuthology.orchestra.run.smithi182.stderr: 32350K .......... .......... .......... .......... .......... 44% 217M 0s 2019-11-29T11:30:03.581 INFO:teuthology.orchestra.run.smithi182.stderr: 32400K .......... .......... .......... .......... .......... 44% 262M 0s 2019-11-29T11:30:03.581 INFO:teuthology.orchestra.run.smithi182.stderr: 32450K .......... .......... .......... .......... .......... 44% 264M 0s 2019-11-29T11:30:03.581 INFO:teuthology.orchestra.run.smithi182.stderr: 32500K .......... .......... .......... .......... .......... 44% 264M 0s 2019-11-29T11:30:03.581 INFO:teuthology.orchestra.run.smithi182.stderr: 32550K .......... .......... .......... .......... .......... 44% 231M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32600K .......... .......... .......... .......... .......... 44% 261M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32650K .......... .......... .......... .......... .......... 44% 259M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32700K .......... .......... .......... .......... .......... 44% 239M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32750K .......... .......... .......... .......... .......... 44% 204M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32800K .......... .......... .......... .......... .......... 44% 244M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32850K .......... .......... .......... .......... .......... 44% 243M 0s 2019-11-29T11:30:03.582 INFO:teuthology.orchestra.run.smithi182.stderr: 32900K .......... .......... .......... .......... .......... 44% 252M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 32950K .......... .......... .......... .......... .......... 44% 223M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33000K .......... .......... .......... .......... .......... 44% 254M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33050K .......... .......... .......... .......... .......... 44% 237M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33100K .......... .......... .......... .......... .......... 45% 226M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33150K .......... .......... .......... .......... .......... 45% 205M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33200K .......... .......... .......... .......... .......... 45% 265M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33250K .......... .......... .......... .......... .......... 45% 253M 0s 2019-11-29T11:30:03.583 INFO:teuthology.orchestra.run.smithi182.stderr: 33300K .......... .......... .......... .......... .......... 45% 263M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33350K .......... .......... .......... .......... .......... 45% 245M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33400K .......... .......... .......... .......... .......... 45% 267M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33450K .......... .......... .......... .......... .......... 45% 264M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33500K .......... .......... .......... .......... .......... 45% 258M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33550K .......... .......... .......... .......... .......... 45% 212M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33600K .......... .......... .......... .......... .......... 45% 261M 0s 2019-11-29T11:30:03.584 INFO:teuthology.orchestra.run.smithi182.stderr: 33650K .......... .......... .......... .......... .......... 45% 260M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33700K .......... .......... .......... .......... .......... 45% 279M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33750K .......... .......... .......... .......... .......... 45% 226M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33800K .......... .......... .......... .......... .......... 46% 250M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33850K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33900K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 33950K .......... .......... .......... .......... .......... 46% 218M 0s 2019-11-29T11:30:03.585 INFO:teuthology.orchestra.run.smithi182.stderr: 34000K .......... .......... .......... .......... .......... 46% 265M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34050K .......... .......... .......... .......... .......... 46% 260M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34100K .......... .......... .......... .......... .......... 46% 272M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34150K .......... .......... .......... .......... .......... 46% 243M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34200K .......... .......... .......... .......... .......... 46% 274M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34250K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34300K .......... .......... .......... .......... .......... 46% 247M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34350K .......... .......... .......... .......... .......... 46% 206M 0s 2019-11-29T11:30:03.586 INFO:teuthology.orchestra.run.smithi182.stderr: 34400K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-29T11:30:03.587 INFO:teuthology.orchestra.run.smithi182.stderr: 34450K .......... .......... .......... .......... .......... 46% 251M 0s 2019-11-29T11:30:03.587 INFO:teuthology.orchestra.run.smithi182.stderr: 34500K .......... .......... .......... .......... .......... 46% 252M 0s 2019-11-29T11:30:03.587 INFO:teuthology.orchestra.run.smithi182.stderr: 34550K .......... .......... .......... .......... .......... 47% 228M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34600K .......... .......... .......... .......... .......... 47% 245M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34650K .......... .......... .......... .......... .......... 47% 219M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34700K .......... .......... .......... .......... .......... 47% 251M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34750K .......... .......... .......... .......... .......... 47% 219M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34800K .......... .......... .......... .......... .......... 47% 259M 0s 2019-11-29T11:30:03.588 INFO:teuthology.orchestra.run.smithi182.stderr: 34850K .......... .......... .......... .......... .......... 47% 243M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 34900K .......... .......... .......... .......... .......... 47% 260M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 34950K .......... .......... .......... .......... .......... 47% 242M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 35000K .......... .......... .......... .......... .......... 47% 256M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 35050K .......... .......... .......... .......... .......... 47% 255M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 35100K .......... .......... .......... .......... .......... 47% 267M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 35150K .......... .......... .......... .......... .......... 47% 220M 0s 2019-11-29T11:30:03.589 INFO:teuthology.orchestra.run.smithi182.stderr: 35200K .......... .......... .......... .......... .......... 47% 279M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35250K .......... .......... .......... .......... .......... 47% 276M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35300K .......... .......... .......... .......... .......... 48% 271M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35350K .......... .......... .......... .......... .......... 48% 237M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35400K .......... .......... .......... .......... .......... 48% 267M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35450K .......... .......... .......... .......... .......... 48% 286M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35500K .......... .......... .......... .......... .......... 48% 277M 0s 2019-11-29T11:30:03.590 INFO:teuthology.orchestra.run.smithi182.stderr: 35550K .......... .......... .......... .......... .......... 48% 228M 0s 2019-11-29T11:30:03.591 INFO:teuthology.orchestra.run.smithi182.stderr: 35600K .......... .......... .......... .......... .......... 48% 269M 0s 2019-11-29T11:30:03.591 INFO:teuthology.orchestra.run.smithi182.stderr: 35650K .......... .......... .......... .......... .......... 48% 268M 0s 2019-11-29T11:30:03.591 INFO:teuthology.orchestra.run.smithi182.stderr: 35700K .......... .......... .......... .......... .......... 48% 260M 0s 2019-11-29T11:30:03.591 INFO:teuthology.orchestra.run.smithi182.stderr: 35750K .......... .......... .......... .......... .......... 48% 246M 0s 2019-11-29T11:30:03.592 INFO:teuthology.orchestra.run.smithi182.stderr: 35800K .......... .......... .......... .......... .......... 48% 278M 0s 2019-11-29T11:30:03.592 INFO:teuthology.orchestra.run.smithi182.stderr: 35850K .......... .......... .......... .......... .......... 48% 284M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 35900K .......... .......... .......... .......... .......... 48% 281M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 35950K .......... .......... .......... .......... .......... 48% 232M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 36000K .......... .......... .......... .......... .......... 49% 270M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 36050K .......... .......... .......... .......... .......... 49% 274M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 36100K .......... .......... .......... .......... .......... 49% 283M 0s 2019-11-29T11:30:03.593 INFO:teuthology.orchestra.run.smithi182.stderr: 36150K .......... .......... .......... .......... .......... 49% 250M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36200K .......... .......... .......... .......... .......... 49% 280M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36250K .......... .......... .......... .......... .......... 49% 281M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36300K .......... .......... .......... .......... .......... 49% 284M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36350K .......... .......... .......... .......... .......... 49% 234M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36400K .......... .......... .......... .......... .......... 49% 266M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36450K .......... .......... .......... .......... .......... 49% 261M 0s 2019-11-29T11:30:03.594 INFO:teuthology.orchestra.run.smithi182.stderr: 36500K .......... .......... .......... .......... .......... 49% 275M 0s 2019-11-29T11:30:03.595 INFO:teuthology.orchestra.run.smithi182.stderr: 36550K .......... .......... .......... .......... .......... 49% 243M 0s 2019-11-29T11:30:03.595 INFO:teuthology.orchestra.run.smithi182.stderr: 36600K .......... .......... .......... .......... .......... 49% 282M 0s 2019-11-29T11:30:03.595 INFO:teuthology.orchestra.run.smithi182.stderr: 36650K .......... .......... .......... .......... .......... 49% 267M 0s 2019-11-29T11:30:03.595 INFO:teuthology.orchestra.run.smithi182.stderr: 36700K .......... .......... .......... .......... .......... 49% 268M 0s 2019-11-29T11:30:03.596 INFO:teuthology.orchestra.run.smithi182.stderr: 36750K .......... .......... .......... .......... .......... 50% 222M 0s 2019-11-29T11:30:03.596 INFO:teuthology.orchestra.run.smithi182.stderr: 36800K .......... .......... .......... .......... .......... 50% 276M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 36850K .......... .......... .......... .......... .......... 50% 274M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 36900K .......... .......... .......... .......... .......... 50% 278M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 36950K .......... .......... .......... .......... .......... 50% 249M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 37000K .......... .......... .......... .......... .......... 50% 275M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 37050K .......... .......... .......... .......... .......... 50% 277M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 37100K .......... .......... .......... .......... .......... 50% 269M 0s 2019-11-29T11:30:03.597 INFO:teuthology.orchestra.run.smithi182.stderr: 37150K .......... .......... .......... .......... .......... 50% 228M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37200K .......... .......... .......... .......... .......... 50% 270M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37250K .......... .......... .......... .......... .......... 50% 279M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37300K .......... .......... .......... .......... .......... 50% 299M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37350K .......... .......... .......... .......... .......... 50% 265M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37400K .......... .......... .......... .......... .......... 50% 276M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37450K .......... .......... .......... .......... .......... 50% 292M 0s 2019-11-29T11:30:03.598 INFO:teuthology.orchestra.run.smithi182.stderr: 37500K .......... .......... .......... .......... .......... 51% 274M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37550K .......... .......... .......... .......... .......... 51% 236M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37600K .......... .......... .......... .......... .......... 51% 281M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37650K .......... .......... .......... .......... .......... 51% 284M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37700K .......... .......... .......... .......... .......... 51% 282M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37750K .......... .......... .......... .......... .......... 51% 249M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37800K .......... .......... .......... .......... .......... 51% 274M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37850K .......... .......... .......... .......... .......... 51% 284M 0s 2019-11-29T11:30:03.599 INFO:teuthology.orchestra.run.smithi182.stderr: 37900K .......... .......... .......... .......... .......... 51% 287M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 37950K .......... .......... .......... .......... .......... 51% 235M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38000K .......... .......... .......... .......... .......... 51% 266M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38050K .......... .......... .......... .......... .......... 51% 268M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38100K .......... .......... .......... .......... .......... 51% 273M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38150K .......... .......... .......... .......... .......... 51% 248M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38200K .......... .......... .......... .......... .......... 51% 279M 0s 2019-11-29T11:30:03.600 INFO:teuthology.orchestra.run.smithi182.stderr: 38250K .......... .......... .......... .......... .......... 52% 293M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38300K .......... .......... .......... .......... .......... 52% 289M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38350K .......... .......... .......... .......... .......... 52% 233M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38400K .......... .......... .......... .......... .......... 52% 281M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38450K .......... .......... .......... .......... .......... 52% 268M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38500K .......... .......... .......... .......... .......... 52% 291M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38550K .......... .......... .......... .......... .......... 52% 270M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38600K .......... .......... .......... .......... .......... 52% 298M 0s 2019-11-29T11:30:03.601 INFO:teuthology.orchestra.run.smithi182.stderr: 38650K .......... .......... .......... .......... .......... 52% 289M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38700K .......... .......... .......... .......... .......... 52% 298M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38750K .......... .......... .......... .......... .......... 52% 223M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38800K .......... .......... .......... .......... .......... 52% 279M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38850K .......... .......... .......... .......... .......... 52% 280M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38900K .......... .......... .......... .......... .......... 52% 268M 0s 2019-11-29T11:30:03.602 INFO:teuthology.orchestra.run.smithi182.stderr: 38950K .......... .......... .......... .......... .......... 53% 256M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39000K .......... .......... .......... .......... .......... 53% 264M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39050K .......... .......... .......... .......... .......... 53% 292M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39100K .......... .......... .......... .......... .......... 53% 279M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39150K .......... .......... .......... .......... .......... 53% 223M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39200K .......... .......... .......... .......... .......... 53% 293M 0s 2019-11-29T11:30:03.603 INFO:teuthology.orchestra.run.smithi182.stderr: 39250K .......... .......... .......... .......... .......... 53% 277M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39300K .......... .......... .......... .......... .......... 53% 286M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39350K .......... .......... .......... .......... .......... 53% 248M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39400K .......... .......... .......... .......... .......... 53% 284M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39450K .......... .......... .......... .......... .......... 53% 281M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39500K .......... .......... .......... .......... .......... 53% 289M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39550K .......... .......... .......... .......... .......... 53% 216M 0s 2019-11-29T11:30:03.604 INFO:teuthology.orchestra.run.smithi182.stderr: 39600K .......... .......... .......... .......... .......... 53% 281M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39650K .......... .......... .......... .......... .......... 53% 290M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39700K .......... .......... .......... .......... .......... 54% 274M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39750K .......... .......... .......... .......... .......... 54% 251M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39800K .......... .......... .......... .......... .......... 54% 289M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39850K .......... .......... .......... .......... .......... 54% 299M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39900K .......... .......... .......... .......... .......... 54% 269M 0s 2019-11-29T11:30:03.605 INFO:teuthology.orchestra.run.smithi182.stderr: 39950K .......... .......... .......... .......... .......... 54% 243M 0s 2019-11-29T11:30:03.606 INFO:teuthology.orchestra.run.smithi182.stderr: 40000K .......... .......... .......... .......... .......... 54% 285M 0s 2019-11-29T11:30:03.606 INFO:teuthology.orchestra.run.smithi182.stderr: 40050K .......... .......... .......... .......... .......... 54% 287M 0s 2019-11-29T11:30:03.606 INFO:teuthology.orchestra.run.smithi182.stderr: 40100K .......... .......... .......... .......... .......... 54% 292M 0s 2019-11-29T11:30:03.606 INFO:teuthology.orchestra.run.smithi182.stderr: 40150K .......... .......... .......... .......... .......... 54% 269M 0s 2019-11-29T11:30:03.606 INFO:teuthology.orchestra.run.smithi182.stderr: 40200K .......... .......... .......... .......... .......... 54% 290M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40250K .......... .......... .......... .......... .......... 54% 302M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40300K .......... .......... .......... .......... .......... 54% 288M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40350K .......... .......... .......... .......... .......... 54% 236M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40400K .......... .......... .......... .......... .......... 54% 276M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40450K .......... .......... .......... .......... .......... 55% 279M 0s 2019-11-29T11:30:03.607 INFO:teuthology.orchestra.run.smithi182.stderr: 40500K .......... .......... .......... .......... .......... 55% 296M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40550K .......... .......... .......... .......... .......... 55% 262M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40600K .......... .......... .......... .......... .......... 55% 280M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40650K .......... .......... .......... .......... .......... 55% 302M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40700K .......... .......... .......... .......... .......... 55% 286M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40750K .......... .......... .......... .......... .......... 55% 226M 0s 2019-11-29T11:30:03.608 INFO:teuthology.orchestra.run.smithi182.stderr: 40800K .......... .......... .......... .......... .......... 55% 280M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 40850K .......... .......... .......... .......... .......... 55% 278M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 40900K .......... .......... .......... .......... .......... 55% 274M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 40950K .......... .......... .......... .......... .......... 55% 247M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 41000K .......... .......... .......... .......... .......... 55% 281M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 41050K .......... .......... .......... .......... .......... 55% 303M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 41100K .......... .......... .......... .......... .......... 55% 285M 0s 2019-11-29T11:30:03.609 INFO:teuthology.orchestra.run.smithi182.stderr: 41150K .......... .......... .......... .......... .......... 56% 247M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41200K .......... .......... .......... .......... .......... 56% 280M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41250K .......... .......... .......... .......... .......... 56% 284M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41300K .......... .......... .......... .......... .......... 56% 278M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41350K .......... .......... .......... .......... .......... 56% 279M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41400K .......... .......... .......... .......... .......... 56% 287M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41450K .......... .......... .......... .......... .......... 56% 290M 0s 2019-11-29T11:30:03.610 INFO:teuthology.orchestra.run.smithi182.stderr: 41500K .......... .......... .......... .......... .......... 56% 310M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41550K .......... .......... .......... .......... .......... 56% 246M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41600K .......... .......... .......... .......... .......... 56% 292M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41650K .......... .......... .......... .......... .......... 56% 293M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41700K .......... .......... .......... .......... .......... 56% 279M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41750K .......... .......... .......... .......... .......... 56% 263M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41800K .......... .......... .......... .......... .......... 56% 297M 0s 2019-11-29T11:30:03.611 INFO:teuthology.orchestra.run.smithi182.stderr: 41850K .......... .......... .......... .......... .......... 56% 315M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 41900K .......... .......... .......... .......... .......... 57% 296M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 41950K .......... .......... .......... .......... .......... 57% 251M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42000K .......... .......... .......... .......... .......... 57% 288M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42050K .......... .......... .......... .......... .......... 57% 303M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42100K .......... .......... .......... .......... .......... 57% 302M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42150K .......... .......... .......... .......... .......... 57% 282M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42200K .......... .......... .......... .......... .......... 57% 300M 0s 2019-11-29T11:30:03.612 INFO:teuthology.orchestra.run.smithi182.stderr: 42250K .......... .......... .......... .......... .......... 57% 311M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42300K .......... .......... .......... .......... .......... 57% 292M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42350K .......... .......... .......... .......... .......... 57% 244M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42400K .......... .......... .......... .......... .......... 57% 310M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42450K .......... .......... .......... .......... .......... 57% 296M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42500K .......... .......... .......... .......... .......... 57% 285M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42550K .......... .......... .......... .......... .......... 57% 263M 0s 2019-11-29T11:30:03.613 INFO:teuthology.orchestra.run.smithi182.stderr: 42600K .......... .......... .......... .......... .......... 57% 289M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42650K .......... .......... .......... .......... .......... 58% 296M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42700K .......... .......... .......... .......... .......... 58% 290M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42750K .......... .......... .......... .......... .......... 58% 230M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42800K .......... .......... .......... .......... .......... 58% 290M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42850K .......... .......... .......... .......... .......... 58% 290M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42900K .......... .......... .......... .......... .......... 58% 280M 0s 2019-11-29T11:30:03.614 INFO:teuthology.orchestra.run.smithi182.stderr: 42950K .......... .......... .......... .......... .......... 58% 241M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43000K .......... .......... .......... .......... .......... 58% 275M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43050K .......... .......... .......... .......... .......... 58% 295M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43100K .......... .......... .......... .......... .......... 58% 283M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43150K .......... .......... .......... .......... .......... 58% 236M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43200K .......... .......... .......... .......... .......... 58% 299M 0s 2019-11-29T11:30:03.615 INFO:teuthology.orchestra.run.smithi182.stderr: 43250K .......... .......... .......... .......... .......... 58% 298M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43300K .......... .......... .......... .......... .......... 58% 302M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43350K .......... .......... .......... .......... .......... 59% 267M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43400K .......... .......... .......... .......... .......... 59% 301M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43450K .......... .......... .......... .......... .......... 59% 298M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43500K .......... .......... .......... .......... .......... 59% 288M 0s 2019-11-29T11:30:03.616 INFO:teuthology.orchestra.run.smithi182.stderr: 43550K .......... .......... .......... .......... .......... 59% 249M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43600K .......... .......... .......... .......... .......... 59% 302M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43650K .......... .......... .......... .......... .......... 59% 302M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43700K .......... .......... .......... .......... .......... 59% 299M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43750K .......... .......... .......... .......... .......... 59% 258M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43800K .......... .......... .......... .......... .......... 59% 297M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43850K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43900K .......... .......... .......... .......... .......... 59% 309M 0s 2019-11-29T11:30:03.617 INFO:teuthology.orchestra.run.smithi182.stderr: 43950K .......... .......... .......... .......... .......... 59% 253M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44000K .......... .......... .......... .......... .......... 59% 305M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44050K .......... .......... .......... .......... .......... 59% 290M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44100K .......... .......... .......... .......... .......... 60% 292M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44150K .......... .......... .......... .......... .......... 60% 261M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44200K .......... .......... .......... .......... .......... 60% 309M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44250K .......... .......... .......... .......... .......... 60% 320M 0s 2019-11-29T11:30:03.618 INFO:teuthology.orchestra.run.smithi182.stderr: 44300K .......... .......... .......... .......... .......... 60% 323M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44350K .......... .......... .......... .......... .......... 60% 247M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44400K .......... .......... .......... .......... .......... 60% 293M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44450K .......... .......... .......... .......... .......... 60% 294M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44500K .......... .......... .......... .......... .......... 60% 295M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44550K .......... .......... .......... .......... .......... 60% 267M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44600K .......... .......... .......... .......... .......... 60% 298M 0s 2019-11-29T11:30:03.619 INFO:teuthology.orchestra.run.smithi182.stderr: 44650K .......... .......... .......... .......... .......... 60% 305M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44700K .......... .......... .......... .......... .......... 60% 304M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44750K .......... .......... .......... .......... .......... 60% 264M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44800K .......... .......... .......... .......... .......... 60% 311M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44850K .......... .......... .......... .......... .......... 61% 306M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44900K .......... .......... .......... .......... .......... 61% 314M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 44950K .......... .......... .......... .......... .......... 61% 279M 0s 2019-11-29T11:30:03.620 INFO:teuthology.orchestra.run.smithi182.stderr: 45000K .......... .......... .......... .......... .......... 61% 300M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45050K .......... .......... .......... .......... .......... 61% 318M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45100K .......... .......... .......... .......... .......... 61% 291M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45150K .......... .......... .......... .......... .......... 61% 243M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45200K .......... .......... .......... .......... .......... 61% 298M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45250K .......... .......... .......... .......... .......... 61% 286M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45300K .......... .......... .......... .......... .......... 61% 285M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45350K .......... .......... .......... .......... .......... 61% 274M 0s 2019-11-29T11:30:03.621 INFO:teuthology.orchestra.run.smithi182.stderr: 45400K .......... .......... .......... .......... .......... 61% 290M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45450K .......... .......... .......... .......... .......... 61% 298M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45500K .......... .......... .......... .......... .......... 61% 281M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45550K .......... .......... .......... .......... .......... 61% 247M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45600K .......... .......... .......... .......... .......... 62% 303M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45650K .......... .......... .......... .......... .......... 62% 317M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45700K .......... .......... .......... .......... .......... 62% 332M 0s 2019-11-29T11:30:03.622 INFO:teuthology.orchestra.run.smithi182.stderr: 45750K .......... .......... .......... .......... .......... 62% 288M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 45800K .......... .......... .......... .......... .......... 62% 329M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 45850K .......... .......... .......... .......... .......... 62% 315M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 45900K .......... .......... .......... .......... .......... 62% 322M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 45950K .......... .......... .......... .......... .......... 62% 267M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 46000K .......... .......... .......... .......... .......... 62% 330M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 46050K .......... .......... .......... .......... .......... 62% 319M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 46100K .......... .......... .......... .......... .......... 62% 304M 0s 2019-11-29T11:30:03.623 INFO:teuthology.orchestra.run.smithi182.stderr: 46150K .......... .......... .......... .......... .......... 62% 290M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46200K .......... .......... .......... .......... .......... 62% 331M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46250K .......... .......... .......... .......... .......... 62% 329M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46300K .......... .......... .......... .......... .......... 63% 324M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46350K .......... .......... .......... .......... .......... 63% 261M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46400K .......... .......... .......... .......... .......... 63% 318M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46450K .......... .......... .......... .......... .......... 63% 317M 0s 2019-11-29T11:30:03.624 INFO:teuthology.orchestra.run.smithi182.stderr: 46500K .......... .......... .......... .......... .......... 63% 335M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46550K .......... .......... .......... .......... .......... 63% 295M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46600K .......... .......... .......... .......... .......... 63% 292M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46650K .......... .......... .......... .......... .......... 63% 336M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46700K .......... .......... .......... .......... .......... 63% 329M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46750K .......... .......... .......... .......... .......... 63% 264M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46800K .......... .......... .......... .......... .......... 63% 327M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46850K .......... .......... .......... .......... .......... 63% 320M 0s 2019-11-29T11:30:03.625 INFO:teuthology.orchestra.run.smithi182.stderr: 46900K .......... .......... .......... .......... .......... 63% 326M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 46950K .......... .......... .......... .......... .......... 63% 292M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47000K .......... .......... .......... .......... .......... 63% 334M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47050K .......... .......... .......... .......... .......... 64% 314M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47100K .......... .......... .......... .......... .......... 64% 324M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47150K .......... .......... .......... .......... .......... 64% 264M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47200K .......... .......... .......... .......... .......... 64% 332M 0s 2019-11-29T11:30:03.626 INFO:teuthology.orchestra.run.smithi182.stderr: 47250K .......... .......... .......... .......... .......... 64% 332M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47300K .......... .......... .......... .......... .......... 64% 335M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47350K .......... .......... .......... .......... .......... 64% 301M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47400K .......... .......... .......... .......... .......... 64% 313M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47450K .......... .......... .......... .......... .......... 64% 323M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47500K .......... .......... .......... .......... .......... 64% 331M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47550K .......... .......... .......... .......... .......... 64% 263M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47600K .......... .......... .......... .......... .......... 64% 334M 0s 2019-11-29T11:30:03.627 INFO:teuthology.orchestra.run.smithi182.stderr: 47650K .......... .......... .......... .......... .......... 64% 325M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47700K .......... .......... .......... .......... .......... 64% 325M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47750K .......... .......... .......... .......... .......... 64% 283M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47800K .......... .......... .......... .......... .......... 65% 326M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47850K .......... .......... .......... .......... .......... 65% 344M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47900K .......... .......... .......... .......... .......... 65% 324M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 47950K .......... .......... .......... .......... .......... 65% 266M 0s 2019-11-29T11:30:03.628 INFO:teuthology.orchestra.run.smithi182.stderr: 48000K .......... .......... .......... .......... .......... 65% 332M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48050K .......... .......... .......... .......... .......... 65% 316M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48100K .......... .......... .......... .......... .......... 65% 326M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48150K .......... .......... .......... .......... .......... 65% 287M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48200K .......... .......... .......... .......... .......... 65% 322M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48250K .......... .......... .......... .......... .......... 65% 322M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48300K .......... .......... .......... .......... .......... 65% 315M 0s 2019-11-29T11:30:03.629 INFO:teuthology.orchestra.run.smithi182.stderr: 48350K .......... .......... .......... .......... .......... 65% 260M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48400K .......... .......... .......... .......... .......... 65% 326M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48450K .......... .......... .......... .......... .......... 65% 320M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48500K .......... .......... .......... .......... .......... 66% 326M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48550K .......... .......... .......... .......... .......... 66% 296M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48600K .......... .......... .......... .......... .......... 66% 325M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48650K .......... .......... .......... .......... .......... 66% 331M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48700K .......... .......... .......... .......... .......... 66% 320M 0s 2019-11-29T11:30:03.630 INFO:teuthology.orchestra.run.smithi182.stderr: 48750K .......... .......... .......... .......... .......... 66% 273M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 48800K .......... .......... .......... .......... .......... 66% 317M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 48850K .......... .......... .......... .......... .......... 66% 320M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 48900K .......... .......... .......... .......... .......... 66% 317M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 48950K .......... .......... .......... .......... .......... 66% 294M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 49000K .......... .......... .......... .......... .......... 66% 320M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 49050K .......... .......... .......... .......... .......... 66% 319M 0s 2019-11-29T11:30:03.631 INFO:teuthology.orchestra.run.smithi182.stderr: 49100K .......... .......... .......... .......... .......... 66% 326M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49150K .......... .......... .......... .......... .......... 66% 268M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49200K .......... .......... .......... .......... .......... 66% 318M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49250K .......... .......... .......... .......... .......... 67% 333M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49300K .......... .......... .......... .......... .......... 67% 329M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49350K .......... .......... .......... .......... .......... 67% 282M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49400K .......... .......... .......... .......... .......... 67% 323M 0s 2019-11-29T11:30:03.632 INFO:teuthology.orchestra.run.smithi182.stderr: 49450K .......... .......... .......... .......... .......... 67% 320M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49500K .......... .......... .......... .......... .......... 67% 317M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49550K .......... .......... .......... .......... .......... 67% 255M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49600K .......... .......... .......... .......... .......... 67% 326M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49650K .......... .......... .......... .......... .......... 67% 304M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49700K .......... .......... .......... .......... .......... 67% 321M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49750K .......... .......... .......... .......... .......... 67% 298M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49800K .......... .......... .......... .......... .......... 67% 326M 0s 2019-11-29T11:30:03.633 INFO:teuthology.orchestra.run.smithi182.stderr: 49850K .......... .......... .......... .......... .......... 67% 329M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 49900K .......... .......... .......... .......... .......... 67% 319M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 49950K .......... .......... .......... .......... .......... 67% 267M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 50000K .......... .......... .......... .......... .......... 68% 325M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 50050K .......... .......... .......... .......... .......... 68% 318M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 50100K .......... .......... .......... .......... .......... 68% 333M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 50150K .......... .......... .......... .......... .......... 68% 293M 0s 2019-11-29T11:30:03.634 INFO:teuthology.orchestra.run.smithi182.stderr: 50200K .......... .......... .......... .......... .......... 68% 340M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50250K .......... .......... .......... .......... .......... 68% 347M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50300K .......... .......... .......... .......... .......... 68% 306M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50350K .......... .......... .......... .......... .......... 68% 252M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50400K .......... .......... .......... .......... .......... 68% 311M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50450K .......... .......... .......... .......... .......... 68% 300M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50500K .......... .......... .......... .......... .......... 68% 314M 0s 2019-11-29T11:30:03.635 INFO:teuthology.orchestra.run.smithi182.stderr: 50550K .......... .......... .......... .......... .......... 68% 279M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50600K .......... .......... .......... .......... .......... 68% 309M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50650K .......... .......... .......... .......... .......... 68% 318M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50700K .......... .......... .......... .......... .......... 68% 318M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50750K .......... .......... .......... .......... .......... 69% 262M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50800K .......... .......... .......... .......... .......... 69% 297M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50850K .......... .......... .......... .......... .......... 69% 309M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50900K .......... .......... .......... .......... .......... 69% 319M 0s 2019-11-29T11:30:03.636 INFO:teuthology.orchestra.run.smithi182.stderr: 50950K .......... .......... .......... .......... .......... 69% 270M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51000K .......... .......... .......... .......... .......... 69% 334M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51050K .......... .......... .......... .......... .......... 69% 335M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51100K .......... .......... .......... .......... .......... 69% 318M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51150K .......... .......... .......... .......... .......... 69% 269M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51200K .......... .......... .......... .......... .......... 69% 315M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51250K .......... .......... .......... .......... .......... 69% 323M 0s 2019-11-29T11:30:03.637 INFO:teuthology.orchestra.run.smithi182.stderr: 51300K .......... .......... .......... .......... .......... 69% 323M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51350K .......... .......... .......... .......... .......... 69% 291M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51400K .......... .......... .......... .......... .......... 69% 317M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51450K .......... .......... .......... .......... .......... 70% 327M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51500K .......... .......... .......... .......... .......... 70% 316M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51550K .......... .......... .......... .......... .......... 70% 260M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51600K .......... .......... .......... .......... .......... 70% 328M 0s 2019-11-29T11:30:03.638 INFO:teuthology.orchestra.run.smithi182.stderr: 51650K .......... .......... .......... .......... .......... 70% 321M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51700K .......... .......... .......... .......... .......... 70% 319M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51750K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51800K .......... .......... .......... .......... .......... 70% 330M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51850K .......... .......... .......... .......... .......... 70% 306M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51900K .......... .......... .......... .......... .......... 70% 320M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 51950K .......... .......... .......... .......... .......... 70% 261M 0s 2019-11-29T11:30:03.639 INFO:teuthology.orchestra.run.smithi182.stderr: 52000K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52050K .......... .......... .......... .......... .......... 70% 304M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52100K .......... .......... .......... .......... .......... 70% 308M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52150K .......... .......... .......... .......... .......... 70% 295M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52200K .......... .......... .......... .......... .......... 71% 346M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52250K .......... .......... .......... .......... .......... 71% 352M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52300K .......... .......... .......... .......... .......... 71% 349M 0s 2019-11-29T11:30:03.640 INFO:teuthology.orchestra.run.smithi182.stderr: 52350K .......... .......... .......... .......... .......... 71% 289M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52400K .......... .......... .......... .......... .......... 71% 313M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52450K .......... .......... .......... .......... .......... 71% 325M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52500K .......... .......... .......... .......... .......... 71% 318M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52550K .......... .......... .......... .......... .......... 71% 303M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52600K .......... .......... .......... .......... .......... 71% 333M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52650K .......... .......... .......... .......... .......... 71% 328M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52700K .......... .......... .......... .......... .......... 71% 330M 0s 2019-11-29T11:30:03.641 INFO:teuthology.orchestra.run.smithi182.stderr: 52750K .......... .......... .......... .......... .......... 71% 272M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 52800K .......... .......... .......... .......... .......... 71% 323M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 52850K .......... .......... .......... .......... .......... 71% 331M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 52900K .......... .......... .......... .......... .......... 71% 325M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 52950K .......... .......... .......... .......... .......... 72% 295M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 53000K .......... .......... .......... .......... .......... 72% 329M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 53050K .......... .......... .......... .......... .......... 72% 336M 0s 2019-11-29T11:30:03.642 INFO:teuthology.orchestra.run.smithi182.stderr: 53100K .......... .......... .......... .......... .......... 72% 326M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53150K .......... .......... .......... .......... .......... 72% 260M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53200K .......... .......... .......... .......... .......... 72% 331M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53250K .......... .......... .......... .......... .......... 72% 330M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53300K .......... .......... .......... .......... .......... 72% 333M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53350K .......... .......... .......... .......... .......... 72% 299M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53400K .......... .......... .......... .......... .......... 72% 320M 0s 2019-11-29T11:30:03.643 INFO:teuthology.orchestra.run.smithi182.stderr: 53450K .......... .......... .......... .......... .......... 72% 316M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53500K .......... .......... .......... .......... .......... 72% 335M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53550K .......... .......... .......... .......... .......... 72% 274M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53600K .......... .......... .......... .......... .......... 72% 339M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53650K .......... .......... .......... .......... .......... 73% 323M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53700K .......... .......... .......... .......... .......... 73% 337M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53750K .......... .......... .......... .......... .......... 73% 289M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53800K .......... .......... .......... .......... .......... 73% 333M 0s 2019-11-29T11:30:03.644 INFO:teuthology.orchestra.run.smithi182.stderr: 53850K .......... .......... .......... .......... .......... 73% 336M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 53900K .......... .......... .......... .......... .......... 73% 332M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 53950K .......... .......... .......... .......... .......... 73% 279M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 54000K .......... .......... .......... .......... .......... 73% 331M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 54050K .......... .......... .......... .......... .......... 73% 330M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 54100K .......... .......... .......... .......... .......... 73% 320M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 54150K .......... .......... .......... .......... .......... 73% 283M 0s 2019-11-29T11:30:03.645 INFO:teuthology.orchestra.run.smithi182.stderr: 54200K .......... .......... .......... .......... .......... 73% 327M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54250K .......... .......... .......... .......... .......... 73% 307M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54300K .......... .......... .......... .......... .......... 73% 333M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54350K .......... .......... .......... .......... .......... 73% 274M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54400K .......... .......... .......... .......... .......... 74% 305M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54450K .......... .......... .......... .......... .......... 74% 306M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54500K .......... .......... .......... .......... .......... 74% 330M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54550K .......... .......... .......... .......... .......... 74% 302M 0s 2019-11-29T11:30:03.646 INFO:teuthology.orchestra.run.smithi182.stderr: 54600K .......... .......... .......... .......... .......... 74% 336M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54650K .......... .......... .......... .......... .......... 74% 343M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54700K .......... .......... .......... .......... .......... 74% 329M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54750K .......... .......... .......... .......... .......... 74% 269M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54800K .......... .......... .......... .......... .......... 74% 328M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54850K .......... .......... .......... .......... .......... 74% 321M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54900K .......... .......... .......... .......... .......... 74% 312M 0s 2019-11-29T11:30:03.647 INFO:teuthology.orchestra.run.smithi182.stderr: 54950K .......... .......... .......... .......... .......... 74% 291M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55000K .......... .......... .......... .......... .......... 74% 307M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55050K .......... .......... .......... .......... .......... 74% 323M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55100K .......... .......... .......... .......... .......... 74% 318M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55150K .......... .......... .......... .......... .......... 75% 266M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55200K .......... .......... .......... .......... .......... 75% 331M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55250K .......... .......... .......... .......... .......... 75% 320M 0s 2019-11-29T11:30:03.648 INFO:teuthology.orchestra.run.smithi182.stderr: 55300K .......... .......... .......... .......... .......... 75% 331M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55350K .......... .......... .......... .......... .......... 75% 280M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55400K .......... .......... .......... .......... .......... 75% 328M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55450K .......... .......... .......... .......... .......... 75% 314M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55500K .......... .......... .......... .......... .......... 75% 318M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55550K .......... .......... .......... .......... .......... 75% 270M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55600K .......... .......... .......... .......... .......... 75% 328M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55650K .......... .......... .......... .......... .......... 75% 322M 0s 2019-11-29T11:30:03.649 INFO:teuthology.orchestra.run.smithi182.stderr: 55700K .......... .......... .......... .......... .......... 75% 320M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 55750K .......... .......... .......... .......... .......... 75% 289M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 55800K .......... .......... .......... .......... .......... 75% 332M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 55850K .......... .......... .......... .......... .......... 75% 331M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 55900K .......... .......... .......... .......... .......... 76% 331M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 55950K .......... .......... .......... .......... .......... 76% 275M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 56000K .......... .......... .......... .......... .......... 76% 314M 0s 2019-11-29T11:30:03.650 INFO:teuthology.orchestra.run.smithi182.stderr: 56050K .......... .......... .......... .......... .......... 76% 327M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56100K .......... .......... .......... .......... .......... 76% 330M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56150K .......... .......... .......... .......... .......... 76% 293M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56200K .......... .......... .......... .......... .......... 76% 336M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56250K .......... .......... .......... .......... .......... 76% 334M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56300K .......... .......... .......... .......... .......... 76% 334M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56350K .......... .......... .......... .......... .......... 76% 271M 0s 2019-11-29T11:30:03.651 INFO:teuthology.orchestra.run.smithi182.stderr: 56400K .......... .......... .......... .......... .......... 76% 329M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56450K .......... .......... .......... .......... .......... 76% 327M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56500K .......... .......... .......... .......... .......... 76% 333M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56550K .......... .......... .......... .......... .......... 76% 298M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56600K .......... .......... .......... .......... .......... 77% 317M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56650K .......... .......... .......... .......... .......... 77% 319M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56700K .......... .......... .......... .......... .......... 77% 337M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56750K .......... .......... .......... .......... .......... 77% 270M 0s 2019-11-29T11:30:03.652 INFO:teuthology.orchestra.run.smithi182.stderr: 56800K .......... .......... .......... .......... .......... 77% 318M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 56850K .......... .......... .......... .......... .......... 77% 314M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 56900K .......... .......... .......... .......... .......... 77% 330M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 56950K .......... .......... .......... .......... .......... 77% 288M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 57000K .......... .......... .......... .......... .......... 77% 331M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 57050K .......... .......... .......... .......... .......... 77% 340M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 57100K .......... .......... .......... .......... .......... 77% 335M 0s 2019-11-29T11:30:03.653 INFO:teuthology.orchestra.run.smithi182.stderr: 57150K .......... .......... .......... .......... .......... 77% 275M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57200K .......... .......... .......... .......... .......... 77% 333M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57250K .......... .......... .......... .......... .......... 77% 328M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57300K .......... .......... .......... .......... .......... 77% 329M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57350K .......... .......... .......... .......... .......... 78% 292M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57400K .......... .......... .......... .......... .......... 78% 315M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57450K .......... .......... .......... .......... .......... 78% 317M 0s 2019-11-29T11:30:03.654 INFO:teuthology.orchestra.run.smithi182.stderr: 57500K .......... .......... .......... .......... .......... 78% 309M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57550K .......... .......... .......... .......... .......... 78% 269M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57600K .......... .......... .......... .......... .......... 78% 313M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57650K .......... .......... .......... .......... .......... 78% 325M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57700K .......... .......... .......... .......... .......... 78% 315M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57750K .......... .......... .......... .......... .......... 78% 281M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57800K .......... .......... .......... .......... .......... 78% 324M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57850K .......... .......... .......... .......... .......... 78% 319M 0s 2019-11-29T11:30:03.655 INFO:teuthology.orchestra.run.smithi182.stderr: 57900K .......... .......... .......... .......... .......... 78% 330M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 57950K .......... .......... .......... .......... .......... 78% 263M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58000K .......... .......... .......... .......... .......... 78% 327M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58050K .......... .......... .......... .......... .......... 78% 324M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58100K .......... .......... .......... .......... .......... 79% 319M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58150K .......... .......... .......... .......... .......... 79% 291M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58200K .......... .......... .......... .......... .......... 79% 328M 0s 2019-11-29T11:30:03.656 INFO:teuthology.orchestra.run.smithi182.stderr: 58250K .......... .......... .......... .......... .......... 79% 311M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58300K .......... .......... .......... .......... .......... 79% 329M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58350K .......... .......... .......... .......... .......... 79% 273M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58400K .......... .......... .......... .......... .......... 79% 321M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58450K .......... .......... .......... .......... .......... 79% 318M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58500K .......... .......... .......... .......... .......... 79% 331M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58550K .......... .......... .......... .......... .......... 79% 288M 0s 2019-11-29T11:30:03.657 INFO:teuthology.orchestra.run.smithi182.stderr: 58600K .......... .......... .......... .......... .......... 79% 331M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58650K .......... .......... .......... .......... .......... 79% 311M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58700K .......... .......... .......... .......... .......... 79% 337M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58750K .......... .......... .......... .......... .......... 79% 272M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58800K .......... .......... .......... .......... .......... 80% 298M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58850K .......... .......... .......... .......... .......... 80% 302M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58900K .......... .......... .......... .......... .......... 80% 296M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 58950K .......... .......... .......... .......... .......... 80% 282M 0s 2019-11-29T11:30:03.658 INFO:teuthology.orchestra.run.smithi182.stderr: 59000K .......... .......... .......... .......... .......... 80% 298M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59050K .......... .......... .......... .......... .......... 80% 291M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59100K .......... .......... .......... .......... .......... 80% 309M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59150K .......... .......... .......... .......... .......... 80% 223M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59200K .......... .......... .......... .......... .......... 80% 285M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59250K .......... .......... .......... .......... .......... 80% 296M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59300K .......... .......... .......... .......... .......... 80% 304M 0s 2019-11-29T11:30:03.659 INFO:teuthology.orchestra.run.smithi182.stderr: 59350K .......... .......... .......... .......... .......... 80% 271M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59400K .......... .......... .......... .......... .......... 80% 302M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59450K .......... .......... .......... .......... .......... 80% 313M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59500K .......... .......... .......... .......... .......... 80% 307M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59550K .......... .......... .......... .......... .......... 81% 264M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59600K .......... .......... .......... .......... .......... 81% 300M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59650K .......... .......... .......... .......... .......... 81% 283M 0s 2019-11-29T11:30:03.660 INFO:teuthology.orchestra.run.smithi182.stderr: 59700K .......... .......... .......... .......... .......... 81% 292M 0s 2019-11-29T11:30:03.661 INFO:teuthology.orchestra.run.smithi182.stderr: 59750K .......... .......... .......... .......... .......... 81% 263M 0s 2019-11-29T11:30:03.661 INFO:teuthology.orchestra.run.smithi182.stderr: 59800K .......... .......... .......... .......... .......... 81% 305M 0s 2019-11-29T11:30:03.661 INFO:teuthology.orchestra.run.smithi182.stderr: 59850K .......... .......... .......... .......... .......... 81% 319M 0s 2019-11-29T11:30:03.661 INFO:teuthology.orchestra.run.smithi182.stderr: 59900K .......... .......... .......... .......... .......... 81% 301M 0s 2019-11-29T11:30:03.661 INFO:teuthology.orchestra.run.smithi182.stderr: 59950K .......... .......... .......... .......... .......... 81% 261M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60000K .......... .......... .......... .......... .......... 81% 302M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60050K .......... .......... .......... .......... .......... 81% 289M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60100K .......... .......... .......... .......... .......... 81% 298M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60150K .......... .......... .......... .......... .......... 81% 263M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60200K .......... .......... .......... .......... .......... 81% 292M 0s 2019-11-29T11:30:03.662 INFO:teuthology.orchestra.run.smithi182.stderr: 60250K .......... .......... .......... .......... .......... 81% 293M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60300K .......... .......... .......... .......... .......... 82% 218M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60350K .......... .......... .......... .......... .......... 82% 253M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60400K .......... .......... .......... .......... .......... 82% 299M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60450K .......... .......... .......... .......... .......... 82% 305M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60500K .......... .......... .......... .......... .......... 82% 309M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60550K .......... .......... .......... .......... .......... 82% 281M 0s 2019-11-29T11:30:03.663 INFO:teuthology.orchestra.run.smithi182.stderr: 60600K .......... .......... .......... .......... .......... 82% 299M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60650K .......... .......... .......... .......... .......... 82% 300M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60700K .......... .......... .......... .......... .......... 82% 311M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60750K .......... .......... .......... .......... .......... 82% 263M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60800K .......... .......... .......... .......... .......... 82% 314M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60850K .......... .......... .......... .......... .......... 82% 305M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60900K .......... .......... .......... .......... .......... 82% 297M 0s 2019-11-29T11:30:03.664 INFO:teuthology.orchestra.run.smithi182.stderr: 60950K .......... .......... .......... .......... .......... 82% 262M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61000K .......... .......... .......... .......... .......... 82% 295M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61050K .......... .......... .......... .......... .......... 83% 299M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61100K .......... .......... .......... .......... .......... 83% 298M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61150K .......... .......... .......... .......... .......... 83% 247M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61200K .......... .......... .......... .......... .......... 83% 295M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61250K .......... .......... .......... .......... .......... 83% 301M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61300K .......... .......... .......... .......... .......... 83% 307M 0s 2019-11-29T11:30:03.665 INFO:teuthology.orchestra.run.smithi182.stderr: 61350K .......... .......... .......... .......... .......... 83% 280M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61400K .......... .......... .......... .......... .......... 83% 312M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61450K .......... .......... .......... .......... .......... 83% 325M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61500K .......... .......... .......... .......... .......... 83% 311M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61550K .......... .......... .......... .......... .......... 83% 244M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61600K .......... .......... .......... .......... .......... 83% 307M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61650K .......... .......... .......... .......... .......... 83% 310M 0s 2019-11-29T11:30:03.666 INFO:teuthology.orchestra.run.smithi182.stderr: 61700K .......... .......... .......... .......... .......... 83% 319M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 61750K .......... .......... .......... .......... .......... 84% 287M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 61800K .......... .......... .......... .......... .......... 84% 316M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 61850K .......... .......... .......... .......... .......... 84% 303M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 61900K .......... .......... .......... .......... .......... 84% 300M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 61950K .......... .......... .......... .......... .......... 84% 245M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 62000K .......... .......... .......... .......... .......... 84% 281M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 62050K .......... .......... .......... .......... .......... 84% 263M 0s 2019-11-29T11:30:03.667 INFO:teuthology.orchestra.run.smithi182.stderr: 62100K .......... .......... .......... .......... .......... 84% 290M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62150K .......... .......... .......... .......... .......... 84% 257M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62200K .......... .......... .......... .......... .......... 84% 297M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62250K .......... .......... .......... .......... .......... 84% 300M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62300K .......... .......... .......... .......... .......... 84% 302M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62350K .......... .......... .......... .......... .......... 84% 249M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62400K .......... .......... .......... .......... .......... 84% 287M 0s 2019-11-29T11:30:03.668 INFO:teuthology.orchestra.run.smithi182.stderr: 62450K .......... .......... .......... .......... .......... 84% 297M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62500K .......... .......... .......... .......... .......... 85% 303M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62550K .......... .......... .......... .......... .......... 85% 270M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62600K .......... .......... .......... .......... .......... 85% 301M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62650K .......... .......... .......... .......... .......... 85% 304M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62700K .......... .......... .......... .......... .......... 85% 301M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62750K .......... .......... .......... .......... .......... 85% 249M 0s 2019-11-29T11:30:03.669 INFO:teuthology.orchestra.run.smithi182.stderr: 62800K .......... .......... .......... .......... .......... 85% 304M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 62850K .......... .......... .......... .......... .......... 85% 307M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 62900K .......... .......... .......... .......... .......... 85% 311M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 62950K .......... .......... .......... .......... .......... 85% 272M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 63000K .......... .......... .......... .......... .......... 85% 293M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 63050K .......... .......... .......... .......... .......... 85% 314M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 63100K .......... .......... .......... .......... .......... 85% 312M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 63150K .......... .......... .......... .......... .......... 85% 252M 0s 2019-11-29T11:30:03.670 INFO:teuthology.orchestra.run.smithi182.stderr: 63200K .......... .......... .......... .......... .......... 85% 301M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63250K .......... .......... .......... .......... .......... 86% 289M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63300K .......... .......... .......... .......... .......... 86% 297M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63350K .......... .......... .......... .......... .......... 86% 264M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63400K .......... .......... .......... .......... .......... 86% 301M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63450K .......... .......... .......... .......... .......... 86% 323M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63500K .......... .......... .......... .......... .......... 86% 308M 0s 2019-11-29T11:30:03.671 INFO:teuthology.orchestra.run.smithi182.stderr: 63550K .......... .......... .......... .......... .......... 86% 268M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63600K .......... .......... .......... .......... .......... 86% 295M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63650K .......... .......... .......... .......... .......... 86% 303M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63700K .......... .......... .......... .......... .......... 86% 301M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63750K .......... .......... .......... .......... .......... 86% 273M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63800K .......... .......... .......... .......... .......... 86% 286M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63850K .......... .......... .......... .......... .......... 86% 307M 0s 2019-11-29T11:30:03.672 INFO:teuthology.orchestra.run.smithi182.stderr: 63900K .......... .......... .......... .......... .......... 86% 280M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 63950K .......... .......... .......... .......... .......... 87% 256M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64000K .......... .......... .......... .......... .......... 87% 298M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64050K .......... .......... .......... .......... .......... 87% 287M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64100K .......... .......... .......... .......... .......... 87% 293M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64150K .......... .......... .......... .......... .......... 87% 263M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64200K .......... .......... .......... .......... .......... 87% 287M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64250K .......... .......... .......... .......... .......... 87% 310M 0s 2019-11-29T11:30:03.673 INFO:teuthology.orchestra.run.smithi182.stderr: 64300K .......... .......... .......... .......... .......... 87% 290M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64350K .......... .......... .......... .......... .......... 87% 238M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64400K .......... .......... .......... .......... .......... 87% 298M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64450K .......... .......... .......... .......... .......... 87% 301M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64500K .......... .......... .......... .......... .......... 87% 291M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64550K .......... .......... .......... .......... .......... 87% 282M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64600K .......... .......... .......... .......... .......... 87% 309M 0s 2019-11-29T11:30:03.674 INFO:teuthology.orchestra.run.smithi182.stderr: 64650K .......... .......... .......... .......... .......... 87% 301M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64700K .......... .......... .......... .......... .......... 88% 297M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64750K .......... .......... .......... .......... .......... 88% 239M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64800K .......... .......... .......... .......... .......... 88% 302M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64850K .......... .......... .......... .......... .......... 88% 291M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64900K .......... .......... .......... .......... .......... 88% 299M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 64950K .......... .......... .......... .......... .......... 88% 273M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 65000K .......... .......... .......... .......... .......... 88% 297M 0s 2019-11-29T11:30:03.675 INFO:teuthology.orchestra.run.smithi182.stderr: 65050K .......... .......... .......... .......... .......... 88% 314M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65100K .......... .......... .......... .......... .......... 88% 312M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65150K .......... .......... .......... .......... .......... 88% 254M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65200K .......... .......... .......... .......... .......... 88% 289M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65250K .......... .......... .......... .......... .......... 88% 287M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65300K .......... .......... .......... .......... .......... 88% 275M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65350K .......... .......... .......... .......... .......... 88% 265M 0s 2019-11-29T11:30:03.676 INFO:teuthology.orchestra.run.smithi182.stderr: 65400K .......... .......... .......... .......... .......... 88% 298M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65450K .......... .......... .......... .......... .......... 89% 275M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65500K .......... .......... .......... .......... .......... 89% 315M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65550K .......... .......... .......... .......... .......... 89% 243M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65600K .......... .......... .......... .......... .......... 89% 298M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65650K .......... .......... .......... .......... .......... 89% 285M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65700K .......... .......... .......... .......... .......... 89% 307M 0s 2019-11-29T11:30:03.677 INFO:teuthology.orchestra.run.smithi182.stderr: 65750K .......... .......... .......... .......... .......... 89% 273M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 65800K .......... .......... .......... .......... .......... 89% 293M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 65850K .......... .......... .......... .......... .......... 89% 301M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 65900K .......... .......... .......... .......... .......... 89% 300M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 65950K .......... .......... .......... .......... .......... 89% 246M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 66000K .......... .......... .......... .......... .......... 89% 306M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 66050K .......... .......... .......... .......... .......... 89% 299M 0s 2019-11-29T11:30:03.678 INFO:teuthology.orchestra.run.smithi182.stderr: 66100K .......... .......... .......... .......... .......... 89% 304M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66150K .......... .......... .......... .......... .......... 89% 285M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66200K .......... .......... .......... .......... .......... 90% 313M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66250K .......... .......... .......... .......... .......... 90% 307M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66300K .......... .......... .......... .......... .......... 90% 307M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66350K .......... .......... .......... .......... .......... 90% 241M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66400K .......... .......... .......... .......... .......... 90% 303M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66450K .......... .......... .......... .......... .......... 90% 296M 0s 2019-11-29T11:30:03.679 INFO:teuthology.orchestra.run.smithi182.stderr: 66500K .......... .......... .......... .......... .......... 90% 295M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66550K .......... .......... .......... .......... .......... 90% 267M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66600K .......... .......... .......... .......... .......... 90% 300M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66650K .......... .......... .......... .......... .......... 90% 319M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66700K .......... .......... .......... .......... .......... 90% 303M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66750K .......... .......... .......... .......... .......... 90% 261M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66800K .......... .......... .......... .......... .......... 90% 306M 0s 2019-11-29T11:30:03.680 INFO:teuthology.orchestra.run.smithi182.stderr: 66850K .......... .......... .......... .......... .......... 90% 290M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 66900K .......... .......... .......... .......... .......... 91% 304M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 66950K .......... .......... .......... .......... .......... 91% 274M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 67000K .......... .......... .......... .......... .......... 91% 307M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 67050K .......... .......... .......... .......... .......... 91% 321M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 67100K .......... .......... .......... .......... .......... 91% 316M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 67150K .......... .......... .......... .......... .......... 91% 259M 0s 2019-11-29T11:30:03.681 INFO:teuthology.orchestra.run.smithi182.stderr: 67200K .......... .......... .......... .......... .......... 91% 310M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67250K .......... .......... .......... .......... .......... 91% 313M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67300K .......... .......... .......... .......... .......... 91% 318M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67350K .......... .......... .......... .......... .......... 91% 286M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67400K .......... .......... .......... .......... .......... 91% 316M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67450K .......... .......... .......... .......... .......... 91% 309M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67500K .......... .......... .......... .......... .......... 91% 292M 0s 2019-11-29T11:30:03.682 INFO:teuthology.orchestra.run.smithi182.stderr: 67550K .......... .......... .......... .......... .......... 91% 245M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67600K .......... .......... .......... .......... .......... 91% 293M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67650K .......... .......... .......... .......... .......... 92% 278M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67700K .......... .......... .......... .......... .......... 92% 298M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67750K .......... .......... .......... .......... .......... 92% 256M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67800K .......... .......... .......... .......... .......... 92% 296M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67850K .......... .......... .......... .......... .......... 92% 307M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67900K .......... .......... .......... .......... .......... 92% 285M 0s 2019-11-29T11:30:03.683 INFO:teuthology.orchestra.run.smithi182.stderr: 67950K .......... .......... .......... .......... .......... 92% 235M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68000K .......... .......... .......... .......... .......... 92% 292M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68050K .......... .......... .......... .......... .......... 92% 289M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68100K .......... .......... .......... .......... .......... 92% 311M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68150K .......... .......... .......... .......... .......... 92% 286M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68200K .......... .......... .......... .......... .......... 92% 311M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68250K .......... .......... .......... .......... .......... 92% 318M 0s 2019-11-29T11:30:03.684 INFO:teuthology.orchestra.run.smithi182.stderr: 68300K .......... .......... .......... .......... .......... 92% 300M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68350K .......... .......... .......... .......... .......... 92% 248M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68400K .......... .......... .......... .......... .......... 93% 317M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68450K .......... .......... .......... .......... .......... 93% 307M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68500K .......... .......... .......... .......... .......... 93% 322M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68550K .......... .......... .......... .......... .......... 93% 274M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68600K .......... .......... .......... .......... .......... 93% 310M 0s 2019-11-29T11:30:03.685 INFO:teuthology.orchestra.run.smithi182.stderr: 68650K .......... .......... .......... .......... .......... 93% 297M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68700K .......... .......... .......... .......... .......... 93% 295M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68750K .......... .......... .......... .......... .......... 93% 250M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68800K .......... .......... .......... .......... .......... 93% 296M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68850K .......... .......... .......... .......... .......... 93% 297M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68900K .......... .......... .......... .......... .......... 93% 314M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 68950K .......... .......... .......... .......... .......... 93% 277M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 69000K .......... .......... .......... .......... .......... 93% 309M 0s 2019-11-29T11:30:03.686 INFO:teuthology.orchestra.run.smithi182.stderr: 69050K .......... .......... .......... .......... .......... 93% 301M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69100K .......... .......... .......... .......... .......... 94% 307M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69150K .......... .......... .......... .......... .......... 94% 250M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69200K .......... .......... .......... .......... .......... 94% 296M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69250K .......... .......... .......... .......... .......... 94% 296M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69300K .......... .......... .......... .......... .......... 94% 312M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69350K .......... .......... .......... .......... .......... 94% 291M 0s 2019-11-29T11:30:03.687 INFO:teuthology.orchestra.run.smithi182.stderr: 69400K .......... .......... .......... .......... .......... 94% 332M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69450K .......... .......... .......... .......... .......... 94% 329M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69500K .......... .......... .......... .......... .......... 94% 333M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69550K .......... .......... .......... .......... .......... 94% 264M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69600K .......... .......... .......... .......... .......... 94% 325M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69650K .......... .......... .......... .......... .......... 94% 328M 0s 2019-11-29T11:30:03.688 INFO:teuthology.orchestra.run.smithi182.stderr: 69700K .......... .......... .......... .......... .......... 94% 334M 0s 2019-11-29T11:30:03.689 INFO:teuthology.orchestra.run.smithi182.stderr: 69750K .......... .......... .......... .......... .......... 94% 297M 0s 2019-11-29T11:30:03.689 INFO:teuthology.orchestra.run.smithi182.stderr: 69800K .......... .......... .......... .......... .......... 94% 316M 0s 2019-11-29T11:30:03.689 INFO:teuthology.orchestra.run.smithi182.stderr: 69850K .......... .......... .......... .......... .......... 95% 322M 0s 2019-11-29T11:30:03.689 INFO:teuthology.orchestra.run.smithi182.stderr: 69900K .......... .......... .......... .......... .......... 95% 317M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 69950K .......... .......... .......... .......... .......... 95% 266M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70000K .......... .......... .......... .......... .......... 95% 309M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70050K .......... .......... .......... .......... .......... 95% 291M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70100K .......... .......... .......... .......... .......... 95% 325M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70150K .......... .......... .......... .......... .......... 95% 282M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70200K .......... .......... .......... .......... .......... 95% 290M 0s 2019-11-29T11:30:03.690 INFO:teuthology.orchestra.run.smithi182.stderr: 70250K .......... .......... .......... .......... .......... 95% 328M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70300K .......... .......... .......... .......... .......... 95% 323M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70350K .......... .......... .......... .......... .......... 95% 257M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70400K .......... .......... .......... .......... .......... 95% 330M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70450K .......... .......... .......... .......... .......... 95% 320M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70500K .......... .......... .......... .......... .......... 95% 319M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70550K .......... .......... .......... .......... .......... 95% 298M 0s 2019-11-29T11:30:03.691 INFO:teuthology.orchestra.run.smithi182.stderr: 70600K .......... .......... .......... .......... .......... 96% 317M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70650K .......... .......... .......... .......... .......... 96% 331M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70700K .......... .......... .......... .......... .......... 96% 317M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70750K .......... .......... .......... .......... .......... 96% 256M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70800K .......... .......... .......... .......... .......... 96% 312M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70850K .......... .......... .......... .......... .......... 96% 325M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70900K .......... .......... .......... .......... .......... 96% 321M 0s 2019-11-29T11:30:03.692 INFO:teuthology.orchestra.run.smithi182.stderr: 70950K .......... .......... .......... .......... .......... 96% 290M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71000K .......... .......... .......... .......... .......... 96% 319M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71050K .......... .......... .......... .......... .......... 96% 311M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71100K .......... .......... .......... .......... .......... 96% 313M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71150K .......... .......... .......... .......... .......... 96% 261M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71200K .......... .......... .......... .......... .......... 96% 330M 0s 2019-11-29T11:30:03.693 INFO:teuthology.orchestra.run.smithi182.stderr: 71250K .......... .......... .......... .......... .......... 96% 317M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71300K .......... .......... .......... .......... .......... 96% 330M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71350K .......... .......... .......... .......... .......... 97% 292M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71400K .......... .......... .......... .......... .......... 97% 333M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71450K .......... .......... .......... .......... .......... 97% 331M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71500K .......... .......... .......... .......... .......... 97% 325M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71550K .......... .......... .......... .......... .......... 97% 264M 0s 2019-11-29T11:30:03.694 INFO:teuthology.orchestra.run.smithi182.stderr: 71600K .......... .......... .......... .......... .......... 97% 319M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71650K .......... .......... .......... .......... .......... 97% 324M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71700K .......... .......... .......... .......... .......... 97% 334M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71750K .......... .......... .......... .......... .......... 97% 287M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71800K .......... .......... .......... .......... .......... 97% 314M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71850K .......... .......... .......... .......... .......... 97% 322M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71900K .......... .......... .......... .......... .......... 97% 301M 0s 2019-11-29T11:30:03.695 INFO:teuthology.orchestra.run.smithi182.stderr: 71950K .......... .......... .......... .......... .......... 97% 256M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72000K .......... .......... .......... .......... .......... 97% 316M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72050K .......... .......... .......... .......... .......... 98% 281M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72100K .......... .......... .......... .......... .......... 98% 328M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72150K .......... .......... .......... .......... .......... 98% 267M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72200K .......... .......... .......... .......... .......... 98% 322M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72250K .......... .......... .......... .......... .......... 98% 339M 0s 2019-11-29T11:30:03.696 INFO:teuthology.orchestra.run.smithi182.stderr: 72300K .......... .......... .......... .......... .......... 98% 311M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72350K .......... .......... .......... .......... .......... 98% 252M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72400K .......... .......... .......... .......... .......... 98% 310M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72450K .......... .......... .......... .......... .......... 98% 289M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72500K .......... .......... .......... .......... .......... 98% 314M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72550K .......... .......... .......... .......... .......... 98% 282M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72600K .......... .......... .......... .......... .......... 98% 324M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72650K .......... .......... .......... .......... .......... 98% 332M 0s 2019-11-29T11:30:03.697 INFO:teuthology.orchestra.run.smithi182.stderr: 72700K .......... .......... .......... .......... .......... 98% 313M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 72750K .......... .......... .......... .......... .......... 98% 259M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 72800K .......... .......... .......... .......... .......... 99% 323M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 72850K .......... .......... .......... .......... .......... 99% 325M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 72900K .......... .......... .......... .......... .......... 99% 319M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 72950K .......... .......... .......... .......... .......... 99% 274M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 73000K .......... .......... .......... .......... .......... 99% 318M 0s 2019-11-29T11:30:03.698 INFO:teuthology.orchestra.run.smithi182.stderr: 73050K .......... .......... .......... .......... .......... 99% 324M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73100K .......... .......... .......... .......... .......... 99% 329M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73150K .......... .......... .......... .......... .......... 99% 271M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73200K .......... .......... .......... .......... .......... 99% 318M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73250K .......... .......... .......... .......... .......... 99% 324M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73300K .......... .......... .......... .......... .......... 99% 317M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73350K .......... .......... .......... .......... .......... 99% 291M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73400K .......... .......... .......... .......... .......... 99% 298M 0s 2019-11-29T11:30:03.699 INFO:teuthology.orchestra.run.smithi182.stderr: 73450K .......... .......... .......... .......... .......... 99% 320M 0s 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stderr: 73500K .......... .......... .......... .......... .......... 99% 328M 0s 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stderr: 73550K ........ 100% 165M=0.3s 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29 11:30:02 (264 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T11:30:03.700 INFO:teuthology.orchestra.run.smithi182.stdout:Archive: gradle-4.7-bin.zip 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-29T11:30:03.701 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-29T11:30:03.702 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-29T11:30:03.703 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-29T11:30:03.704 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-29T11:30:03.705 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-29T11:30:03.706 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-29T11:30:03.706 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-29T11:30:03.706 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-29T11:30:03.707 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-29T11:30:03.707 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-29T11:30:03.707 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-29T11:30:03.707 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-29T11:30:03.707 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-29T11:30:03.708 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-29T11:30:03.709 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-29T11:30:03.710 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-29T11:30:03.711 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-29T11:30:03.712 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-29T11:30:03.713 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-29T11:30:03.714 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-29T11:30:03.715 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-29T11:30:03.716 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-29T11:30:03.716 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-29T11:30:03.716 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-29T11:30:03.716 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-29T11:30:03.717 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-29T11:30:03.718 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-29T11:30:03.719 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-29T11:30:03.720 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-29T11:30:03.721 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-29T11:30:03.722 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-29T11:30:03.723 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-29T11:30:03.724 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-29T11:30:03.725 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-29T11:30:03.726 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-29T11:30:03.727 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-29T11:30:03.728 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-29T11:30:03.729 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-29T11:30:03.730 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-29T11:30:03.731 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-29T11:30:03.731 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-29T11:30:03.731 INFO:teuthology.orchestra.run.smithi182.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-29T11:30:03.731 INFO:teuthology.orchestra.run.smithi182.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-29T11:30:04.560 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.560 INFO:teuthology.orchestra.run.smithi182.stdout:Welcome to Gradle 4.7! 2019-11-29T11:30:04.560 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.561 INFO:teuthology.orchestra.run.smithi182.stdout:Here are the highlights of this release: 2019-11-29T11:30:04.561 INFO:teuthology.orchestra.run.smithi182.stdout: - Incremental annotation processing 2019-11-29T11:30:04.562 INFO:teuthology.orchestra.run.smithi182.stdout: - JDK 10 support 2019-11-29T11:30:04.563 INFO:teuthology.orchestra.run.smithi182.stdout: - Grouped non-interactive console logs 2019-11-29T11:30:04.563 INFO:teuthology.orchestra.run.smithi182.stdout: - Failed tests are re-run first for quicker feedback 2019-11-29T11:30:04.563 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.563 INFO:teuthology.orchestra.run.smithi182.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-29T11:30:04.563 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.873 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:------------------------------------------------------------ 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:Gradle 4.7 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:------------------------------------------------------------ 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-29T11:30:04.874 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:Groovy: 2.4.12 2019-11-29T11:30:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-29T11:30:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-29T11:30:04.875 INFO:teuthology.orchestra.run.smithi182.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-29T11:30:04.875 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:04.879 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-29T11:30:04.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-29T11:30:04.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi182.front.sepia.ceph.com 2019-11-29T11:30:04.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-29T11:30:04.879 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi114.front.sepia.ceph.com 2019-11-29T11:30:04.880 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-29T11:30:05.282 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-29T11:30:05.283 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-29T11:30:05.283 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'FYIWZHBKIDYXJFVNBIDM', 's3dir': 'folder', 'endpoint': 'smithi182.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': 'UEh6cEmw4VDows4LWSYRwOz5gwxfRFi37jE/OMc9XUkpDxR9K1SHmw==', 'host': 'smithi182.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-29T11:30:05.283 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-29T11:30:05.284 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'FYIWZHBKIDYXJFVNBIDM', '--secret', 'UEh6cEmw4VDows4LWSYRwOz5gwxfRFi37jE/OMc9XUkpDxR9K1SHmw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-29T11:30:05.284 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key FYIWZHBKIDYXJFVNBIDM --secret UEh6cEmw4VDows4LWSYRwOz5gwxfRFi37jE/OMc9XUkpDxR9K1SHmw== --email tester.client.0_test@test.test --cluster ceph 2019-11-29T11:30:05.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.436+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.463+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.463+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.474+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.474+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.480+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.480+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.489+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:05.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.700+0000 7ff4bcd84ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:30:05.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.700+0000 7ff4bcd84ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:30:05.685 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.700+0000 7ff4bcd84ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:30:05.685 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.700+0000 7ff4bcd84ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:30:05.685 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.700+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.709+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:05.693 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.709+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.723+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:05.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.723+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.731+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:05.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.731+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.730 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.746+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:05.730 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.746+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.736 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.753+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.753+0000 7ff4bcd84ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:30:05.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.753+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.759+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.743 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.759+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.766+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:05.751 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.766+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.780+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:05.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.780+0000 7ff4bcd84ec0 20 zonegroup default 2019-11-29T11:30:05.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.780+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.771 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.787+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.771 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.787+0000 7ff4bcd84ec0 10 Cannot find current period zone using local zone 2019-11-29T11:30:05.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.787+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.777 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.793+0000 7ff4bcd84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:05.777 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.793+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.801+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:05.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.801+0000 7ff4bcd84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:05.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.816+0000 7ff4bcd84ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:05.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.816+0000 7ff4bcd84ec0 20 zone default found 2019-11-29T11:30:05.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.816+0000 7ff4bcd84ec0 20 started sync module instance, tier type = 2019-11-29T11:30:05.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:05.816+0000 7ff4bcd84ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:30:06.163 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=0 2019-11-29T11:30:06.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=1 2019-11-29T11:30:06.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=2 2019-11-29T11:30:06.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=3 2019-11-29T11:30:06.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=4 2019-11-29T11:30:06.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.180+0000 7ff4bcd84ec0 20 add_watcher() i=5 2019-11-29T11:30:06.182 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.199+0000 7ff4bcd84ec0 20 add_watcher() i=6 2019-11-29T11:30:06.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.219+0000 7ff4bcd84ec0 20 add_watcher() i=7 2019-11-29T11:30:06.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.219+0000 7ff4bcd84ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:30:06.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.219+0000 7ff47a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:30:06.221 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.237+0000 7ff4a9fb1700 0 -- 172.21.15.182:0/1733887701 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x559a90ab9460 msgr2=0x559a90abfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:30:06.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:06.270+0000 7ff4aa7b2700 0 -- 172.21.15.182:0/3120720498 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x559a90abf410 msgr2=0x559a90abf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:30:07.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.596+0000 7ff3f0ff9700 20 reqs_thread_entry: start 2019-11-29T11:30:07.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.596+0000 7ff3ea7fc700 20 reqs_thread_entry: start 2019-11-29T11:30:07.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.596+0000 7ff4bcd84ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:30:07.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.597+0000 7ff3e8ff9700 20 reqs_thread_entry: start 2019-11-29T11:30:07.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.597+0000 7ff4bcd84ec0 20 get_system_obj_state: rctx=0x7ffceffee868 obj=default.rgw.meta:users.uid:tester.client.0 state=0x559a90b3a2b0 s->prefetch_data=0 2019-11-29T11:30:07.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.597+0000 7ff4bcd84ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-29T11:30:07.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.603+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-29T11:30:07.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.603+0000 7ff4bcd84ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T11:30:07.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.603+0000 7ff4bcd84ec0 20 get_system_obj_state: rctx=0x7ffceffee878 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x559a90b3c040 s->prefetch_data=0 2019-11-29T11:30:07.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.603+0000 7ff4bcd84ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-29T11:30:07.605 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.609+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.609+0000 7ff4bcd84ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.609+0000 7ff4bcd84ec0 20 get_system_obj_state: rctx=0x7ffceffee878 obj=default.rgw.meta:users.keys:FYIWZHBKIDYXJFVNBIDM state=0x559a90b3c040 s->prefetch_data=0 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.609+0000 7ff4bcd84ec0 10 cache get: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM : miss 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.615+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM info.flags=0x0 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.615+0000 7ff4bcd84ec0 10 adding default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM to cache LRU end 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.615+0000 7ff4bcd84ec0 20 get_system_obj_state: rctx=0x7ffceffee488 obj=default.rgw.meta:users.keys:FYIWZHBKIDYXJFVNBIDM state=0x559a90b3c040 s->prefetch_data=0 2019-11-29T11:30:07.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.615+0000 7ff4bcd84ec0 10 cache get: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM : type miss (requested=0x6, cached=0x0) 2019-11-29T11:30:07.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.620+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM info.flags=0x0 2019-11-29T11:30:07.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.620+0000 7ff4bcd84ec0 10 moving default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM to cache LRU end 2019-11-29T11:30:07.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.620+0000 7ff4bcd84ec0 20 get_system_obj_state: rctx=0x7ffceffee608 obj=default.rgw.meta:users.keys:FYIWZHBKIDYXJFVNBIDM state=0x559a90b3c040 s->prefetch_data=0 2019-11-29T11:30:07.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.620+0000 7ff4bcd84ec0 10 cache get: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM : type miss (requested=0x6, cached=0x0) 2019-11-29T11:30:07.611 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.626+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM info.flags=0x0 2019-11-29T11:30:07.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.626+0000 7ff4bcd84ec0 10 moving default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM to cache LRU end 2019-11-29T11:30:07.669 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.685+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-29T11:30:07.669 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.685+0000 7ff4bcd84ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T11:30:07.669 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.685+0000 7ff4bcd84ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-29T11:30:07.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.703+0000 7ff48affd700 10 RGWWatcher::handle_notify() notify_id 554050781187 cookie 94122340412224 notifier 4726 bl.length()=632 2019-11-29T11:30:07.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.703+0000 7ff48affd700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-29T11:30:07.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:07.703+0000 7ff48affd700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-29T11:30:08.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.189+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-29T11:30:08.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.189+0000 7ff4bcd84ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T11:30:08.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.189+0000 7ff4bcd84ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-29T11:30:08.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.206+0000 7ff48affd700 10 RGWWatcher::handle_notify() notify_id 554050781188 cookie 94122340393104 notifier 4726 bl.length()=200 2019-11-29T11:30:08.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.206+0000 7ff48affd700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-29T11:30:08.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.206+0000 7ff48affd700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-29T11:30:08.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.950+0000 7ff4bcd84ec0 10 cache put: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM info.flags=0x7 2019-11-29T11:30:08.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.951+0000 7ff4bcd84ec0 10 moving default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM to cache LRU end 2019-11-29T11:30:08.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.951+0000 7ff4bcd84ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=189 2019-11-29T11:30:08.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.964+0000 7ff48affd700 10 RGWWatcher::handle_notify() notify_id 554050781189 cookie 94122340387216 notifier 4726 bl.length()=189 2019-11-29T11:30:08.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.964+0000 7ff48affd700 10 cache put: name=default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM info.flags=0x7 2019-11-29T11:30:08.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:08.964+0000 7ff48affd700 10 moving default.rgw.meta+users.keys+FYIWZHBKIDYXJFVNBIDM to cache LRU end 2019-11-29T11:30:09.269 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "tester.client.0", 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Ms. tester.client.0", 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "tester.client.0_test@test.test", 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T11:30:09.270 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "tester.client.0", 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "FYIWZHBKIDYXJFVNBIDM", 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "UEh6cEmw4VDows4LWSYRwOz5gwxfRFi37jE/OMc9XUkpDxR9K1SHmw==" 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T11:30:09.271 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T11:30:09.272 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T11:30:09.272 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T11:30:09.272 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T11:30:09.272 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T11:30:09.272 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:30:09.273 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T11:30:09.274 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T11:30:09.275 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T11:30:09.275 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T11:30:09.275 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T11:30:09.275 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T11:30:09.275 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:09.341 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.358+0000 7ff4bcd84ec0 20 remove_watcher() i=0 2019-11-29T11:30:09.341 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.358+0000 7ff4bcd84ec0 2 removed watcher, disabling cache 2019-11-29T11:30:09.392 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.408+0000 7ff4bcd84ec0 20 remove_watcher() i=1 2019-11-29T11:30:09.438 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.454+0000 7ff4bcd84ec0 20 remove_watcher() i=2 2019-11-29T11:30:09.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.489+0000 7ff4bcd84ec0 20 remove_watcher() i=3 2019-11-29T11:30:09.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.534+0000 7ff4bcd84ec0 20 remove_watcher() i=4 2019-11-29T11:30:09.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.565+0000 7ff4bcd84ec0 20 remove_watcher() i=5 2019-11-29T11:30:09.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.603+0000 7ff4bcd84ec0 20 remove_watcher() i=6 2019-11-29T11:30:09.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.642+0000 7ff4bcd84ec0 20 remove_watcher() i=7 2019-11-29T11:30:09.635 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-29T11:30:09.691 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-29T11:30:09.699 INFO:teuthology.orchestra.run.smithi182:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-29T11:30:09.789 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:30:09.920 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.937+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:09.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.958+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:09.942 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.958+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:09.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.968+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:09.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.968+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:09.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.974+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:09.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.974+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:09.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:09.982+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:10.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.171+0000 7f626ce32ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:30:10.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.171+0000 7f626ce32ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:30:10.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.171+0000 7f626ce32ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:30:10.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.171+0000 7f626ce32ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:30:10.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.171+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.178+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:10.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.178+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.192+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:10.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.192+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.200+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:10.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.200+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.213+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:10.197 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.213+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.219+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:10.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.219+0000 7f626ce32ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:30:10.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.219+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.227+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:10.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.227+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.220 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.237+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:10.220 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.237+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.250+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:10.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.250+0000 7f626ce32ec0 20 zonegroup default 2019-11-29T11:30:10.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.250+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.240 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.256+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:10.240 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.256+0000 7f626ce32ec0 10 Cannot find current period zone using local zone 2019-11-29T11:30:10.240 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.256+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.245 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.262+0000 7f626ce32ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:10.246 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.262+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.253 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.269+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:10.253 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.269+0000 7f626ce32ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:10.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.293+0000 7f626ce32ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:10.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.293+0000 7f626ce32ec0 20 zone default found 2019-11-29T11:30:10.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.293+0000 7f626ce32ec0 20 started sync module instance, tier type = 2019-11-29T11:30:10.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.293+0000 7f626ce32ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:30:10.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=0 2019-11-29T11:30:10.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=1 2019-11-29T11:30:10.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=2 2019-11-29T11:30:10.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=3 2019-11-29T11:30:10.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=4 2019-11-29T11:30:10.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=5 2019-11-29T11:30:10.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.736+0000 7f626ce32ec0 20 add_watcher() i=6 2019-11-29T11:30:10.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.782+0000 7f626ce32ec0 20 add_watcher() i=7 2019-11-29T11:30:10.877 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.782+0000 7f626ce32ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:30:10.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.782+0000 7f622afdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:30:10.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.797+0000 7f625a05f700 0 -- 172.21.15.182:0/2557289914 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x559ccea70320 msgr2=0x559ccea72740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:30:10.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:10.821+0000 7f625a05f700 0 -- 172.21.15.182:0/2319280150 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x559ccea56df0 msgr2=0x559ccea34320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:30:12.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.101+0000 7f61997fa700 20 reqs_thread_entry: start 2019-11-29T11:30:12.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.101+0000 7f6192ffd700 20 reqs_thread_entry: start 2019-11-29T11:30:12.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.101+0000 7f626ce32ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:30:12.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.101+0000 7f61917fa700 20 reqs_thread_entry: start 2019-11-29T11:30:12.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.101+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:30:12.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.152+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:12.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.168+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:12.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T11:30:12.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_oq_k-iSiPZMi5Y5ZR9DFzuA8g3llBEA', time=2019-11-29T13:29:43.150037+0000, chain.objs.size()=3 2019-11-29T11:30:12.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.GoEmwxSHu-HnkooNHi5AyBa-1vvX4dl_0 2019-11-29T11:30:12.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.GoEmwxSHu-HnkooNHi5AyBa-1vvX4dl_1 2019-11-29T11:30:12.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.GoEmwxSHu-HnkooNHi5AyBa-1vvX4dl_2 2019-11-29T11:30:12.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.235', time=2019-11-29T13:29:43.922018+0000, chain.objs.size()=5 2019-11-29T11:30:12.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.1 2019-11-29T11:30:12.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.1_1 2019-11-29T11:30:12.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.2 2019-11-29T11:30:12.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.2_1 2019-11-29T11:30:12.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.3 2019-11-29T11:30:12.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Dxud5YNQLTh5snkBt3TtWvBI8GVINuE', time=2019-11-29T13:29:44.180712+0000, chain.objs.size()=2 2019-11-29T11:30:12.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.52TAGozQLgvKbO0y0m0aBvHcXwFDZhX_1 2019-11-29T11:30:12.193 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.205+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.52TAGozQLgvKbO0y0m0aBvHcXwFDZhX_2 2019-11-29T11:30:12.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.419+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:12.553 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.569+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:30:12.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.614+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:12.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.628+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:12.638 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.654+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:12.638 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.654+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Vc5iMn9dgtGzWKwg-OEbnsAAFgNwms2', time=2019-11-29T13:29:44.529965+0000, chain.objs.size()=3 2019-11-29T11:30:12.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.654+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_._fVuU5xVzlI5siP9aaaHvkwTKN2p1hW_0 2019-11-29T11:30:12.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.654+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_._fVuU5xVzlI5siP9aaaHvkwTKN2p1hW_1 2019-11-29T11:30:12.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.654+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_._fVuU5xVzlI5siP9aaaHvkwTKN2p1hW_2 2019-11-29T11:30:12.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:12.877+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:13.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.071+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:30:13.125 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.141+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:13.150 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.166+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:13.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.219+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.219+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.40', time=2019-11-29T13:29:35.181610+0000, chain.objs.size()=7 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.219+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__multipart_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.1 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.219+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__shadow_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.1_1 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__multipart_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.2 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__shadow_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.2_1 2019-11-29T11:30:13.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__multipart_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.3 2019-11-29T11:30:13.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__shadow_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.3_1 2019-11-29T11:30:13.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.3__multipart_foo.2~00cIhdm6Zy4daVSOLhlJ1oB1gzIwyRl.4 2019-11-29T11:30:13.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_wcovRgLCS9JrnjnI23tKQqNImxGcnWg', time=2019-11-29T13:29:40.914292+0000, chain.objs.size()=1 2019-11-29T11:30:13.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.220+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.aihvs4DL87bgGvAwCMcMJmNwHci3J4Q_1 2019-11-29T11:30:13.482 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.493+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:13.646 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.662+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:30:13.724 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.740+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:13.753 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.769+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:13.767 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.784+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:13.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.823+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:30:13.872 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.889+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:13.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.909+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:13.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.918+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:13.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:13.970+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:30:14.041 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.058+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:14.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.092+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:14.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.117+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:14.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.117+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='__1k-PgjSHcdNyJ8Bfthhop6CfOMvRCq', time=2019-11-29T13:29:40.338462+0000, chain.objs.size()=2 2019-11-29T11:30:14.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.117+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.Ub8jgjl0EKgXcUVUts3b26Aqga7CiCX_0 2019-11-29T11:30:14.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.Ub8jgjl0EKgXcUVUts3b26Aqga7CiCX_1 2019-11-29T11:30:14.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.233', time=2019-11-29T13:29:43.662925+0000, chain.objs.size()=5 2019-11-29T11:30:14.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.1 2019-11-29T11:30:14.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.1_1 2019-11-29T11:30:14.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.2 2019-11-29T11:30:14.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.2_1 2019-11-29T11:30:14.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.118+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-LUKEWARM.2~9BpyVyg7TAOAaTFtG6305Cd6lXhY7tv.3 2019-11-29T11:30:14.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.410+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:14.507 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.524+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:30:14.579 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.595+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:14.597 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.614+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:14.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2019-11-29T11:30:14.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_LVUgDnoVuqJwQyYIDkzGGPQhegwAtxF', time=2019-11-29T13:29:41.622532+0000, chain.objs.size()=1 2019-11-29T11:30:14.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.llKibPgGIWsXgjmely9pF3RimJh_fC2_0 2019-11-29T11:30:14.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.245', time=2019-11-29T13:29:44.922248+0000, chain.objs.size()=5 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.1 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.1_1 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.2 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.632+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.2_1 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.3 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.196', time=2019-11-29T13:29:46.397813+0000, chain.objs.size()=5 2019-11-29T11:30:14.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-FROZEN.2~J_qaR7Yr6VBZ2XHpOpeFkWmF0w-IcXY.1 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__shadow_foo-FROZEN.2~J_qaR7Yr6VBZ2XHpOpeFkWmF0w-IcXY.1_1 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-FROZEN.2~J_qaR7Yr6VBZ2XHpOpeFkWmF0w-IcXY.2 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__shadow_foo-FROZEN.2~J_qaR7Yr6VBZ2XHpOpeFkWmF0w-IcXY.2_1 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-FROZEN.2~J_qaR7Yr6VBZ2XHpOpeFkWmF0w-IcXY.3 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.84', time=2019-11-29T13:29:48.482173+0000, chain.objs.size()=3 2019-11-29T11:30:14.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.633+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.tIbEJ9-QPIjsp7rt9QTbzgeJg42uYns_0 2019-11-29T11:30:14.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.801+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.tIbEJ9-QPIjsp7rt9QTbzgeJg42uYns_1 2019-11-29T11:30:14.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.809+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.tIbEJ9-QPIjsp7rt9QTbzgeJg42uYns_2 2019-11-29T11:30:14.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.933+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.86', time=2019-11-29T13:29:48.978885+0000, chain.objs.size()=2 2019-11-29T11:30:14.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.933+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.Xh7UlACRJcBN4VZLyPH19tvNCNbwxeZ_1 2019-11-29T11:30:14.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:14.933+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.Xh7UlACRJcBN4VZLyPH19tvNCNbwxeZ_2 2019-11-29T11:30:15.038 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.054+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:15.132 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.149+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:30:15.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.212+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:15.220 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.236+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:15.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.245+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:15.279 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.294+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:30:15.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.351+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:15.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.372+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:15.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.401+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:15.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.401+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_1AanYiCm9YP6zVSWHSL5oGizuZ0cO2m', time=2019-11-29T13:29:39.721376+0000, chain.objs.size()=2 2019-11-29T11:30:15.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.401+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.vGKzM8loc7zHbZiB4NLrHuDboiQBnqR_0 2019-11-29T11:30:15.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.401+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.vGKzM8loc7zHbZiB4NLrHuDboiQBnqR_1 2019-11-29T11:30:15.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.534+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:15.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.695+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:30:15.761 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.778+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:15.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.804+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:15.836 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.852+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:15.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.852+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.108', time=2019-11-29T13:29:39.340483+0000, chain.objs.size()=2 2019-11-29T11:30:15.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.852+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.r9iQzSULczV3rKt4meglKuXrkh7QPCs_0 2019-11-29T11:30:15.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.852+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.r9iQzSULczV3rKt4meglKuXrkh7QPCs_1 2019-11-29T11:30:15.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:15.925+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:16.060 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.077+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:30:16.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.122+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.121 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.138+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:16.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.146+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.189+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:30:16.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.268+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.273 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.289+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:16.285 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.302+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.341+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:30:16.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.387+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.389 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.406+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:16.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.415+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.457+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:30:16.482 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.499+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.517+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:16.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.527+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.546 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.562+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:30:16.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.609+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:16.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.643+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.655+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.655+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.55', time=2019-11-29T13:29:36.540548+0000, chain.objs.size()=7 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.655+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__multipart_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.1 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__shadow_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.1_1 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__multipart_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.2 2019-11-29T11:30:16.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__shadow_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.2_1 2019-11-29T11:30:16.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__multipart_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.3 2019-11-29T11:30:16.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__shadow_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.3_1 2019-11-29T11:30:16.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.656+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.4__multipart_foo.2~zer3cXyQDO24RpFXyWcfMX0HqJczzWF.4 2019-11-29T11:30:16.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.865+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:16.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:16.961+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:30:17.016 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.033+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.050 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.066+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.084+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:17.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.084+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.224', time=2019-11-29T13:29:42.643513+0000, chain.objs.size()=5 2019-11-29T11:30:17.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.084+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.1 2019-11-29T11:30:17.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.084+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.1_1 2019-11-29T11:30:17.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.085+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.2 2019-11-29T11:30:17.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.085+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.2_1 2019-11-29T11:30:17.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.085+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.3 2019-11-29T11:30:17.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.191+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:17.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.304+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:30:17.335 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.352+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.355 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.368+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.377+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.410+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:30:17.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.464+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.471 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.488+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.498+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.519 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.536+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:30:17.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.579+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.577 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.594+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.603+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.639+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:30:17.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.685+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.705+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.718+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:17.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.718+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.210', time=2019-11-29T13:29:46.765091+0000, chain.objs.size()=3 2019-11-29T11:30:17.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.718+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-STANDARD.2~kQEPkOQIHSALBCUvbRe-_ndQm4H3cBz.1 2019-11-29T11:30:17.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.718+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-STANDARD.2~kQEPkOQIHSALBCUvbRe-_ndQm4H3cBz.2 2019-11-29T11:30:17.705 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.718+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-STANDARD.2~kQEPkOQIHSALBCUvbRe-_ndQm4H3cBz.3 2019-11-29T11:30:17.778 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.791+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:17.869 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.886+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:30:17.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.941+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:17.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.956+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:17.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.112', time=2019-11-29T13:29:40.138678+0000, chain.objs.size()=2 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.SKVdR4pDi51s-5vaugSAOGW4V8jzoCN_0 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.SKVdR4pDi51s-5vaugSAOGW4V8jzoCN_1 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.114', time=2019-11-29T13:29:40.545390+0000, chain.objs.size()=2 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.SKVdR4pDi51s-5vaugSAOGW4V8jzoCN_0 2019-11-29T11:30:17.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:17.992+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.SKVdR4pDi51s-5vaugSAOGW4V8jzoCN_1 2019-11-29T11:30:18.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.171+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:18.292 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.309+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:30:18.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.366+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:18.367 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.384+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:18.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.392+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:18.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.429+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:30:18.457 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.473+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:18.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.493+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:18.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_D6Qj4XInOFM_zp1CPI6RgqkVUAl91cs', time=2019-11-29T13:29:43.797085+0000, chain.objs.size()=3 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.FrcyXImOZR_9rHox_lFJZAaUZgyuUuL_0 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.FrcyXImOZR_9rHox_lFJZAaUZgyuUuL_1 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.FrcyXImOZR_9rHox_lFJZAaUZgyuUuL_2 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.242', time=2019-11-29T13:29:44.318961+0000, chain.objs.size()=5 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.1 2019-11-29T11:30:18.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.1_1 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.2 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.2_1 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-STANDARD.2~glaMAVE9fsSgeQfBOY74FuV-2n6kHPp.3 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.85', time=2019-11-29T13:29:48.700130+0000, chain.objs.size()=3 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.Ea82NW-iD6Mew2f_FwdoSRzmp90z7S__0 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.Ea82NW-iD6Mew2f_FwdoSRzmp90z7S__1 2019-11-29T11:30:18.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.525+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.6__shadow_.Ea82NW-iD6Mew2f_FwdoSRzmp90z7S__2 2019-11-29T11:30:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.879+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:18.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:18.973+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:30:19.010 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.027+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:19.034 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.047+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:19.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.063+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:19.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.063+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_wLUv02g8jRPCy_4FyO-3WErJl2kL58i', time=2019-11-29T13:29:41.307537+0000, chain.objs.size()=1 2019-11-29T11:30:19.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.063+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.EPStY9dAWd8FNZW9TSG7jzpXZAvzxRA_0 2019-11-29T11:30:19.117 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.134+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:19.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.251+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:30:19.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.365+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:19.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.386+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:19.381 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.398+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:19.502 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.514+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:30:19.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.569+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:19.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.583+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:19.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:19.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.109', time=2019-11-29T13:29:39.506479+0000, chain.objs.size()=2 2019-11-29T11:30:19.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.r9iQzSULczV3rKt4meglKuXrkh7QPCs_0 2019-11-29T11:30:19.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.r9iQzSULczV3rKt4meglKuXrkh7QPCs_1 2019-11-29T11:30:19.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_H2A1iy3mGCb2Mog5kMN7jOsSemfU3yD', time=2019-11-29T13:29:43.478244+0000, chain.objs.size()=2 2019-11-29T11:30:19.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.__OlhiwC51jiaKjhJPBn319o1OJ5Y0X_1 2019-11-29T11:30:19.588 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.595+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.__OlhiwC51jiaKjhJPBn319o1OJ5Y0X_2 2019-11-29T11:30:19.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:19.874+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:20.006 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.022+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:30:20.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.080+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:20.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.099+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:20.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:20.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.71', time=2019-11-29T13:29:37.922952+0000, chain.objs.size()=4 2019-11-29T11:30:20.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5__multipart_foo.2~ScfBBEnhwxx_I9x8RQg_Pm0XqMsXBun.1 2019-11-29T11:30:20.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5__multipart_foo.2~ScfBBEnhwxx_I9x8RQg_Pm0XqMsXBun.2 2019-11-29T11:30:20.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5__multipart_foo.2~ScfBBEnhwxx_I9x8RQg_Pm0XqMsXBun.3 2019-11-29T11:30:20.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.5__multipart_foo.2~ScfBBEnhwxx_I9x8RQg_Pm0XqMsXBun.4 2019-11-29T11:30:20.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_ZCNfZX1qtyh_whn91mc7cuO5azaOgTb', time=2019-11-29T13:29:39.986473+0000, chain.objs.size()=1 2019-11-29T11:30:20.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.115+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.7__shadow_.hmAtF0mZ2u5rHAfFXl_Gxf2SbRRz-qh_1 2019-11-29T11:30:20.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.215+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:20.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.304+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:30:20.330 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.347+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:20.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.365+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.20', time=2019-11-29T13:29:33.792843+0000, chain.objs.size()=4 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2__multipart_foo.2~7V7ol7-Ty5nPyEH4AzOZMFLXuZvBMih.1 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2__multipart_foo.2~7V7ol7-Ty5nPyEH4AzOZMFLXuZvBMih.2 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2__multipart_foo.2~7V7ol7-Ty5nPyEH4AzOZMFLXuZvBMih.3 2019-11-29T11:30:20.362 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.378+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.2__multipart_foo.2~7V7ol7-Ty5nPyEH4AzOZMFLXuZvBMih.4 2019-11-29T11:30:20.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:20.534 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.551+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:30:20.604 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.621+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:20.630 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.646+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:20.646 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.663+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:20.696 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.713+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:30:20.759 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.775+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:20.780 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.796+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:20.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:30:20.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Sx1a5ljXDkXqEo7mxTrXg_E2JYO2u-s', time=2019-11-29T13:29:44.709393+0000, chain.objs.size()=3 2019-11-29T11:30:20.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.e_PoF9BoZzruOXQvEqtlx8YXYJh391R_0 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.e_PoF9BoZzruOXQvEqtlx8YXYJh391R_1 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_.e_PoF9BoZzruOXQvEqtlx8YXYJh391R_2 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.203', time=2019-11-29T13:29:46.579735+0000, chain.objs.size()=5 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-LUKEWARM.2~RocOILlRjRhzb6rEBbrDNnTF4O6Op0d.1 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__shadow_foo-LUKEWARM.2~RocOILlRjRhzb6rEBbrDNnTF4O6Op0d.1_1 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-LUKEWARM.2~RocOILlRjRhzb6rEBbrDNnTF4O6Op0d.2 2019-11-29T11:30:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.815+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__shadow_foo-LUKEWARM.2~RocOILlRjRhzb6rEBbrDNnTF4O6Op0d.2_1 2019-11-29T11:30:20.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:20.816+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.8__multipart_foo-LUKEWARM.2~RocOILlRjRhzb6rEBbrDNnTF4O6Op0d.3 2019-11-29T11:30:21.135 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.151+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:21.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.234+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:30:21.259 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.275+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:21.273 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.290+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:21.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.298+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:21.312 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.329+0000 7f626ce32ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:30:21.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.397+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:21.402 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.419+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:21.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:30:21.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.225', time=2019-11-29T13:29:42.927449+0000, chain.objs.size()=5 2019-11-29T11:30:21.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.1 2019-11-29T11:30:21.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.1_1 2019-11-29T11:30:21.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.2 2019-11-29T11:30:21.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__shadow_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.2_1 2019-11-29T11:30:21.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.456+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.9__multipart_foo-FROZEN.2~MHOuP-1XWn1CZRDYzSTWEbudUuxzs7-.3 2019-11-29T11:30:21.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.668+0000 7f626ce32ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:30:21.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.805+0000 7f626ce32ec0 20 remove_watcher() i=0 2019-11-29T11:30:21.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.805+0000 7f626ce32ec0 2 removed watcher, disabling cache 2019-11-29T11:30:21.827 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.844+0000 7f626ce32ec0 20 remove_watcher() i=1 2019-11-29T11:30:21.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.877+0000 7f626ce32ec0 20 remove_watcher() i=2 2019-11-29T11:30:21.937 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:21.954+0000 7f626ce32ec0 20 remove_watcher() i=3 2019-11-29T11:30:21.991 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.007+0000 7f626ce32ec0 20 remove_watcher() i=4 2019-11-29T11:30:22.048 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.064+0000 7f626ce32ec0 20 remove_watcher() i=5 2019-11-29T11:30:22.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.105+0000 7f626ce32ec0 20 remove_watcher() i=6 2019-11-29T11:30:22.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.156+0000 7f626ce32ec0 20 remove_watcher() i=7 2019-11-29T11:30:22.147 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:30:22.267 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.284+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.308+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.292 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.308+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.301 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.318+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.301 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.318+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.324+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.324+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.315 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.332+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:22.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.589+0000 7fe4eac26ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:30:22.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.589+0000 7fe4eac26ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:30:22.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.589+0000 7fe4eac26ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:30:22.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.589+0000 7fe4eac26ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:30:22.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.589+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.600+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:22.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.600+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.618+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:22.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.618+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.631+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:22.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.631+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.633 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.649+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:22.633 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.649+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.666+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.666+0000 7fe4eac26ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:30:22.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.666+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.674+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.674+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.685+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:22.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.685+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.682 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.699+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:30:22.682 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.699+0000 7fe4eac26ec0 20 zonegroup default 2019-11-29T11:30:22.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.699+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.706+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.706+0000 7fe4eac26ec0 10 Cannot find current period zone using local zone 2019-11-29T11:30:22.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.706+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.694 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.711+0000 7fe4eac26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:30:22.694 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.711+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.719+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:30:22.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.719+0000 7fe4eac26ec0 20 rados->read ofs=0 len=0 2019-11-29T11:30:22.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.738+0000 7fe4eac26ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:30:22.722 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.738+0000 7fe4eac26ec0 20 zone default found 2019-11-29T11:30:22.722 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.738+0000 7fe4eac26ec0 20 started sync module instance, tier type = 2019-11-29T11:30:22.722 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:22.738+0000 7fe4eac26ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:30:23.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=0 2019-11-29T11:30:23.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=1 2019-11-29T11:30:23.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=2 2019-11-29T11:30:23.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=3 2019-11-29T11:30:23.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=4 2019-11-29T11:30:23.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=5 2019-11-29T11:30:23.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.192+0000 7fe4eac26ec0 20 add_watcher() i=6 2019-11-29T11:30:23.207 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.224+0000 7fe4eac26ec0 20 add_watcher() i=7 2019-11-29T11:30:23.207 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.224+0000 7fe4eac26ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:30:23.207 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.224+0000 7fe42bfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:30:23.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.231+0000 7fe4d7e53700 0 -- 172.21.15.182:0/157817611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55feef372790 msgr2=0x55feef371810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:30:23.416 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.433+0000 7fe4d7e53700 0 --2- 172.21.15.182:0/157817611 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55feef372790 0x55feef371810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T11:30:23.462 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:23.479+0000 7fe4d8654700 0 -- 172.21.15.182:0/588568341 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x55feef358ec0 msgr2=0x55feef381970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:30:24.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.785+0000 7fe4167fc700 20 reqs_thread_entry: start 2019-11-29T11:30:24.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.785+0000 7fe40ffff700 20 reqs_thread_entry: start 2019-11-29T11:30:24.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.785+0000 7fe4eac26ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:30:24.769 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.786+0000 7fe40e7fc700 20 reqs_thread_entry: start 2019-11-29T11:30:24.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.786+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:30:24.822 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.839+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:24.842 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.858+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:24.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.867+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:24.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.906+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:30:24.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:24.994+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.004 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.021+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.016 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.032+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.078 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.095+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:30:25.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.162+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.163 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.180+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.189+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.240+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:30:25.289 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.305+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.312 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.328+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.342+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.374 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.390+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:30:25.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.432+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.438 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.455+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.468+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.488 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.505+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:30:25.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.548+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.564+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.572+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.604+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:30:25.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.650+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.648 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.665+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.675+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.717+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:30:25.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.789+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.817+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:25.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.832+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:25.937 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:25.954+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:30:26.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.100+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.116+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.109 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.125+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.160+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:30:26.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.230+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.246 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.263+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.259 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.275+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.330+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:30:26.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.405+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.425 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.438+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.435 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.452+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.474 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.491+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:30:26.516 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.533+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.548+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.539 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.556+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.582+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:30:26.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.667+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.691+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.705+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.761+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:30:26.827 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.837+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.857 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.869+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.883+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.913 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.929+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:30:26.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:26.985+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:26.988 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.004+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:26.999 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.016+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.049 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.064+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:30:27.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.140+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.173+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.189+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.243+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:30:27.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.324+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.349+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.345 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.362+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.403+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:30:27.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.461+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.461 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.478+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.474 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.491+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.514 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.530+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:30:27.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.592+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.594 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.610+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.622+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.668+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:30:27.732 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.749+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.771+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.777 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.780+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.807 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.824+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:30:27.877 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.893+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.913 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.930+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:27.933 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:27.950+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:27.988 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.005+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:30:28.049 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.065+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.082+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.078 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.094+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.109 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.126+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:30:28.192 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.209+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.235+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.240 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.255+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.299+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:30:28.330 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.347+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.365+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.377+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.418+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:30:28.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.470+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.469 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.486+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.478 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.495+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.578+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:30:28.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.630+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.630 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.647+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.655+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.692+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:30:28.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.730+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.745+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.736 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.753+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.782+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:30:28.809 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.825+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.823 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.840+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.831 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.848+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.877+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:30:28.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.956+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:28.967 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.983+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:28.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:28.996+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.027 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.044+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:30:29.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.102+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.110 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.127+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:29.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.137+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.193+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:30:29.242 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.259+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.283+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:29.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.297+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.329 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.345+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:30:29.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.404+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.425+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:30:29.417 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.434+0000 7fe4eac26ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:30:29.535 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.552+0000 7fe4eac26ec0 20 remove_watcher() i=0 2019-11-29T11:30:29.536 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.552+0000 7fe4eac26ec0 2 removed watcher, disabling cache 2019-11-29T11:30:29.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.632+0000 7fe4eac26ec0 20 remove_watcher() i=1 2019-11-29T11:30:29.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.671+0000 7fe4eac26ec0 20 remove_watcher() i=2 2019-11-29T11:30:29.727 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.743+0000 7fe4eac26ec0 20 remove_watcher() i=3 2019-11-29T11:30:29.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.813+0000 7fe4eac26ec0 20 remove_watcher() i=4 2019-11-29T11:30:29.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.932+0000 7fe4eac26ec0 20 remove_watcher() i=5 2019-11-29T11:30:29.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:29.985+0000 7fe4eac26ec0 20 remove_watcher() i=6 2019-11-29T11:30:30.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:30:30.031+0000 7fe4eac26ec0 20 remove_watcher() i=7 2019-11-29T11:30:30.021 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-29T11:30:30.627 INFO:teuthology.orchestra.run.smithi182.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-29T11:30:34.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-29T11:30:34.226 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-29T11:30:35.328 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :clean UP-TO-DATE 2019-11-29T11:30:35.427 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-29T11:30:35.532 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-29T11:30:35.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-29T11:30:35.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-29T11:30:35.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-29T11:30:35.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-29T11:30:35.732 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-29T11:30:35.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-29T11:30:35.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-29T11:30:35.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-29T11:30:35.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-29T11:30:35.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-29T11:30:35.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-29T11:30:35.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-29T11:30:35.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-29T11:30:35.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-29T11:30:35.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-29T11:30:35.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-29T11:30:35.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-29T11:30:35.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-29T11:30:35.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-29T11:30:36.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-29T11:30:36.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-29T11:30:36.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-29T11:30:36.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-29T11:30:36.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-29T11:30:36.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-29T11:30:36.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-29T11:30:36.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-29T11:30:36.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-29T11:30:36.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-29T11:30:36.036 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-29T11:30:36.036 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-29T11:30:36.036 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-29T11:30:36.036 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-29T11:30:36.036 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-29T11:30:36.037 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-29T11:30:36.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-29T11:30:36.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-29T11:30:36.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-29T11:30:36.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-29T11:30:36.130 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-29T11:30:36.131 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-29T11:30:36.132 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-29T11:30:36.132 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-29T11:30:36.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-29T11:30:36.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-29T11:30:36.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-29T11:30:36.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-29T11:30:36.229 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-29T11:30:36.230 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-29T11:30:36.231 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-29T11:30:36.231 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-29T11:30:36.231 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-29T11:30:36.231 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-29T11:30:36.231 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-29T11:30:36.232 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-29T11:30:36.233 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-29T11:30:36.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-29T11:30:36.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-29T11:30:36.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-29T11:30:36.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-29T11:30:36.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-29T11:30:36.333 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-29T11:30:36.333 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-29T11:30:36.334 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-29T11:30:36.335 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-29T11:30:36.336 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-29T11:30:36.337 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-29T11:30:36.337 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-29T11:30:36.337 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-29T11:30:36.337 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-29T11:30:36.337 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-29T11:30:36.338 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-29T11:30:36.339 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-29T11:30:36.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-29T11:30:36.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-29T11:30:36.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-29T11:30:36.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-29T11:30:36.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-29T11:30:36.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-29T11:30:36.529 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-29T11:30:36.530 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-29T11:30:36.530 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-29T11:30:36.530 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-29T11:30:36.530 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-29T11:30:36.531 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-29T11:30:36.531 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-29T11:30:36.627 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-29T11:30:36.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-29T11:30:36.629 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-29T11:30:36.629 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-29T11:30:36.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-29T11:30:36.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-29T11:30:36.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-29T11:30:36.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-29T11:30:36.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-29T11:30:36.730 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-29T11:30:36.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-29T11:30:36.731 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-29T11:30:36.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-29T11:30:36.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-29T11:30:36.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-29T11:30:36.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-29T11:30:36.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-29T11:30:36.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-29T11:30:36.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-29T11:30:36.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-29T11:30:36.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-29T11:30:36.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-29T11:30:36.927 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-29T11:30:36.928 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-29T11:30:36.928 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-29T11:30:36.928 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-29T11:30:36.928 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-29T11:30:36.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-29T11:30:36.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-29T11:30:36.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-29T11:30:36.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-29T11:30:36.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-29T11:30:36.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-29T11:30:37.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-29T11:30:37.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-29T11:30:37.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-29T11:30:37.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-29T11:30:37.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-29T11:30:37.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-29T11:30:37.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-29T11:30:37.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-29T11:30:37.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-29T11:30:37.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-29T11:30:37.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-29T11:30:37.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-29T11:30:37.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-29T11:30:37.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-29T11:30:37.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-29T11:30:37.830 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-29T11:30:37.831 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-29T11:30:37.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-29T11:30:37.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-29T11:30:37.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-29T11:30:37.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-29T11:30:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-29T11:30:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-29T11:30:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-29T11:30:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-29T11:30:37.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-29T11:30:37.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-29T11:30:38.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-29T11:30:38.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-29T11:30:38.032 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-29T11:30:38.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-29T11:30:38.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-29T11:30:38.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-29T11:30:38.033 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-29T11:30:38.034 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-29T11:30:38.035 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-29T11:30:38.035 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-29T11:30:38.035 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-29T11:30:38.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-29T11:30:38.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-29T11:30:38.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-29T11:30:38.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-29T11:30:38.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-29T11:30:38.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-29T11:30:38.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-29T11:30:38.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-29T11:30:38.234 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-29T11:30:38.235 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-29T11:30:38.235 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-29T11:30:38.235 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-29T11:30:38.235 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-29T11:30:38.235 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-29T11:30:38.236 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-29T11:30:38.236 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-29T11:30:38.236 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-29T11:30:38.236 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-29T11:30:38.236 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-29T11:30:38.237 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-29T11:30:38.237 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-29T11:30:38.238 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-29T11:30:38.238 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-29T11:30:38.238 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-29T11:30:38.238 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-29T11:30:38.238 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-29T11:30:38.327 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-29T11:30:38.327 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-29T11:30:38.327 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-29T11:30:38.327 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-29T11:30:38.328 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-29T11:30:38.329 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-29T11:30:38.428 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-29T11:30:38.428 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-29T11:30:38.428 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-29T11:30:38.429 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-29T11:30:38.430 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-29T11:30:38.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-29T11:30:38.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-29T11:30:38.431 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-29T11:30:38.533 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-29T11:30:38.534 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-29T11:30:38.534 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-29T11:30:38.537 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-29T11:30:38.537 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-29T11:30:38.537 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-29T11:30:38.537 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-29T11:30:38.537 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-29T11:30:38.538 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-29T11:30:38.538 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-29T11:30:38.538 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-29T11:30:38.538 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-29T11:30:38.538 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-29T11:30:38.627 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-29T11:30:38.627 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-29T11:30:38.627 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-29T11:30:38.627 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-29T11:30:38.628 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-29T11:30:38.634 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-29T11:30:38.634 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-29T11:30:38.634 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-29T11:30:38.635 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-29T11:30:38.635 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-29T11:30:38.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-29T11:30:38.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-29T11:30:38.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-29T11:30:38.727 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-29T11:30:38.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-29T11:30:38.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-29T11:30:38.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-29T11:30:38.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-29T11:30:38.728 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-29T11:30:38.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-29T11:30:38.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-29T11:30:38.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-29T11:30:38.729 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-29T11:30:38.827 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-29T11:30:38.827 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-29T11:30:38.827 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-29T11:30:38.827 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-29T11:30:38.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-29T11:30:38.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-29T11:30:38.828 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-29T11:30:38.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-29T11:30:38.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-29T11:30:38.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-29T11:30:38.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-29T11:30:38.829 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-29T11:30:38.929 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-29T11:30:38.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-29T11:30:38.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-29T11:30:38.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-29T11:30:38.930 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-29T11:30:38.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-29T11:30:38.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-29T11:30:38.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-29T11:30:38.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-29T11:30:38.931 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-29T11:30:38.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-29T11:30:38.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-29T11:30:38.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-29T11:30:38.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-29T11:30:38.932 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-29T11:30:38.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-29T11:30:38.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-29T11:30:38.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-29T11:30:38.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-29T11:30:38.933 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-29T11:30:39.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-29T11:30:39.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-29T11:30:39.027 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-29T11:30:39.028 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-29T11:30:39.029 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-29T11:30:39.030 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-29T11:30:39.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-29T11:30:39.031 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-29T11:30:39.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-29T11:30:39.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-29T11:30:39.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-29T11:30:39.127 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-29T11:30:39.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-29T11:30:39.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-29T11:30:39.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-29T11:30:39.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-29T11:30:39.128 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-29T11:30:39.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-29T11:30:39.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-29T11:30:39.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-29T11:30:39.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-29T11:30:39.129 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-29T11:30:39.227 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-29T11:30:39.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-29T11:30:39.228 INFO:teuthology.orchestra.run.smithi182.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-29T11:30:47.926 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileJava 2019-11-29T11:30:47.927 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processResources 2019-11-29T11:30:47.927 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :classes 2019-11-29T11:30:48.327 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:48.327 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileTestJava 2019-11-29T11:30:48.327 INFO:teuthology.orchestra.run.smithi182.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T11:30:48.328 INFO:teuthology.orchestra.run.smithi182.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T11:30:48.426 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:48.427 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T11:30:48.427 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :testClasses 2019-11-29T11:30:55.326 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:55.326 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :test 2019-11-29T11:30:55.327 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:30:55.327 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-29T11:31:34.325 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:31:34.325 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-29T11:31:39.625 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:31:39.626 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-29T11:31:41.725 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:31:41.725 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-29T11:31:48.825 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:31:48.825 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-29T11:32:12.224 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:12.224 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-29T11:32:19.624 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:19.625 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-29T11:32:20.224 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:20.224 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-29T11:32:21.228 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:21.228 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-29T11:32:23.724 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:23.724 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-29T11:32:25.515 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:16:33.673 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.552 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:16:33.710 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.553 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:16:33.729 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.554 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:16:33.730 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.555 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:16:33.731 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.556 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:16:33.732 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.713 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:16:33.870 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.811 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:16:33.987 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:25.816 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:16:33.992 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:32:28.924 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:28.924 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-29T11:32:51.024 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:32:51.024 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-29T11:33:05.023 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:33:05.024 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-29T11:33:30.696 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:17:38.856 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.734 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:17:38.894 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.744 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:17:38.921 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.752 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:17:38.923 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.785 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:17:38.962 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.792 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:17:38.951 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.826 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:17:39.003 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.835 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:17:39.013 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:33:30.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:17:39.051 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:36:42.419 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:36:42.421 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-29T11:36:56.119 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:36:56.120 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-29T11:36:58.319 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:36:58.320 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-29T11:37:03.419 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:03.420 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-29T11:37:06.721 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:06.721 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-29T11:37:19.219 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:19.220 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-29T11:37:36.019 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:36.020 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-29T11:37:36.618 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:21:44.781 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.628 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:21:44.792 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.665 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:21:44.846 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.677 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:21:44.858 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.679 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:21:44.860 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.687 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:21:44.869 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.841 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:21:45.022 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.849 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:21:45.030 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:36.863 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:21:45.027 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:37:43.719 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:43.719 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-29T11:37:44.119 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:44.119 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-29T11:37:45.019 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:37:45.019 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-29T11:38:02.819 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:38:02.819 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-29T11:38:08.819 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:38:08.819 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-29T11:38:33.019 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:38:33.019 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-29T11:38:44.119 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:38:44.119 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-29T11:39:06.019 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:39:06.019 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-29T11:39:11.419 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:39:11.419 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-29T11:41:52.345 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:26:00.498 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.406 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:26:00.503 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.414 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:26:00.595 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.417 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:26:00.598 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.419 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:26:00.601 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.437 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:26:00.619 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.530 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:26:00.683 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.536 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:26:00.717 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:41:52.592 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:26:00.774 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:46:35.017 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:46:35.018 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-29T11:46:42.117 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:46:42.118 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-29T11:47:46.917 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:47:46.917 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-29T11:47:52.917 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:47:52.917 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-29T11:48:00.135 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:32:08.276 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.145 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:32:08.286 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.151 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:32:08.334 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.153 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:32:08.336 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.156 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:32:08.339 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.159 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:32:08.342 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.354 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:32:08.496 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.392 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:32:08.575 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:00.416 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:32:08.599 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:48:22.617 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:22.617 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-29T11:48:29.817 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:29.817 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-29T11:48:38.117 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:38.117 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-29T11:48:52.617 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:52.617 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-29T11:48:55.017 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:55.017 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-29T11:48:58.917 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:48:58.917 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-29T11:49:00.617 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:00.617 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-29T11:49:04.417 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:04.417 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-29T11:49:06.617 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:06.617 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-29T11:49:13.917 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:13.917 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-29T11:49:17.017 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:17.017 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-29T11:49:23.717 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:23.717 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-29T11:49:27.117 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:27.117 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-29T11:49:34.518 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:34.518 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-29T11:49:37.417 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:37.417 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-29T11:49:43.916 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:43.917 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-29T11:49:46.317 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:46.317 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-29T11:49:51.417 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:49:51.417 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-29T11:50:26.416 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:50:26.417 INFO:teuthology.orchestra.run.smithi182.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-29T11:50:34.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:50:34.510 INFO:teuthology.orchestra.run.smithi182.stdout:---------------------------------------------------------------------- 2019-11-29T11:50:34.510 INFO:teuthology.orchestra.run.smithi182.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-29T11:50:34.510 INFO:teuthology.orchestra.run.smithi182.stdout:---------------------------------------------------------------------- 2019-11-29T11:50:34.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:50:34.511 INFO:teuthology.orchestra.run.smithi182.stdout:BUILD SUCCESSFUL in 20m 4s 2019-11-29T11:50:34.511 INFO:teuthology.orchestra.run.smithi182.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-29T11:50:34.828 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:50:34.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.004+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:34.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.024+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:34.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.024+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.034+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.034+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.041+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.016 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.041+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.021 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.048+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:35.242 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.269+0000 7f66acb50ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:50:35.242 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.269+0000 7f66acb50ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:50:35.242 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.269+0000 7f66acb50ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:50:35.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.269+0000 7f66acb50ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:50:35.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.269+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.287+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:35.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.287+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.307+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:50:35.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.307+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.318+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:35.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.318+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.335+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:50:35.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.336+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.347+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.347+0000 7f66acb50ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:50:35.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.347+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.359+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.359+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.376+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:35.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.376+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.364 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.391+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:50:35.364 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.391+0000 7f66acb50ec0 20 zonegroup default 2019-11-29T11:50:35.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.391+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.397+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.397+0000 7f66acb50ec0 10 Cannot find current period zone using local zone 2019-11-29T11:50:35.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.397+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.406+0000 7f66acb50ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:35.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.406+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.390 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.417+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:35.390 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.417+0000 7f66acb50ec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:35.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.437+0000 7f66acb50ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:50:35.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.437+0000 7f66acb50ec0 20 zone default found 2019-11-29T11:50:35.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.437+0000 7f66acb50ec0 20 started sync module instance, tier type = 2019-11-29T11:50:35.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.437+0000 7f66acb50ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:50:35.867 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=0 2019-11-29T11:50:35.867 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=1 2019-11-29T11:50:35.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=2 2019-11-29T11:50:35.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=3 2019-11-29T11:50:35.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=4 2019-11-29T11:50:35.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.894+0000 7f66acb50ec0 20 add_watcher() i=5 2019-11-29T11:50:35.873 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.900+0000 7f66acb50ec0 20 add_watcher() i=6 2019-11-29T11:50:35.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.934+0000 7f66acb50ec0 20 add_watcher() i=7 2019-11-29T11:50:35.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.934+0000 7f66acb50ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:50:35.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.935+0000 7f666a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:50:35.919 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:35.946+0000 7f6693fff700 0 -- 172.21.15.182:0/3379386666 >> v2:172.21.15.114:3300/0 conn(0x558b90e28060 msgr2=0x558b90e513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:50:36.122 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:36.149+0000 7f6693fff700 0 --2- 172.21.15.182:0/3379386666 >> v2:172.21.15.114:3300/0 conn(0x558b90e28060 0x558b90e513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T11:50:36.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:36.180+0000 7f669a57e700 0 -- 172.21.15.182:0/2685319448 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x558b90e10a70 msgr2=0x558b90e28b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T11:50:37.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:37.999+0000 7f65e0ff9700 20 reqs_thread_entry: start 2019-11-29T11:50:37.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:37.999+0000 7f65da7fc700 20 reqs_thread_entry: start 2019-11-29T11:50:37.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:37.999+0000 7f66acb50ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:50:37.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.000+0000 7f65d8ff9700 20 reqs_thread_entry: start 2019-11-29T11:50:37.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.000+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:50:38.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.082+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.079 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.106+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:38.092 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.119+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.167+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:50:38.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.217+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.233+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:38.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.244+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.278+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:50:38.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.351+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.381+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:38.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.398+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.462+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:50:38.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.545+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:38.556 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.583+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:38.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.607+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:38.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.607+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.446', time=2019-11-29T13:35:25.543536+0000, chain.objs.size()=9 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.607+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.1 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.1_1 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.2 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.2_1 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.3 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.3_1 2019-11-29T11:50:38.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.4 2019-11-29T11:50:38.583 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.4_1 2019-11-29T11:50:38.583 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.608+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~mSHqCzQMz-Mae5o-BeZd9UnHAGM0ZZn.5 2019-11-29T11:50:38.937 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:38.963+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:39.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.085+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:50:39.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.142+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:39.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.163+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:39.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.674', time=2019-11-29T13:48:24.332494+0000, chain.objs.size()=9 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__multipart_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.1 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__shadow_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.1_1 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__multipart_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.2 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__shadow_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.2_1 2019-11-29T11:50:39.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__multipart_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.3 2019-11-29T11:50:39.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__shadow_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.3_1 2019-11-29T11:50:39.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__multipart_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.4 2019-11-29T11:50:39.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__shadow_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.4_1 2019-11-29T11:50:39.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.199+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.30__multipart_key1.2~P7_EOqPJ6ABzNWGbOnXOGdUpbKKvXxv.5 2019-11-29T11:50:39.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.609+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:39.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.728+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:50:39.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.767+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:39.758 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.785+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:39.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq', time=2019-11-29T13:31:33.461149+0000, chain.objs.size()=9 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__multipart_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.1 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__shadow_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.1_1 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__multipart_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.2 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__shadow_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.2_1 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__multipart_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.3 2019-11-29T11:50:39.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__shadow_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.3_1 2019-11-29T11:50:39.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__multipart_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.4 2019-11-29T11:50:39.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__shadow_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.4_1 2019-11-29T11:50:39.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.13__multipart_key1.2~LXh7k6yxp35YcN0Z7s7ueA8oFUPWCTq.5 2019-11-29T11:50:39.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.466', time=2019-11-29T13:36:40.922991+0000, chain.objs.size()=7 2019-11-29T11:50:39.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.808+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.1 2019-11-29T11:50:39.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.809+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.1_1 2019-11-29T11:50:39.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:39.809+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.1_2 2019-11-29T11:50:40.014 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.041+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.2 2019-11-29T11:50:40.015 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.041+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.2_1 2019-11-29T11:50:40.062 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.089+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.2_2 2019-11-29T11:50:40.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.089+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~qq_Lurk3uXh8j3cZnVFfBC-hCBySVZp.3 2019-11-29T11:50:40.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.249+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:40.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.332+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:50:40.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.373+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:40.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.398+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:40.381 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.408+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:40.416 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.443+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:50:40.459 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.485+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:40.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.500+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:40.485 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.511+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:40.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.511+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.430', time=2019-11-29T13:36:50.621275+0000, chain.objs.size()=5 2019-11-29T11:50:40.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.511+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.19__shadow_.I6PTCpDGXBI7dIlixjxENV6kZDaFnNz_1 2019-11-29T11:50:40.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.511+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.19__shadow_.I6PTCpDGXBI7dIlixjxENV6kZDaFnNz_2 2019-11-29T11:50:40.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.512+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.19__shadow_.I6PTCpDGXBI7dIlixjxENV6kZDaFnNz_3 2019-11-29T11:50:40.487 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.512+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.19__shadow_.I6PTCpDGXBI7dIlixjxENV6kZDaFnNz_4 2019-11-29T11:50:40.487 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.512+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.19__shadow_.I6PTCpDGXBI7dIlixjxENV6kZDaFnNz_5 2019-11-29T11:50:40.778 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.805+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:40.886 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:40.913+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:50:40.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.023+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:41.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.059+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:41.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:41.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.659', time=2019-11-29T13:47:49.131424+0000, chain.objs.size()=9 2019-11-29T11:50:41.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__multipart_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.1 2019-11-29T11:50:41.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__shadow_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.1_1 2019-11-29T11:50:41.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__multipart_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.2 2019-11-29T11:50:41.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__shadow_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.2_1 2019-11-29T11:50:41.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__multipart_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.3 2019-11-29T11:50:41.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__shadow_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.3_1 2019-11-29T11:50:41.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__multipart_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.4 2019-11-29T11:50:41.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__shadow_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.4_1 2019-11-29T11:50:41.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.079+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.29__multipart_key1.2~jiZMAVSQZuktUWLUMlFf0Me2AMAhBlJ.5 2019-11-29T11:50:41.313 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.340+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:41.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.438+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:50:41.457 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.484+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:41.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.503+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.521+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.521+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.454', time=2019-11-29T13:35:57.158717+0000, chain.objs.size()=9 2019-11-29T11:50:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.521+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.1 2019-11-29T11:50:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.1_1 2019-11-29T11:50:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.2 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.2_1 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.3 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.3_1 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.4 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.4_1 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~4NGeJIeWc7rygfwVrw-wx8AmcqjZdVD.5 2019-11-29T11:50:41.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.560', time=2019-11-29T13:38:35.610005+0000, chain.objs.size()=9 2019-11-29T11:50:41.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.1 2019-11-29T11:50:41.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.1_1 2019-11-29T11:50:41.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.522+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.2 2019-11-29T11:50:41.773 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.2_1 2019-11-29T11:50:41.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.3 2019-11-29T11:50:41.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.3_1 2019-11-29T11:50:41.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.4 2019-11-29T11:50:41.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.4_1 2019-11-29T11:50:41.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:41.800+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file.mpg.2~LCJDIu3iqv2XRmhdRQSs-JWh_Np5A0J.5 2019-11-29T11:50:41.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.000+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:42.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.081+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:50:42.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.125+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.142+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:42.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.150+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.183+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:50:42.258 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.285+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.278 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.305+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.417', time=2019-11-29T13:32:53.076282+0000, chain.objs.size()=9 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.1 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.1_1 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.2 2019-11-29T11:50:42.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.2_1 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.3 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.3_1 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.4 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.4_1 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.5 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.319+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.415', time=2019-11-29T13:32:59.564260+0000, chain.objs.size()=9 2019-11-29T11:50:42.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.1 2019-11-29T11:50:42.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.1_1 2019-11-29T11:50:42.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.2 2019-11-29T11:50:42.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.422+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.2_1 2019-11-29T11:50:42.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.422+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.3 2019-11-29T11:50:42.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.422+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.3_1 2019-11-29T11:50:42.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.424+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.4 2019-11-29T11:50:42.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.424+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__shadow_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.4_1 2019-11-29T11:50:42.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.424+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.17__multipart_key1.2~HKorkbbFKhzai9seVYj_ZV8JkbN5Njm.5 2019-11-29T11:50:42.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.688+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:42.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.776+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:50:42.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.824+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.812 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.839+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:42.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.847+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.876+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:50:42.904 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.931+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.918 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.945+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:42.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.953+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:42.971 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:42.998+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:50:43.037 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.063+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:43.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.089+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:43.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.112+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:43.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.112+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.559', time=2019-11-29T13:38:38.322558+0000, chain.objs.size()=9 2019-11-29T11:50:43.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.1 2019-11-29T11:50:43.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.1_1 2019-11-29T11:50:43.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.2 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.2_1 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.3 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.3_1 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.4 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__shadow_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.4_1 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.26__multipart_file2.mpg.2~6bp6CyA5hJUR3_7UhU_q2-UR2IzUnuv.5 2019-11-29T11:50:43.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.608', time=2019-11-29T13:43:23.295686+0000, chain.objs.size()=21 2019-11-29T11:50:43.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.1 2019-11-29T11:50:43.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.1_1 2019-11-29T11:50:43.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.113+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.2 2019-11-29T11:50:43.434 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.461+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.2_1 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.3 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.3_1 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.4 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.4_1 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.5 2019-11-29T11:50:43.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.5_1 2019-11-29T11:50:43.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.6 2019-11-29T11:50:43.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.6_1 2019-11-29T11:50:43.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.7 2019-11-29T11:50:43.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.668+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.7_1 2019-11-29T11:50:43.696 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.723+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.8 2019-11-29T11:50:43.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:43.755+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.8_1 2019-11-29T11:50:44.070 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.097+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.9 2019-11-29T11:50:44.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.097+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.9_1 2019-11-29T11:50:44.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.170+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.10 2019-11-29T11:50:44.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.170+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.10_1 2019-11-29T11:50:44.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.242+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~Nc53F13aFTiehZ19hT2M8iaa2ogiSzT.11 2019-11-29T11:50:44.301 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.328+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:44.416 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.443+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:50:44.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.503+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:44.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.523+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:44.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:44.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.460', time=2019-11-29T13:36:18.702566+0000, chain.objs.size()=7 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.1 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.1_1 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.1_2 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.2 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.2_1 2019-11-29T11:50:44.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.2_2 2019-11-29T11:50:44.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~sdfHMcYkZYqad05JRSEinuhtLkfzQgP.3 2019-11-29T11:50:44.732 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.759+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:44.831 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.857+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:50:44.880 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.907+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:44.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.921+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:44.913 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.472', time=2019-11-29T13:36:45.403984+0000, chain.objs.size()=7 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.1 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.1_1 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.1_2 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.2 2019-11-29T11:50:44.914 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.2_1 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.2_2 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~uwUe5O7JLKnkKna3GMmhoY5EEVjpOEh.3 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.628', time=2019-11-29T13:45:35.476721+0000, chain.objs.size()=16 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.1 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.1_1 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.1_2 2019-11-29T11:50:44.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.2 2019-11-29T11:50:44.916 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:44.940+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.2_1 2019-11-29T11:50:45.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.184+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.2_2 2019-11-29T11:50:45.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.198+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.3 2019-11-29T11:50:45.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.198+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.3_1 2019-11-29T11:50:45.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.241+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.3_2 2019-11-29T11:50:45.219 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.246+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.4 2019-11-29T11:50:45.219 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.246+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.4_1 2019-11-29T11:50:45.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.281+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.4_2 2019-11-29T11:50:45.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.281+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.5 2019-11-29T11:50:45.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.282+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.5_1 2019-11-29T11:50:45.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.5_2 2019-11-29T11:50:45.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~xGhkdkomkW9JrsdoLWLk1zIRBad7tvN.6 2019-11-29T11:50:45.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.518+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:45.583 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.610+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:50:45.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.670+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:45.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.685+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:45.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.697+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:45.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.727+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:50:45.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.782+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:45.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.797+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:45.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:45.783 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.386', time=2019-11-29T13:32:14.274590+0000, chain.objs.size()=9 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__multipart_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.1 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__shadow_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.1_1 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__multipart_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.2 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__shadow_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.2_1 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__multipart_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.3 2019-11-29T11:50:45.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__shadow_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.3_1 2019-11-29T11:50:45.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__multipart_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.4 2019-11-29T11:50:45.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__shadow_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.4_1 2019-11-29T11:50:45.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:45.810+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.15__multipart_key1.2~ica8sTxm1pwQPmIdSDtduzyrkAoN43L.5 2019-11-29T11:50:46.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.111+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:46.180 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.207+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:50:46.236 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.263+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.263 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.289+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:46.274 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.301+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.359+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:50:46.392 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.419+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.439+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:46.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:46.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj', time=2019-11-29T13:39:08.264725+0000, chain.objs.size()=5 2019-11-29T11:50:46.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.27__multipart_key1.2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj.7 2019-11-29T11:50:46.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.27__shadow_key1.2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj.7_1 2019-11-29T11:50:46.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.27__multipart_key1.2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj.10 2019-11-29T11:50:46.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.27__shadow_key1.2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj.10_1 2019-11-29T11:50:46.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.456+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.27__multipart_key1.2~XvJaIp9238bvqhH6b-ZiLdGCDE809lj.13 2019-11-29T11:50:46.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.646+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:46.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.729+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:50:46.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.812+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.842+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:46.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.859+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.920+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:50:46.947 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.974+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:46.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:46.996+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:47.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:47.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.528', time=2019-11-29T13:38:04.609633+0000, chain.objs.size()=9 2019-11-29T11:50:47.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__multipart_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.1 2019-11-29T11:50:47.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__shadow_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.1_1 2019-11-29T11:50:47.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__multipart_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.2 2019-11-29T11:50:47.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__shadow_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.2_1 2019-11-29T11:50:47.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__multipart_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.3 2019-11-29T11:50:47.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__shadow_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.3_1 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__multipart_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.4 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__shadow_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.4_1 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.25__multipart_key1.2~HciElb9nGtejBDyIPtlABYOMp0oE-Hg.5 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.636', time=2019-11-29T13:46:33.649823+0000, chain.objs.size()=16 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.1 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.1_1 2019-11-29T11:50:47.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.026+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.1_2 2019-11-29T11:50:47.270 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.296+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.2 2019-11-29T11:50:47.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.304+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.2_1 2019-11-29T11:50:47.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.311+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.2_2 2019-11-29T11:50:47.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.311+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.3 2019-11-29T11:50:47.329 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.356+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.3_1 2019-11-29T11:50:47.400 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.3_2 2019-11-29T11:50:47.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.4 2019-11-29T11:50:47.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.4_1 2019-11-29T11:50:47.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.4_2 2019-11-29T11:50:47.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.5 2019-11-29T11:50:47.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.427+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.5_1 2019-11-29T11:50:47.466 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.493+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.5_2 2019-11-29T11:50:47.485 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.512+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~bvbR1Or0LZqwBV9LlH6ZMqyxYAjUKzS.6 2019-11-29T11:50:47.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:47.975+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:48.034 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.061+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:50:48.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.101+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.122+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:48.110 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.137+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.167+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:50:48.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.231+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.252+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:48.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.260+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.278 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.305+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:50:48.328 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.355+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.375+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:48.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.387+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.426+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:50:48.465 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.492+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:48.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.517+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:48.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.620', time=2019-11-29T13:44:30.517288+0000, chain.objs.size()=19 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.1 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.1_1 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.2 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.2_1 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.3 2019-11-29T11:50:48.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.3_1 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.4 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.4_1 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.5 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.5_1 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.6 2019-11-29T11:50:48.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.535+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.6_1 2019-11-29T11:50:48.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.845+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.7 2019-11-29T11:50:48.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.845+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.7_1 2019-11-29T11:50:48.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.845+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.8 2019-11-29T11:50:48.819 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.845+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.8_1 2019-11-29T11:50:48.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.877+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.9 2019-11-29T11:50:48.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.877+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.9_1 2019-11-29T11:50:48.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:48.877+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~geVuEXv9KnD08OEaFax0BjTcmalqrp5.10 2019-11-29T11:50:49.135 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.162+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:49.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.257+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:50:49.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.310+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:49.307 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.334+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:49.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.344+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:49.366 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.393+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:50:49.425 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.452+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:49.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.475+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.595', time=2019-11-29T13:42:06.639296+0000, chain.objs.size()=21 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.1 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.1_1 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.2 2019-11-29T11:50:49.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.2_1 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.3 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.3_1 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.4 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.4_1 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.5 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.5_1 2019-11-29T11:50:49.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.6 2019-11-29T11:50:49.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.501+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.6_1 2019-11-29T11:50:49.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.984+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.7 2019-11-29T11:50:49.958 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.984+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.7_1 2019-11-29T11:50:49.965 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.992+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.8 2019-11-29T11:50:49.966 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.992+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.8_1 2019-11-29T11:50:49.966 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.992+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.9 2019-11-29T11:50:49.966 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.992+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.9_1 2019-11-29T11:50:49.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.10 2019-11-29T11:50:49.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.10_1 2019-11-29T11:50:49.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~NVqa7CuU9-6QeYUP49ou7GVSxIdHE3R.11 2019-11-29T11:50:49.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.644', time=2019-11-29T13:46:36.575348+0000, chain.objs.size()=16 2019-11-29T11:50:49.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.1 2019-11-29T11:50:49.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:49.995+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.1_1 2019-11-29T11:50:50.259 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.1_2 2019-11-29T11:50:50.259 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.2 2019-11-29T11:50:50.259 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.2_1 2019-11-29T11:50:50.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.2_2 2019-11-29T11:50:50.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.3 2019-11-29T11:50:50.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.3_1 2019-11-29T11:50:50.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.286+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.3_2 2019-11-29T11:50:50.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.4 2019-11-29T11:50:50.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.4_1 2019-11-29T11:50:50.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.333+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.4_2 2019-11-29T11:50:50.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.333+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.5 2019-11-29T11:50:50.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.611+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.5_1 2019-11-29T11:50:50.585 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.611+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__shadow_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.5_2 2019-11-29T11:50:50.669 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.696+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.28__multipart_key1.2~nIinq9OCgJ52KSYZ3IKub4gyemEFsLk.6 2019-11-29T11:50:50.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.797+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:50.878 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.905+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:50:50.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.975+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:50.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:50.995+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.438', time=2019-11-29T13:34:51.258269+0000, chain.objs.size()=9 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.1 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.1_1 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.2 2019-11-29T11:50:50.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.2_1 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.3 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.3_1 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.4 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__shadow_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.4_1 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.20__multipart_key1.2~AO3BFuqWZ3sJc8Ez2XWZyr-CNA9hn7b.5 2019-11-29T11:50:50.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT', time=2019-11-29T13:48:48.439035+0000, chain.objs.size()=28 2019-11-29T11:50:50.998 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.1 2019-11-29T11:50:50.998 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.2 2019-11-29T11:50:50.998 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.022+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.3 2019-11-29T11:50:51.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.4 2019-11-29T11:50:51.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.5 2019-11-29T11:50:51.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.6 2019-11-29T11:50:51.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.7 2019-11-29T11:50:51.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.8 2019-11-29T11:50:51.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.319+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.9 2019-11-29T11:50:51.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.10 2019-11-29T11:50:51.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.320+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.11 2019-11-29T11:50:51.300 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.327+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.12 2019-11-29T11:50:51.300 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.327+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.13 2019-11-29T11:50:51.300 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.327+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.14 2019-11-29T11:50:51.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.446+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.WqbF51x57OAh_3dk7L4n5HvwdbSeuQ3.15 2019-11-29T11:50:51.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.446+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1._Of7I5joJK4sdJgDRmgvkvjb78CK2Vj.16 2019-11-29T11:50:51.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.447+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.Nxk51QJMRBXIIETV604lK3S97kiMKmj.17 2019-11-29T11:50:51.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.447+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.gnwUeuCK7fg95th06grMjqbAE7us9Dj.18 2019-11-29T11:50:51.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.qx8jOtS6wNyd8IrHWcHJFn49GC0P8yC.19 2019-11-29T11:50:51.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.vuVonsv2r9rlWHu9A1e3hKYdQfInQ-9.20 2019-11-29T11:50:51.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.21 2019-11-29T11:50:51.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.22 2019-11-29T11:50:51.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.23 2019-11-29T11:50:51.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.24 2019-11-29T11:50:51.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.477+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.25 2019-11-29T11:50:51.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.571+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.26 2019-11-29T11:50:51.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.571+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.27 2019-11-29T11:50:51.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.571+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.31__multipart_key1.2~6BkmWykNG57PwFMRoDA8CFosXlTPnLT.28 2019-11-29T11:50:51.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.662+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:51.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.781+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:50:51.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.857+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:51.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.880+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:51.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.892+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:51.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.926+0000 7f66acb50ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:50:51.947 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.974+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:51.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:51.989+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:51.983 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.509', time=2019-11-29T13:37:37.654090+0000, chain.objs.size()=9 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__multipart_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.1 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__shadow_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.1_1 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__multipart_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.2 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__shadow_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.2_1 2019-11-29T11:50:51.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__multipart_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.3 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__shadow_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.3_1 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__multipart_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.4 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__shadow_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.4_1 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.24__multipart_key1.2~7RW3kb0RfblMEBIVRuNdedkMUJ6tMOq.5 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.833', time=2019-11-29T13:50:28.505736+0000, chain.objs.size()=21 2019-11-29T11:50:51.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.1 2019-11-29T11:50:51.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.1_1 2019-11-29T11:50:51.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.009+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.2 2019-11-29T11:50:52.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.2_1 2019-11-29T11:50:52.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.3 2019-11-29T11:50:52.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.3_1 2019-11-29T11:50:52.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.4 2019-11-29T11:50:52.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.4_1 2019-11-29T11:50:52.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.351+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.5 2019-11-29T11:50:52.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.527+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.5_1 2019-11-29T11:50:52.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.527+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.6 2019-11-29T11:50:52.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.527+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.6_1 2019-11-29T11:50:52.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.527+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.7 2019-11-29T11:50:52.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.527+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.7_1 2019-11-29T11:50:52.541 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.568+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.8 2019-11-29T11:50:52.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.670+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.8_1 2019-11-29T11:50:52.644 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.670+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.9 2019-11-29T11:50:52.644 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.670+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.9_1 2019-11-29T11:50:52.644 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.670+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.10 2019-11-29T11:50:52.644 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.670+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__shadow_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.10_1 2019-11-29T11:50:52.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.716+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.39__multipart_key1.2~EDxp9fq1HJKzas6j7c2SNokWBKtrQPQ.11 2019-11-29T11:50:52.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:52.876+0000 7f66acb50ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T11:50:53.022 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.049+0000 7f66acb50ec0 20 remove_watcher() i=0 2019-11-29T11:50:53.022 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.049+0000 7f66acb50ec0 2 removed watcher, disabling cache 2019-11-29T11:50:53.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.092+0000 7f66acb50ec0 20 remove_watcher() i=1 2019-11-29T11:50:53.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.128+0000 7f66acb50ec0 20 remove_watcher() i=2 2019-11-29T11:50:53.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.200+0000 7f66acb50ec0 20 remove_watcher() i=3 2019-11-29T11:50:53.237 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.264+0000 7f66acb50ec0 20 remove_watcher() i=4 2019-11-29T11:50:53.286 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.313+0000 7f66acb50ec0 20 remove_watcher() i=5 2019-11-29T11:50:53.335 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.362+0000 7f66acb50ec0 20 remove_watcher() i=6 2019-11-29T11:50:53.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.406+0000 7f66acb50ec0 20 remove_watcher() i=7 2019-11-29T11:50:53.390 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:50:53.554 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.581+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.574 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.601+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.575 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.601+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.613+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.613+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.619+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.619+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.600 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.627+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:53.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.897+0000 7f3acc87aec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:50:53.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.897+0000 7f3acc87aec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:50:53.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.897+0000 7f3acc87aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:50:53.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.897+0000 7f3acc87aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:50:53.871 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.897+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.907+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:53.880 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.907+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.925+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:50:53.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.925+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.906 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.933+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:53.906 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.933+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.944+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:50:53.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.944+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.928 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.954+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.928 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.955+0000 7f3acc87aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:50:53.928 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.955+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.962+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.962+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.971+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:53.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.971+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.987+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:50:53.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.987+0000 7f3acc87aec0 20 zonegroup default 2019-11-29T11:50:53.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.987+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.967 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.994+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.967 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.994+0000 7f3acc87aec0 10 Cannot find current period zone using local zone 2019-11-29T11:50:53.967 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:53.994+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.002+0000 7f3acc87aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:50:53.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.002+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:53.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.011+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:50:53.984 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.011+0000 7f3acc87aec0 20 rados->read ofs=0 len=0 2019-11-29T11:50:54.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.027+0000 7f3acc87aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:50:54.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.027+0000 7f3acc87aec0 20 zone default found 2019-11-29T11:50:54.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.027+0000 7f3acc87aec0 20 started sync module instance, tier type = 2019-11-29T11:50:54.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.027+0000 7f3acc87aec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:50:54.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=0 2019-11-29T11:50:54.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=1 2019-11-29T11:50:54.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=2 2019-11-29T11:50:54.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=3 2019-11-29T11:50:54.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=4 2019-11-29T11:50:54.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.447+0000 7f3acc87aec0 20 add_watcher() i=5 2019-11-29T11:50:54.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.472+0000 7f3acc87aec0 20 add_watcher() i=6 2019-11-29T11:50:54.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.480+0000 7f3acc87aec0 20 add_watcher() i=7 2019-11-29T11:50:54.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.480+0000 7f3acc87aec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:50:54.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.480+0000 7f3a8a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:50:54.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.485+0000 7f3aba2a8700 0 -- 172.21.15.182:0/1541269268 >> v2:172.21.15.114:3300/0 conn(0x557c359d5e20 msgr2=0x557c359e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:50:54.504 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:54.531+0000 7f3ab92a6700 0 -- 172.21.15.182:0/889604112 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x557c35a12920 msgr2=0x557c35a19220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:50:56.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.112+0000 7f3a00ff9700 20 reqs_thread_entry: start 2019-11-29T11:50:56.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.112+0000 7f39fa7fc700 20 reqs_thread_entry: start 2019-11-29T11:50:56.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.112+0000 7f3acc87aec0 20 init_complete bucket index max shards: 0 2019-11-29T11:50:56.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.113+0000 7f39f8ff9700 20 reqs_thread_entry: start 2019-11-29T11:50:56.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.113+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:50:56.132 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.159+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.176+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.188+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.225+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:50:56.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.265+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.253 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.280+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.289+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.289 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.316+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:50:56.376 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.403+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.404 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.431+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.422 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.449+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.500+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:50:56.540 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.567+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.563 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.590+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.603+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.668+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:50:56.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.727+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.748+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.731 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.758+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.809+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:50:56.893 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.920+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.948+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:56.932 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:56.959+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:56.974 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.001+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:50:57.024 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.051+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.046 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.073+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.067 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.094+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.108 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.135+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:50:57.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.184+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.199+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.181 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.208+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.252+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:50:57.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.309+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.324+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.333+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.384+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:50:57.414 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.441+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.431 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.458+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.467+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.516+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:50:57.534 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.561+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.549 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.576+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.588+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.619+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:50:57.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.663+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.678+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.663 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.690+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.741+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:50:57.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.812+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.803 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.830+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.838+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.863 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.890+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:50:57.922 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.949+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:57.949 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.976+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:57.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:57.991+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.024 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.051+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:50:58.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.113+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.130+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.139+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.173+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:50:58.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.236+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.256+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.239 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.266+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.282 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.309+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:50:58.367 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.394+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.414+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.423+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.463+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:50:58.474 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.501+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.518+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.501 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.528+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.534 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.561+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:50:58.646 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.673+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.726+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.710 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.737+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.751 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.779+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:50:58.803 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.830+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.849+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.856+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.871 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.898+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:50:58.937 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.964+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.979+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:58.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:58.988+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:58.999 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.026+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:50:59.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.101+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.129+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.147+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.203+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:50:59.253 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.280+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.303+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.314+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.349+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:50:59.374 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.401+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.389 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.416+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.398 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.425+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.435 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.462+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:50:59.520 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.547+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.571+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.557 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.585+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.629+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:50:59.647 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.674+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.666 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.693+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.674 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.701+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.716 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.743+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:50:59.778 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.805+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.823+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.805 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.832+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.852 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.880+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:50:59.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.925+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.917 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.944+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:50:59.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.954+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:50:59.967 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:50:59.994+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:51:00.040 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.067+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.088+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:00.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.105+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.134 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.161+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:51:00.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.211+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.231+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:00.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.243+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.270 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.297+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:51:00.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.348+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.387+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:00.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.396+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.438+0000 7f3acc87aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:51:00.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.475+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.465 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.492+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:00.474 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.501+0000 7f3acc87aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:00.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.603+0000 7f3acc87aec0 20 remove_watcher() i=0 2019-11-29T11:51:00.576 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.603+0000 7f3acc87aec0 2 removed watcher, disabling cache 2019-11-29T11:51:00.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.647+0000 7f3acc87aec0 20 remove_watcher() i=1 2019-11-29T11:51:00.680 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.707+0000 7f3acc87aec0 20 remove_watcher() i=2 2019-11-29T11:51:00.729 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.756+0000 7f3acc87aec0 20 remove_watcher() i=3 2019-11-29T11:51:00.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.825+0000 7f3acc87aec0 20 remove_watcher() i=4 2019-11-29T11:51:00.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.876+0000 7f3acc87aec0 20 remove_watcher() i=5 2019-11-29T11:51:00.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.923+0000 7f3acc87aec0 20 remove_watcher() i=6 2019-11-29T11:51:00.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:00.968+0000 7f3acc87aec0 20 remove_watcher() i=7 2019-11-29T11:51:00.949 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:51:01.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.082+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.078 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.105+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.078 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.105+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.115+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.115+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.093 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.120+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.093 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.120+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.129+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:01.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.375+0000 7f4f96548ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:51:01.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.375+0000 7f4f96548ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:51:01.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.375+0000 7f4f96548ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:51:01.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.375+0000 7f4f96548ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:51:01.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.375+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.361 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.388+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:01.361 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.388+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.398+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:51:01.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.398+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.384 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.411+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:01.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.411+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.420+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:51:01.394 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.420+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.407 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.434+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.434+0000 7f4f96548ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:51:01.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.434+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.417 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.444+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.417 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.444+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.456+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:01.430 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.456+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.472+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:51:01.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.472+0000 7f4f96548ec0 20 zonegroup default 2019-11-29T11:51:01.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.472+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.478+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.478+0000 7f4f96548ec0 10 Cannot find current period zone using local zone 2019-11-29T11:51:01.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.478+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.485+0000 7f4f96548ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:01.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.485+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.465 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.492+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:01.465 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.492+0000 7f4f96548ec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:01.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.507+0000 7f4f96548ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:51:01.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.507+0000 7f4f96548ec0 20 zone default found 2019-11-29T11:51:01.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.507+0000 7f4f96548ec0 20 started sync module instance, tier type = 2019-11-29T11:51:01.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.507+0000 7f4f96548ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:51:01.845 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=0 2019-11-29T11:51:01.845 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=1 2019-11-29T11:51:01.845 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=2 2019-11-29T11:51:01.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=3 2019-11-29T11:51:01.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=4 2019-11-29T11:51:01.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=5 2019-11-29T11:51:01.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.872+0000 7f4f96548ec0 20 add_watcher() i=6 2019-11-29T11:51:01.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.902+0000 7f4f96548ec0 20 add_watcher() i=7 2019-11-29T11:51:01.876 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.902+0000 7f4f96548ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:51:01.876 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.903+0000 7f4f53fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:51:01.881 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.908+0000 7f4f83775700 0 -- 172.21.15.182:0/276128636 >> v1:172.21.15.114:6789/0 conn(0x55fcfb256ff0 legacy=0x55fcfb2535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T11:51:01.916 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:01.943+0000 7f4f83775700 0 -- 172.21.15.182:0/2612305911 >> [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] conn(0x55fcfb28e420 msgr2=0x55fcfb290840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:51:03.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.375+0000 7f4ec27fc700 20 reqs_thread_entry: start 2019-11-29T11:51:03.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.375+0000 7f4ebbfff700 20 reqs_thread_entry: start 2019-11-29T11:51:03.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.375+0000 7f4f96548ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:51:03.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.376+0000 7f4eba7fc700 20 reqs_thread_entry: start 2019-11-29T11:51:03.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.376+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:51:03.439 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.466+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.466 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.493+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:03.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.507+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.530 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.557+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:51:03.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.649+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.669+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:03.650 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.677+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.696 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.723+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:51:03.768 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.795+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.817+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:03.805 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.832+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.883 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.910+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:51:03.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.973+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:03.966 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:03.993+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:03.977 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.004+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.133 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.159+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:51:04.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.212+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.230+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.238+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.253 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.280+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:51:04.303 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.330+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.319 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.346+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.328 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.355+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.389+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:51:04.425 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.452+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.467+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.476+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.524+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:51:04.590 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.617+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.643+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.633 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.660+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.716+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:51:04.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.782+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.801+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.812+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.852+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:51:04.918 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.945+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:04.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.977+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:04.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:04.991+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.018 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.045+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:51:05.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.112+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.132+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.143+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.185+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:51:05.224 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.251+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.242 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.269+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.277+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.336+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:51:05.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.396+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.415+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.401 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.427+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.437 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.464+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:51:05.479 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.506+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.495 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.522+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.506 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.533+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.578+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:51:05.596 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.623+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.641+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.650+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.655 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.682+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:51:05.725 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.752+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.755 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.782+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.799+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.827 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.854+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:51:05.884 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.911+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.936+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:05.926 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.953+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:05.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:05.996+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:51:06.044 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.071+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.090+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.080 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.107+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.122 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.149+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:51:06.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.212+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.231+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.239+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.241 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.268+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:51:06.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.321+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.336+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.323 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.350+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.380+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:51:06.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.442+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.437 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.464+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.473+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.544+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:51:06.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.599+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.614+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.622+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.633 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.660+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:51:06.679 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.706+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.696 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.723+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.735+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.759 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.786+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:51:06.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.828+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.819 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.846+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.857+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.888+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:51:06.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.923+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.912 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.939+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:06.920 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.947+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:06.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:06.979+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:51:07.009 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.036+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.028 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.055+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.063+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.111+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:51:07.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.187+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.225+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.245+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.302 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.328+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:51:07.356 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.382+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.377 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.404+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.387 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.414+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.456+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:51:07.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.523+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.523 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.550+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.537 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.564+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.605 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.632+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:51:07.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.714+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.709 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.736+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.747+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.792+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:51:07.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.848+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.841 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.868+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:07.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.880+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:07.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.915+0000 7f4f96548ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:51:07.968 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:07.995+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:08.007 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.034+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:08.022 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.049+0000 7f4f96548ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:08.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.147+0000 7f4f96548ec0 20 remove_watcher() i=0 2019-11-29T11:51:08.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.147+0000 7f4f96548ec0 2 removed watcher, disabling cache 2019-11-29T11:51:08.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.187+0000 7f4f96548ec0 20 remove_watcher() i=1 2019-11-29T11:51:08.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.250+0000 7f4f96548ec0 20 remove_watcher() i=2 2019-11-29T11:51:08.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.316+0000 7f4f96548ec0 20 remove_watcher() i=3 2019-11-29T11:51:08.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.384+0000 7f4f96548ec0 20 remove_watcher() i=4 2019-11-29T11:51:08.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.440+0000 7f4f96548ec0 20 remove_watcher() i=5 2019-11-29T11:51:08.468 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.495+0000 7f4f96548ec0 20 remove_watcher() i=6 2019-11-29T11:51:08.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.549+0000 7f4f96548ec0 20 remove_watcher() i=7 2019-11-29T11:51:08.532 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:51:08.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.687+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:08.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.718+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:08.691 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.718+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:08.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.729+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:08.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.729+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:08.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.735+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:08.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.735+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:08.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.748+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:08.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.999+0000 7fef9512aec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:51:08.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.999+0000 7fef9512aec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:51:08.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.999+0000 7fef9512aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:51:08.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.999+0000 7fef9512aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:51:08.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:08.999+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:08.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.009+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:08.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.009+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.029+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:51:09.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.029+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.016 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.043+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:09.016 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.043+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.035 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.062+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:51:09.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.062+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.046 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.073+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:09.046 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.073+0000 7fef9512aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:51:09.046 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.073+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.081+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:09.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.081+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.090+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:09.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.090+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.109+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:51:09.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.109+0000 7fef9512aec0 20 zonegroup default 2019-11-29T11:51:09.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.109+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.116+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:09.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.116+0000 7fef9512aec0 10 Cannot find current period zone using local zone 2019-11-29T11:51:09.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.116+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.126+0000 7fef9512aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:51:09.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.126+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.111 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.138+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:51:09.111 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.138+0000 7fef9512aec0 20 rados->read ofs=0 len=0 2019-11-29T11:51:09.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.157+0000 7fef9512aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:51:09.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.157+0000 7fef9512aec0 20 zone default found 2019-11-29T11:51:09.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.157+0000 7fef9512aec0 20 started sync module instance, tier type = 2019-11-29T11:51:09.131 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.157+0000 7fef9512aec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:51:09.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=0 2019-11-29T11:51:09.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=1 2019-11-29T11:51:09.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=2 2019-11-29T11:51:09.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=3 2019-11-29T11:51:09.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=4 2019-11-29T11:51:09.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=5 2019-11-29T11:51:09.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.502+0000 7fef9512aec0 20 add_watcher() i=6 2019-11-29T11:51:09.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.535+0000 7fef9512aec0 20 add_watcher() i=7 2019-11-29T11:51:09.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.535+0000 7fef9512aec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:51:09.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.535+0000 7fef52fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:51:09.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.538+0000 7fef82357700 0 -- 172.21.15.182:0/3190243095 >> v1:172.21.15.114:6789/0 conn(0x55a85a3053a0 legacy=0x55a85a3013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:51:09.555 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:09.582+0000 7fef82b58700 0 -- 172.21.15.182:0/3410783514 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7feec4017570 msgr2=0x7feec4019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:51:10.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.928+0000 7feec17fa700 20 reqs_thread_entry: start 2019-11-29T11:51:10.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.928+0000 7feebaffd700 20 reqs_thread_entry: start 2019-11-29T11:51:10.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.928+0000 7fef9512aec0 20 init_complete bucket index max shards: 0 2019-11-29T11:51:10.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.929+0000 7feeb97fa700 20 reqs_thread_entry: start 2019-11-29T11:51:10.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.929+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:51:10.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:10.983+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:10.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.000+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:10.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.013+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.020 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.047+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:51:11.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.140+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.171+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.193+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.236+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:51:11.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.307+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.303 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.330+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.316 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.343+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.358 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.384+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:51:11.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.433+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.433 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.459+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.442 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.469+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.516+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:51:11.526 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.553+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.540 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.567+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.575+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.716+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:51:11.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.764+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.753 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.781+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.792+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.828+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:51:11.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.881+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.895+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:11.876 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.903+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.915 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:11.942+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:51:11.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.003+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:11.993 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.020+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.005 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.029+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.042 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.069+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:51:12.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.116+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.131+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.140+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.178+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:51:12.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.223+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.236+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.245+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.248 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.275+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:51:12.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.314+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.302 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.328+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.310 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.337+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.390+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:51:12.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.442+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.437 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.464+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.474+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.499 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.526+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:51:12.571 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.598+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.668+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.687+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.748+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:51:12.781 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.808+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.803 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.830+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:12.822 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.849+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.886+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:51:12.953 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:12.980+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:12.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.009+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.003 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.030+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.085+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:51:13.124 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.152+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.176+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.158 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.186+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.224+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:51:13.240 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.267+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.282+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.290+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.324+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:51:13.402 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.429+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.463+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.462 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.489+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.509 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.536+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:51:13.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.622+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.629 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.656+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.677+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.719 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.746+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:51:13.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.823+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.812 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.839+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.847+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.897+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:51:13.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.954+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:13.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.983+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:13.971 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:13.998+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.011 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.038+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:51:14.049 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.076+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.067 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.094+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.103+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.139+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:51:14.168 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.195+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.210+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.191 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.218+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.232 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.259+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:51:14.303 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.330+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.359+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.374+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.396 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.423+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:51:14.438 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.465+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.467 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.494+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.504+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.548+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:51:14.594 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.621+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.648+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.635 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.663+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.702+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:51:14.732 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.759+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.748 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.776+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.758 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.786+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.829+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:51:14.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.916+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.948+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:14.933 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.961+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:14.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:14.999+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:51:15.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.063+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.062 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.089+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:15.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.099+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.115 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.142+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:51:15.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.204+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.226+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:15.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.238+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.284+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:51:15.301 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.327+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.316 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.343+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:15.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.351+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.356 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.383+0000 7fef9512aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:51:15.404 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.431+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.422 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.449+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:51:15.433 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.460+0000 7fef9512aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:51:15.530 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.557+0000 7fef9512aec0 20 remove_watcher() i=0 2019-11-29T11:51:15.530 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.557+0000 7fef9512aec0 2 removed watcher, disabling cache 2019-11-29T11:51:15.571 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.598+0000 7fef9512aec0 20 remove_watcher() i=1 2019-11-29T11:51:15.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.633+0000 7fef9512aec0 20 remove_watcher() i=2 2019-11-29T11:51:15.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.699+0000 7fef9512aec0 20 remove_watcher() i=3 2019-11-29T11:51:15.729 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.756+0000 7fef9512aec0 20 remove_watcher() i=4 2019-11-29T11:51:15.830 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.857+0000 7fef9512aec0 20 remove_watcher() i=5 2019-11-29T11:51:15.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.924+0000 7fef9512aec0 20 remove_watcher() i=6 2019-11-29T11:51:15.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:51:15.980+0000 7fef9512aec0 20 remove_watcher() i=7 2019-11-29T11:51:15.961 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-29T11:51:16.710 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :clean 2019-11-29T11:51:17.308 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileJava 2019-11-29T11:51:17.308 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processResources 2019-11-29T11:51:17.308 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :classes 2019-11-29T11:51:17.609 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:17.609 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileTestJava 2019-11-29T11:51:17.609 INFO:teuthology.orchestra.run.smithi182.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T11:51:17.609 INFO:teuthology.orchestra.run.smithi182.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T11:51:17.609 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:17.610 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T11:51:17.610 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :testClasses 2019-11-29T11:51:19.608 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:19.608 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :test 2019-11-29T11:51:19.609 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:19.609 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-29T11:51:22.908 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:22.908 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-29T11:51:28.708 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:28.708 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-29T11:51:31.408 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:31.408 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-29T11:51:37.008 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:37.008 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-29T11:51:40.008 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:40.008 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-29T11:51:45.708 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:45.708 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-29T11:51:51.708 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:51.708 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-29T11:51:53.208 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:53.208 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-29T11:51:57.308 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:51:57.308 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-29T11:52:02.608 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:02.608 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-29T11:52:02.809 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:02.809 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-29T11:52:03.808 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:03.808 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-29T11:52:10.708 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:10.708 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-29T11:52:22.408 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:22.408 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-29T11:52:25.308 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:25.308 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-29T11:52:31.507 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:31.508 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-29T11:52:31.708 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:31.708 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-29T11:52:32.704 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:32.705 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------- 2019-11-29T11:52:32.705 INFO:teuthology.orchestra.run.smithi182.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-29T11:52:32.705 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------- 2019-11-29T11:52:32.705 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:52:32.705 INFO:teuthology.orchestra.run.smithi182.stdout:BUILD SUCCESSFUL in 1m 16s 2019-11-29T11:52:32.706 INFO:teuthology.orchestra.run.smithi182.stdout:5 actionable tasks: 5 executed 2019-11-29T11:52:32.721 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:52:32.834 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.862+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:32.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.880+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:32.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.880+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:32.863 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.890+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:32.863 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.890+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:32.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.896+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:32.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.896+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:32.875 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:32.903+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:33.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.150+0000 7fd4a5a5bec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:52:33.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.150+0000 7fd4a5a5bec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:52:33.124 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.150+0000 7fd4a5a5bec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:52:33.124 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.150+0000 7fd4a5a5bec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:52:33.124 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.150+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.137 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.164+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:33.137 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.164+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.182+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:33.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.182+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.169 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.196+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:33.169 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.196+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.216+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:33.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.216+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.202 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.229+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:33.202 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.229+0000 7fd4a5a5bec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:52:33.202 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.229+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.241+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:33.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.241+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.227 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.255+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:33.228 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.255+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.246 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.274+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:33.247 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.274+0000 7fd4a5a5bec0 20 zonegroup default 2019-11-29T11:52:33.247 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.274+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.282+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:33.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.282+0000 7fd4a5a5bec0 10 Cannot find current period zone using local zone 2019-11-29T11:52:33.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.282+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.289+0000 7fd4a5a5bec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:33.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.289+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.298+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:33.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.298+0000 7fd4a5a5bec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:33.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.314+0000 7fd4a5a5bec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:33.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.314+0000 7fd4a5a5bec0 20 zone default found 2019-11-29T11:52:33.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.314+0000 7fd4a5a5bec0 20 started sync module instance, tier type = 2019-11-29T11:52:33.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.314+0000 7fd4a5a5bec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:52:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=0 2019-11-29T11:52:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=1 2019-11-29T11:52:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=2 2019-11-29T11:52:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=3 2019-11-29T11:52:33.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=4 2019-11-29T11:52:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=5 2019-11-29T11:52:33.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.710+0000 7fd4a5a5bec0 20 add_watcher() i=6 2019-11-29T11:52:33.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.755+0000 7fd4a5a5bec0 20 add_watcher() i=7 2019-11-29T11:52:33.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.755+0000 7fd4a5a5bec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:52:33.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.755+0000 7fd4637de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:52:33.731 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.758+0000 7fd48bfff700 0 -- 172.21.15.182:0/3343881000 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55d67260e170 msgr2=0x55d67260b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:52:33.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:33.800+0000 7fd493489700 0 -- 172.21.15.182:0/257770916 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7fd3d4017580 msgr2=0x7fd3d4019a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:52:35.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.131+0000 7fd3d1ffb700 20 reqs_thread_entry: start 2019-11-29T11:52:35.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.131+0000 7fd3cb7fe700 20 reqs_thread_entry: start 2019-11-29T11:52:35.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.132+0000 7fd4a5a5bec0 20 init_complete bucket index max shards: 0 2019-11-29T11:52:35.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.132+0000 7fd3c9ffb700 20 reqs_thread_entry: start 2019-11-29T11:52:35.105 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.132+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:52:35.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.180+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.169 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.196+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.178 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.205+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.238+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:52:35.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.321+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.348+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.336 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.363+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.412+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:52:35.455 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.482+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.504+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.513+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.571+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:52:35.604 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.631+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.646+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.654+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.703+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:52:35.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.742+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.756+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.736 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.764+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.766 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.794+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:52:35.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.833+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.849+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.859+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.863 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.891+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:52:35.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.935+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.922 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.949+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:35.931 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.958+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:35.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:35.991+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:52:36.041 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.068+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.099+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.113+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.126 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.154+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:52:36.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.210+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.231+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.244+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.278+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:52:36.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.324+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.314 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.341+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.350+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.388+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:52:36.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.452+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.444 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.471+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.458 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.485+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.518+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:52:36.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.558+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.576+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.587+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.634+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:52:36.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.689+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.679 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.707+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.716+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.739 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.766+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:52:36.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.833+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.826 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.853+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.865+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.915+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:52:36.951 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:36.978+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:36.978 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.005+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:36.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.015+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.060+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:52:37.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.099+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.112+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.121+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.124 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.152+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:52:37.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.191+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.181 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.208+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.217+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.259+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:52:37.289 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.316+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.304 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.331+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.312 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.340+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.387+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:52:37.456 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.483+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.508+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.520+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.553 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.580+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:52:37.624 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.651+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.676+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.664 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.691+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.703 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.730+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:52:37.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.799+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.812 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.840+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.833 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.860+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.915+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:52:37.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:37.989+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:37.983 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.008+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:37.989 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.016+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.020 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.047+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:52:38.066 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.093+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.108+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.091 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.116+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.120 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.147+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:52:38.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.227+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.258+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.272+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.318+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:52:38.344 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.371+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.397+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.413+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.434 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.455+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:52:38.481 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.508+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.527+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.510 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.537+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.577+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:52:38.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.642+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.646 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.674+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.685+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.742+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:52:38.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.794+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.812+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.795 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.822+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.878+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:52:38.927 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.949+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:38.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.966+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:38.947 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:38.975+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.027+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:52:39.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.091+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.115+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:39.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.128+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.175+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:52:39.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.241+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.237 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.265+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:39.247 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.274+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.300 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.327+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:52:39.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.406+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.463+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:39.455 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.482+0000 7fd4a5a5bec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:39.574 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.601+0000 7fd4a5a5bec0 20 remove_watcher() i=0 2019-11-29T11:52:39.574 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.601+0000 7fd4a5a5bec0 2 removed watcher, disabling cache 2019-11-29T11:52:39.610 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.637+0000 7fd4a5a5bec0 20 remove_watcher() i=1 2019-11-29T11:52:39.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.676+0000 7fd4a5a5bec0 20 remove_watcher() i=2 2019-11-29T11:52:39.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.748+0000 7fd4a5a5bec0 20 remove_watcher() i=3 2019-11-29T11:52:39.771 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.798+0000 7fd4a5a5bec0 20 remove_watcher() i=4 2019-11-29T11:52:39.819 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.846+0000 7fd4a5a5bec0 20 remove_watcher() i=5 2019-11-29T11:52:39.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.893+0000 7fd4a5a5bec0 20 remove_watcher() i=6 2019-11-29T11:52:39.940 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:39.967+0000 7fd4a5a5bec0 20 remove_watcher() i=7 2019-11-29T11:52:39.948 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:52:40.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.102+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.128+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.128+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.110 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.137+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.110 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.137+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.143+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.143+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.150+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:40.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.321+0000 7f6728b55ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:52:40.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.321+0000 7f6728b55ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:52:40.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.321+0000 7f6728b55ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:52:40.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.321+0000 7f6728b55ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:52:40.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.321+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.335+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:40.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.335+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.352+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:40.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.352+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.360+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:40.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.360+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.380+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:40.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.380+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.387+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.387+0000 7f6728b55ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:52:40.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.387+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.393+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.393+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.374 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.401+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:40.374 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.401+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.391 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.418+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:40.392 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.418+0000 7f6728b55ec0 20 zonegroup default 2019-11-29T11:52:40.392 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.418+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.426+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.426+0000 7f6728b55ec0 10 Cannot find current period zone using local zone 2019-11-29T11:52:40.400 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.426+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.405 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.433+0000 7f6728b55ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:40.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.433+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.440+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:40.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.440+0000 7f6728b55ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:40.426 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.453+0000 7f6728b55ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:40.426 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.453+0000 7f6728b55ec0 20 zone default found 2019-11-29T11:52:40.427 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.453+0000 7f6728b55ec0 20 started sync module instance, tier type = 2019-11-29T11:52:40.427 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.453+0000 7f6728b55ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:52:40.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=0 2019-11-29T11:52:40.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=1 2019-11-29T11:52:40.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=2 2019-11-29T11:52:40.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=3 2019-11-29T11:52:40.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=4 2019-11-29T11:52:40.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.825+0000 7f6728b55ec0 20 add_watcher() i=5 2019-11-29T11:52:40.826 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.853+0000 7f6728b55ec0 20 add_watcher() i=6 2019-11-29T11:52:40.847 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.874+0000 7f6728b55ec0 20 add_watcher() i=7 2019-11-29T11:52:40.847 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.874+0000 7f6728b55ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:52:40.848 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.874+0000 7f66e67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:52:40.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:40.883+0000 7f6715d82700 0 -- 172.21.15.182:0/2752330136 >> v2:172.21.15.182:3300/0 conn(0x562a89229500 msgr2=0x562a89226810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:52:41.058 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:41.085+0000 7f6715d82700 0 --2- 172.21.15.182:0/2752330136 >> v2:172.21.15.182:3300/0 conn(0x562a89229500 0x562a89226810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T11:52:41.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:41.142+0000 7f6715d82700 0 -- 172.21.15.182:0/4150148847 >> v1:172.21.15.114:6789/0 conn(0x562a89220e40 legacy=0x562a891fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:52:42.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.519+0000 7f665cff9700 20 reqs_thread_entry: start 2019-11-29T11:52:42.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.520+0000 7f66567fc700 20 reqs_thread_entry: start 2019-11-29T11:52:42.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.520+0000 7f6728b55ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:52:42.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.520+0000 7f6654ff9700 20 reqs_thread_entry: start 2019-11-29T11:52:42.493 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.520+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:52:42.538 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.565+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.554 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.582+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:42.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.589+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.605 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.633+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:52:42.666 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.693+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.714+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:42.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.735+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.752 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.780+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:52:42.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.820+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.809 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.836+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:42.818 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.846+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.877+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:52:42.953 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:42.980+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:42.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.008+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:42.991 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.018+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.055 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.082+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:52:43.121 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.148+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.171+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.185+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.221+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:52:43.231 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.259+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.248 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.275+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.257 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.284+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.317+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:52:43.373 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.400+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.440+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.437 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.465+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.502 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.530+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:52:43.574 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.601+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.600 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.628+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.643+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.668 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.696+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:52:43.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.760+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.756 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.783+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.792+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.843+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:52:43.905 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.932+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:43.935 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.962+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:43.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:43.980+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.048 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.075+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:52:44.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.123+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.139+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.121 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.148+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.182+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:52:44.210 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.237+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.253+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.239 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.267+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.318+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:52:44.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.388+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.427+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.447+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.512+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:52:44.533 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.560+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.552 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.579+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.587+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.606 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.633+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:52:44.682 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.709+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.740+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.724 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.752+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.768 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.795+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:52:44.826 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.853+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.845 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.872+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:44.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.881+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:44.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:44.922+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:52:44.975 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.002+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.013 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.040+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.061+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.141+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:52:45.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.204+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.223+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.233+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.303+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:52:45.331 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.358+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.356 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.383+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.366 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.393+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.441+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:52:45.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.491+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.482 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.509+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.494 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.521+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.527 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.554+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:52:45.564 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.591+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.579 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.606+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.589 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.616+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.621 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.649+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:52:45.663 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.690+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.706+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.714+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.720 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.747+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:52:45.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.826+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.852+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.843 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.871+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.927+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:52:45.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:45.984+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:45.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.008+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:45.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.022+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.042 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.070+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:52:46.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.130+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.128 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.156+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.166+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.182 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.210+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:52:46.256 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.283+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.275 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.302+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.311+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.350+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:52:46.382 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.409+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.424+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.406 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.433+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.442 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.469+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:52:46.511 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.539+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.533 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.560+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.545 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.572+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.597 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.624+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:52:46.666 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.694+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.716+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.742+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.768 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.795+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:52:46.813 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.841+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.860+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.840 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.868+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.891 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.919+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:52:46.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.962+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.952 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.980+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:46.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:46.991+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:46.999 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.027+0000 7f6728b55ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:52:47.046 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.073+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:47.062 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.089+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:47.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.099+0000 7f6728b55ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:47.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.214+0000 7f6728b55ec0 20 remove_watcher() i=0 2019-11-29T11:52:47.187 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.214+0000 7f6728b55ec0 2 removed watcher, disabling cache 2019-11-29T11:52:47.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.254+0000 7f6728b55ec0 20 remove_watcher() i=1 2019-11-29T11:52:47.265 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.293+0000 7f6728b55ec0 20 remove_watcher() i=2 2019-11-29T11:52:47.335 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.362+0000 7f6728b55ec0 20 remove_watcher() i=3 2019-11-29T11:52:47.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.407+0000 7f6728b55ec0 20 remove_watcher() i=4 2019-11-29T11:52:47.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.448+0000 7f6728b55ec0 20 remove_watcher() i=5 2019-11-29T11:52:47.470 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.498+0000 7f6728b55ec0 20 remove_watcher() i=6 2019-11-29T11:52:47.523 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.550+0000 7f6728b55ec0 20 remove_watcher() i=7 2019-11-29T11:52:47.529 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:52:47.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.667+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.704+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.704+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.717+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.717+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.725+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.725+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.735+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.892+0000 7fd023e84ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.892+0000 7fd023e84ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.892+0000 7fd023e84ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.892+0000 7fd023e84ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.892+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.899+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.899+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.908+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.908+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.916+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.916+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.930+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:48.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.930+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.937+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.937+0000 7fd023e84ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.937+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.943+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.943+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.950+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.950+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.966+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.967+0000 7fd023e84ec0 20 zonegroup default 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.967+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.973+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.973+0000 7fd023e84ec0 10 Cannot find current period zone using local zone 2019-11-29T11:52:48.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.973+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.980+0000 7fd023e84ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.980+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.988+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.988+0000 7fd023e84ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.998+0000 7fd023e84ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:48.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.998+0000 7fd023e84ec0 20 zone default found 2019-11-29T11:52:48.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.998+0000 7fd023e84ec0 20 started sync module instance, tier type = 2019-11-29T11:52:48.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:47.998+0000 7fd023e84ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:52:48.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=0 2019-11-29T11:52:48.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=1 2019-11-29T11:52:48.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=2 2019-11-29T11:52:48.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=3 2019-11-29T11:52:48.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=4 2019-11-29T11:52:48.340 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=5 2019-11-29T11:52:48.340 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.366+0000 7fd023e84ec0 20 add_watcher() i=6 2019-11-29T11:52:48.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.406+0000 7fd023e84ec0 20 add_watcher() i=7 2019-11-29T11:52:48.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.406+0000 7fd023e84ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:52:48.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.407+0000 7fcfe1fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:52:48.382 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.409+0000 7fd0110b1700 0 -- 172.21.15.182:0/3578688385 >> v1:172.21.15.182:6789/0 conn(0x56303013c3b0 legacy=0x56303013e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:52:48.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:48.451+0000 7fd0118b2700 0 -- 172.21.15.182:0/2493500878 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7fcf54017580 msgr2=0x7fcf54019a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:52:49.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.827+0000 7fcf4bfff700 20 reqs_thread_entry: start 2019-11-29T11:52:49.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.828+0000 7fcf49ffb700 20 reqs_thread_entry: start 2019-11-29T11:52:49.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.828+0000 7fd023e84ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:52:49.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.828+0000 7fcf3bfff700 20 reqs_thread_entry: start 2019-11-29T11:52:49.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.828+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:52:49.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.876+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:49.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.893+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:49.876 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.904+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:49.911 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.939+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:52:49.959 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:49.985+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:49.973 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.001+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:49.983 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.011+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.027 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.054+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:52:50.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.098+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.114+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.122+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.168+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:52:50.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.216+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.233+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.242+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.247 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.275+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:52:50.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.320+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.336+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.318 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.346+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.359 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.386+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:52:50.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.440+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.431 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.459+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.467+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.483 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.510+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:52:50.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.558+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.578+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.563 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.586+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.627+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:52:50.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.667+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.682+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.663 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.690+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.719+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:52:50.727 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.754+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.769+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.777+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.809+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:52:50.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.856+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.877+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:50.861 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.888+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:50.928 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:50.955+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:52:50.995 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.020+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.017 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.044+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.030 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.058+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.104+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:52:51.134 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.161+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.200+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.182 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.210+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.244+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:52:51.301 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.328+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.342 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.370+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.361 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.388+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.423 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.450+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:52:51.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.513+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.504 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.531+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.521 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.548+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.559 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.586+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:52:51.609 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.636+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.652+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.632 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.660+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.665 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.692+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:52:51.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.761+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.757 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.784+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.798+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.835 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.863+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:52:51.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.930+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:51.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.958+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:51.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:51.981+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.029+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:52:52.054 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.082+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.100+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.081 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.109+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.125 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.152+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:52:52.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.212+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.208 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.235+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.220 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.248+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.299+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:52:52.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.349+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.366+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.347 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.375+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.403+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:52:52.425 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.452+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.439 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.466+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.475+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.488 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.515+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:52:52.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.596+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.594 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.621+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.608 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.635+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.679+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:52:52.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.739+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.732 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.757+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.769+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.811+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:52:52.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.880+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.882 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.909+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:52.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:52.925+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:52.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.000+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:52:53.038 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.065+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.060 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.088+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.073 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.100+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.131+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:52:53.175 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.203+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.208 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.235+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.251+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.307+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:52:53.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.402+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.430+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.442+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.518+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:52:53.551 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.579+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.573 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.601+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.585 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.612+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.634 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.661+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:52:53.681 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.708+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.698 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.726+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.734+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.745 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.772+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:52:53.809 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.836+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.828 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.855+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.865+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.895 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.922+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:52:53.933 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.961+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.948 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.975+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:53.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:53.984+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:53.990 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.018+0000 7fd023e84ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:52:54.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.098+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:54.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.130+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:54.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.146+0000 7fd023e84ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:54.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.276+0000 7fd023e84ec0 20 remove_watcher() i=0 2019-11-29T11:52:54.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.276+0000 7fd023e84ec0 2 removed watcher, disabling cache 2019-11-29T11:52:54.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.336+0000 7fd023e84ec0 20 remove_watcher() i=1 2019-11-29T11:52:54.349 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.377+0000 7fd023e84ec0 20 remove_watcher() i=2 2019-11-29T11:52:54.420 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.448+0000 7fd023e84ec0 20 remove_watcher() i=3 2019-11-29T11:52:54.485 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.512+0000 7fd023e84ec0 20 remove_watcher() i=4 2019-11-29T11:52:54.527 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.555+0000 7fd023e84ec0 20 remove_watcher() i=5 2019-11-29T11:52:54.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.614+0000 7fd023e84ec0 20 remove_watcher() i=6 2019-11-29T11:52:54.644 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.671+0000 7fd023e84ec0 20 remove_watcher() i=7 2019-11-29T11:52:54.651 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T11:52:54.758 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.786+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:54.779 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.806+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:54.779 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.806+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:54.791 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.818+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:54.791 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.818+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:54.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.824+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:54.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.824+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:54.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:54.832+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:55.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.074+0000 7f5f81217ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T11:52:55.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.074+0000 7f5f81217ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T11:52:55.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.074+0000 7f5f81217ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T11:52:55.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.074+0000 7f5f81217ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T11:52:55.047 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.074+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.059 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.086+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:55.059 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.086+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.126+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:55.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.126+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.139+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:55.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.139+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.156+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:55.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.156+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.167+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:55.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.167+0000 7f5f81217ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T11:52:55.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.167+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.177+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:55.150 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.177+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.200+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:55.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.200+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.231+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T11:52:55.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.231+0000 7f5f81217ec0 20 zonegroup default 2019-11-29T11:52:55.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.231+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.243+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:55.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.243+0000 7f5f81217ec0 10 Cannot find current period zone using local zone 2019-11-29T11:52:55.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.243+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.252+0000 7f5f81217ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T11:52:55.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.252+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.236 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.263+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T11:52:55.236 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.264+0000 7f5f81217ec0 20 rados->read ofs=0 len=0 2019-11-29T11:52:55.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.278+0000 7f5f81217ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T11:52:55.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.278+0000 7f5f81217ec0 20 zone default found 2019-11-29T11:52:55.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.278+0000 7f5f81217ec0 20 started sync module instance, tier type = 2019-11-29T11:52:55.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.278+0000 7f5f81217ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T11:52:55.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=0 2019-11-29T11:52:55.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=1 2019-11-29T11:52:55.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=2 2019-11-29T11:52:55.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=3 2019-11-29T11:52:55.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=4 2019-11-29T11:52:55.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=5 2019-11-29T11:52:55.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.649+0000 7f5f81217ec0 20 add_watcher() i=6 2019-11-29T11:52:55.655 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.683+0000 7f5f81217ec0 20 add_watcher() i=7 2019-11-29T11:52:55.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.683+0000 7f5f81217ec0 2 all 8 watchers are set, enabling cache 2019-11-29T11:52:55.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.683+0000 7f5f3efdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T11:52:55.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.685+0000 7f5f6ec45700 0 -- >> v2:172.21.15.114:3300/0 conn(0x557a1cfa7700 msgr2=0x557a1cfa6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T11:52:55.690 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:55.717+0000 7f5f6e444700 0 -- 172.21.15.182:0/1097435873 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7f5eb0017570 msgr2=0x7f5eb0019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T11:52:56.991 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.018+0000 7f5ead7fa700 20 reqs_thread_entry: start 2019-11-29T11:52:56.991 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.018+0000 7f5ea6ffd700 20 reqs_thread_entry: start 2019-11-29T11:52:56.991 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.018+0000 7f5f81217ec0 20 init_complete bucket index max shards: 0 2019-11-29T11:52:56.992 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.019+0000 7f5ea57fa700 20 reqs_thread_entry: start 2019-11-29T11:52:56.992 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.019+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T11:52:57.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.080+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.102+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.088 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.115+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.150 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.178+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T11:52:57.211 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.238+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.257+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.270+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.322+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T11:52:57.345 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.372+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.369 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.397+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.383 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.411+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.423 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.451+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T11:52:57.466 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.494+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.485 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.512+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.524+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.537 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.564+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T11:52:57.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.626+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.646+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.656+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.689+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T11:52:57.752 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.780+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.785 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.813+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.802 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.829+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.846 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.873+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T11:52:57.903 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.930+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.922 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.949+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:57.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:57.957+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:57.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.004+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T11:52:58.045 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.072+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.092+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.105+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.158+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T11:52:58.180 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.206+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.223+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.233+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.252 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.279+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T11:52:58.303 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.330+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.347+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.360+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.360 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.388+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T11:52:58.423 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.450+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.468+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.480+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.525+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T11:52:58.547 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.574+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.589+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.596+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.609 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.636+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T11:52:58.665 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.693+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.711+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.742+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.816+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T11:52:58.848 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.875+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.867 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.894+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.879 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.906+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.913 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.940+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T11:52:58.959 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:58.986+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:58.976 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.003+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:58.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.014+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.015 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.042+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T11:52:59.071 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.099+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.114+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.123+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.179+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T11:52:59.221 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.248+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.276+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.268 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.295+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.351+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T11:52:59.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.399+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.416+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.426+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.437 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.464+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T11:52:59.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.552+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.550 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.578+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.563 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.591+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.634+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T11:52:59.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.684+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.670 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.698+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.679 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.707+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.735+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T11:52:59.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.776+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.793+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.812+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.813 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.841+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T11:52:59.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.923+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.921 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.948+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:52:59.938 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:52:59.965+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:52:59.983 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.010+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T11:53:00.045 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.073+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.072 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.099+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.115+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.131 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.159+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T11:53:00.201 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.228+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.221 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.249+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.229 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.256+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.283 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.310+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T11:53:00.366 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.393+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.388 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.415+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.410 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.431+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.439 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.466+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T11:53:00.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.502+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.489 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.516+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.499 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.526+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.558+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T11:53:00.582 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.609+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.626+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.608 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.636+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.683+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T11:53:00.716 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.744+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.770+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.758 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.785+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.808 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.836+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T11:53:00.885 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.913+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.930+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:00.912 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.939+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:00.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:00.977+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T11:53:01.021 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.048+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.050 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.078+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:01.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.092+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.123 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.150+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T11:53:01.195 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.223+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.219 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.247+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:01.231 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.259+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.272 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.299+0000 7f5f81217ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T11:53:01.359 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.386+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.397 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.425+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T11:53:01.422 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.449+0000 7f5f81217ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T11:53:01.515 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.542+0000 7f5f81217ec0 20 remove_watcher() i=0 2019-11-29T11:53:01.515 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.542+0000 7f5f81217ec0 2 removed watcher, disabling cache 2019-11-29T11:53:01.558 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.586+0000 7f5f81217ec0 20 remove_watcher() i=1 2019-11-29T11:53:01.619 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.647+0000 7f5f81217ec0 20 remove_watcher() i=2 2019-11-29T11:53:01.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.684+0000 7f5f81217ec0 20 remove_watcher() i=3 2019-11-29T11:53:01.693 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.720+0000 7f5f81217ec0 20 remove_watcher() i=4 2019-11-29T11:53:01.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.756+0000 7f5f81217ec0 20 remove_watcher() i=5 2019-11-29T11:53:01.767 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.794+0000 7f5f81217ec0 20 remove_watcher() i=6 2019-11-29T11:53:01.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T11:53:01.827+0000 7f5f81217ec0 20 remove_watcher() i=7 2019-11-29T11:53:01.807 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-29T11:53:02.313 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :clean 2019-11-29T11:53:02.811 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileJava 2019-11-29T11:53:02.811 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processResources 2019-11-29T11:53:02.812 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :classes 2019-11-29T11:53:03.012 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:03.012 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :compileTestJava 2019-11-29T11:53:03.012 INFO:teuthology.orchestra.run.smithi182.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-29T11:53:03.013 INFO:teuthology.orchestra.run.smithi182.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-29T11:53:03.013 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:03.013 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :processTestResources NO-SOURCE 2019-11-29T11:53:03.013 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :testClasses 2019-11-29T11:53:05.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:> Task :test 2019-11-29T11:53:05.011 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:05.011 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-29T11:53:11.111 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:11.111 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-29T11:53:11.778 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:37:19.916 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.791 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:37:19.975 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.793 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:37:19.931 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.795 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:37:19.979 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.808 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:37:19.992 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.812 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:37:19.996 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.966 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:37:20.150 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.984 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:37:20.168 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:11.990 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:37:20.129 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:53:21.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:21.711 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-29T11:53:24.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:24.711 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-29T11:53:32.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:32.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-29T11:53:35.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:35.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-29T11:53:41.412 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:53:41.412 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-29T11:54:07.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:07.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-29T11:54:13.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:13.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-29T11:54:16.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:16.811 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-29T11:54:23.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:23.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-29T11:54:28.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:28.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-29T11:54:36.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:36.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-29T11:54:36.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:36.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-29T11:54:38.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:38.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-29T11:54:40.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:40.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-29T11:54:46.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:46.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-29T11:54:54.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:54:54.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-29T11:55:01.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:01.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-29T11:55:04.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:04.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-29T11:55:11.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:11.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-29T11:55:15.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:15.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-29T11:55:22.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:22.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-29T11:55:25.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:25.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-29T11:55:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:32.911 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-29T11:55:36.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:36.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-29T11:55:43.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:43.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-29T11:55:46.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:46.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-29T11:55:52.209 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:52.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-29T11:55:54.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:55:54.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-29T11:56:00.609 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:56:00.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-29T11:56:05.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:56:05.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-29T11:56:11.209 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:56:11.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-29T11:56:31.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:56:31.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-29T11:56:46.511 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T11:56:46.511 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-29T11:58:22.880 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:31.017 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:22.887 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:31.022 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:22.892 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:31.077 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:22.895 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:31.080 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:22.897 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:31.082 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:22.898 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:31.083 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:23.081 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:31.266 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:23.141 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:31.326 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:23.147 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:31.285 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.775 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:43.960 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.787 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:43.972 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.794 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:43.932 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.798 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:43.936 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.803 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:43.989 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.809 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:43.995 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.827 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:42:43.965 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.832 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:42:44.017 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T11:58:35.833 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:42:44.018 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:01:21.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:01:21.711 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-29T12:01:36.913 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:01:36.913 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-29T12:01:39.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:01:39.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-29T12:01:46.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:01:46.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-29T12:01:51.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:01:51.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-29T12:02:02.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:02.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-29T12:02:14.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:14.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-29T12:02:22.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:22.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-29T12:02:22.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:22.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-29T12:02:24.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:24.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-29T12:02:38.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:38.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-29T12:02:44.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:44.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-29T12:02:56.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:02:56.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-29T12:03:09.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:03:09.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-29T12:03:34.797 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:47:42.934 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.807 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:47:42.944 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.813 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:47:42.997 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.816 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:47:43.001 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.821 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:47:43.006 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.825 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:47:43.011 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.970 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:47:43.107 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.986 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:47:43.170 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:34.989 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:47:43.174 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:03:36.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:03:36.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-29T12:03:44.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:03:44.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-29T12:06:13.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:06:13.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-29T12:06:20.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:06:20.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-29T12:06:45.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:06:45.611 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-29T12:06:55.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:06:55.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-29T12:06:57.448 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:51:05.583 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.457 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:51:05.593 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.496 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:51:05.680 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.502 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:51:05.686 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.506 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:51:05.690 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.515 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:51:05.698 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.637 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:51:05.773 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.717 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:51:05.901 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:06:57.750 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:51:05.934 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:07:19.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:19.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-29T12:07:26.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:26.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-29T12:07:37.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:37.211 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-29T12:07:52.413 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:52.414 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-29T12:07:52.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:52.755 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-29T12:07:53.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:53.511 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-29T12:07:54.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:54.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-29T12:07:58.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:07:58.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-29T12:08:45.021 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:52:53.157 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.031 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:52:53.167 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.035 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:52:53.219 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.040 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:52:53.225 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.043 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:52:53.228 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.054 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:52:53.238 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.116 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:52:53.300 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.125 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:52:53.260 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:08:45.134 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:52:53.318 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:09:00.711 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:00.711 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-29T12:09:06.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:06.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-29T12:09:07.513 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:07.513 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-29T12:09:11.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:11.511 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-29T12:09:13.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:13.011 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-29T12:09:19.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:19.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-29T12:09:21.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:21.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-29T12:09:26.712 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:26.712 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-29T12:09:28.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:28.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-29T12:09:32.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:32.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-29T12:09:36.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:36.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-29T12:09:43.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:43.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-29T12:09:51.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:09:51.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-29T12:10:03.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:03.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-29T12:10:09.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:09.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-29T12:10:19.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:19.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-29T12:10:24.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:24.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-29T12:10:36.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:36.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-29T12:10:42.211 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:42.211 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-29T12:10:53.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:53.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-29T12:10:58.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:10:58.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-29T12:11:09.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:09.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-29T12:11:16.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:16.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-29T12:11:28.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:28.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-29T12:11:34.710 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:34.710 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-29T12:11:44.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:44.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-29T12:11:51.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:11:51.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-29T12:12:02.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:02.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-29T12:12:09.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:09.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-29T12:12:21.110 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:21.110 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-29T12:12:29.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:29.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-29T12:12:39.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:39.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-29T12:12:46.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:46.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-29T12:12:54.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:12:54.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-29T12:13:00.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:00.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-29T12:13:08.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:08.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-29T12:13:15.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:15.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-29T12:13:24.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:24.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-29T12:13:32.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:32.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-29T12:13:43.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:43.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-29T12:13:51.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:13:51.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-29T12:13:58.941 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:58:07.075 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:58.962 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:58:07.146 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:58.964 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:58:07.149 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:58.966 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:58:07.150 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:58.969 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:58:07.154 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:58.979 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:58:07.114 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:59.156 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:58:07.341 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:59.178 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:58:07.314 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:13:59.198 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:58:07.382 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:14:01.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:01.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-29T12:14:08.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:08.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-29T12:14:19.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:19.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-29T12:14:25.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:25.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-29T12:14:35.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:35.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-29T12:14:44.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:44.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-29T12:14:56.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:14:56.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-29T12:15:02.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:02.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-29T12:15:12.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:12.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-29T12:15:19.189 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:59:27.325 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.196 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:59:27.381 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.200 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:59:27.334 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.226 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:59:27.411 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.227 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:59:27.412 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.236 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:59:27.421 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.271 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:00:59:27.456 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.282 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:00:59:27.466 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.337 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:00:59:27.472 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:15:19.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:19.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-29T12:15:27.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:27.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-29T12:15:34.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:34.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-29T12:15:44.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:44.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-29T12:15:50.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:15:50.411 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-29T12:16:00.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:00.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-29T12:16:03.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:03.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-29T12:16:08.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:08.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-29T12:16:13.910 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:13.910 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-29T12:16:19.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:19.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-29T12:16:23.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:23.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-29T12:16:30.615 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:30.615 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-29T12:16:33.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:33.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-29T12:16:40.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:40.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-29T12:16:46.810 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:46.810 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-29T12:16:52.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:52.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-29T12:16:53.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:53.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-29T12:16:54.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:54.411 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-29T12:16:57.610 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:16:57.610 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-29T12:17:04.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:04.510 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-29T12:17:07.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:07.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-29T12:17:15.310 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:15.310 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-29T12:17:17.317 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:17.317 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-29T12:17:25.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:25.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-29T12:17:28.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:28.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-29T12:17:34.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:34.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-29T12:17:38.213 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:38.213 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-29T12:17:45.210 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:45.210 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-29T12:17:55.410 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:17:55.410 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-29T12:18:01.010 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:01.010 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-29T12:18:09.510 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:09.511 INFO:teuthology.orchestra.run.smithi182.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-29T12:18:16.263 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:16.263 INFO:teuthology.orchestra.run.smithi182.stdout:---------------------------------------------------------------------- 2019-11-29T12:18:16.263 INFO:teuthology.orchestra.run.smithi182.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-29T12:18:16.263 INFO:teuthology.orchestra.run.smithi182.stdout:---------------------------------------------------------------------- 2019-11-29T12:18:16.264 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:16.264 INFO:teuthology.orchestra.run.smithi182.stdout:BUILD SUCCESSFUL in 25m 14s 2019-11-29T12:18:16.264 INFO:teuthology.orchestra.run.smithi182.stdout:5 actionable tasks: 5 executed 2019-11-29T12:18:16.277 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T12:18:16.434 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.434+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.461 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.460+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.461 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.460+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.472+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.472+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.479 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.478+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.479 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.478+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.489+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:16.713 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.713+0000 7f77e5fcaec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:16.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.713+0000 7f77e5fcaec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:16.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.713+0000 7f77e5fcaec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:16.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.713+0000 7f77e5fcaec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:16.714 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.713+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.726+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:16.727 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.726+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.737+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:16.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.737+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.748+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:16.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.748+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.759+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:16.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.759+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.769+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.769+0000 7f77e5fcaec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:16.770 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.769+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.780 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.780+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.780 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.780+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.791 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.790+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:16.791 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.790+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.800+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:16.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.800+0000 7f77e5fcaec0 20 zonegroup default 2019-11-29T12:18:16.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.800+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.810+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.810+0000 7f77e5fcaec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:16.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.810+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.819+0000 7f77e5fcaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:16.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.819+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.831 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.830+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:16.831 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.830+0000 7f77e5fcaec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:16.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.848+0000 7f77e5fcaec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:16.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.848+0000 7f77e5fcaec0 20 zone default found 2019-11-29T12:18:16.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.848+0000 7f77e5fcaec0 20 started sync module instance, tier type = 2019-11-29T12:18:16.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:16.848+0000 7f77e5fcaec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:17.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=0 2019-11-29T12:18:17.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=1 2019-11-29T12:18:17.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=2 2019-11-29T12:18:17.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=3 2019-11-29T12:18:17.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=4 2019-11-29T12:18:17.251 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.249+0000 7f77e5fcaec0 20 add_watcher() i=5 2019-11-29T12:18:17.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.279+0000 7f77e5fcaec0 20 add_watcher() i=6 2019-11-29T12:18:17.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.288+0000 7f77e5fcaec0 20 add_watcher() i=7 2019-11-29T12:18:17.289 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.288+0000 7f77e5fcaec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:17.289 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.288+0000 7f77a3fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:17.292 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.291+0000 7f77d39f8700 0 -- 172.21.15.182:0/2847990989 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x565377cfd720 msgr2=0x565377d12c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:18:17.331 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:17.331+0000 7f77d39f8700 0 -- 172.21.15.182:0/3307635473 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7f77140175b0 msgr2=0x7f7714019a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:18.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.656+0000 7f77127fc700 20 reqs_thread_entry: start 2019-11-29T12:18:18.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.656+0000 7f770bfff700 20 reqs_thread_entry: start 2019-11-29T12:18:18.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.656+0000 7f77e5fcaec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:18.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.657+0000 7f770a7fc700 20 reqs_thread_entry: start 2019-11-29T12:18:18.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.657+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T12:18:18.724 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.722+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:18.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.745+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:18.756 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.754+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:18.820 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.818+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T12:18:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.900+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:18.920 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.918+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:18.938 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:18.938 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1183', time=2019-11-29T14:03:01.873197+0000, chain.objs.size()=9 2019-11-29T12:18:18.938 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.1 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.1_1 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.2 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.2_1 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.3 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.3_1 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.4 2019-11-29T12:18:18.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.4_1 2019-11-29T12:18:18.940 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:18.936+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file2.mpg.2~tkNlgDpZMVHmywr3tT_c-vRz7-bQpQS.5 2019-11-29T12:18:19.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.177+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:19.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.267+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T12:18:19.306 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.305+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:19.322 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.321+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:19.332 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.330+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:19.363 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.361+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T12:18:19.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.410+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:19.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.427+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:19.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:19.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1038', time=2019-11-29T13:56:33.005407+0000, chain.objs.size()=9 2019-11-29T12:18:19.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.1 2019-11-29T12:18:19.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.1_1 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.2 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.2_1 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.3 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.3_1 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.4 2019-11-29T12:18:19.446 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.4_1 2019-11-29T12:18:19.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.442+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.5 2019-11-29T12:18:19.659 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.657+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:19.801 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.799+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T12:18:19.856 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.854+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:19.873 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.872+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:19.886 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1907', time=2019-11-29T14:18:10.734993+0000, chain.objs.size()=9 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__multipart_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.1 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__shadow_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.1_1 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__multipart_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.2 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__shadow_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.2_1 2019-11-29T12:18:19.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__multipart_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.3 2019-11-29T12:18:19.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__shadow_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.3_1 2019-11-29T12:18:19.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__multipart_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.4 2019-11-29T12:18:19.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__shadow_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.4_1 2019-11-29T12:18:19.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:19.885+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.119__multipart_key1/data/file.mpg.2~g6ioGkAeCeJiWw-Kxwns3x6lqbjkVsQ.5 2019-11-29T12:18:20.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.099+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:20.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.193+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T12:18:20.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.268+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:20.296 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.296+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:20.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:20.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1061', time=2019-11-29T13:58:52.409214+0000, chain.objs.size()=9 2019-11-29T12:18:20.324 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.1 2019-11-29T12:18:20.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.1_1 2019-11-29T12:18:20.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.2 2019-11-29T12:18:20.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.2_1 2019-11-29T12:18:20.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.3 2019-11-29T12:18:20.325 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.3_1 2019-11-29T12:18:20.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.4 2019-11-29T12:18:20.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.4_1 2019-11-29T12:18:20.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.323+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~zCPrey2KaM4msSk4oMICW1PiLqY9cvy.5 2019-11-29T12:18:20.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.617+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:20.709 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.708+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T12:18:20.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.760+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:20.780 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.780+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:20.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.792+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:20.824 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.823+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T12:18:20.883 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.883+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:20.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.908+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:20.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1083', time=2019-11-29T14:00:36.111495+0000, chain.objs.size()=7 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.1 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.1_1 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.1_2 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.2 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.2_1 2019-11-29T12:18:20.945 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.2_2 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~O2tybUR7fvYvKHv-zjt5ypkFI76x-lf.3 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1132', time=2019-11-29T14:02:16.757432+0000, chain.objs.size()=9 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__multipart_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.1 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__shadow_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.1_1 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__multipart_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.2 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__shadow_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.2_1 2019-11-29T12:18:20.946 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:20.943+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__multipart_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.3 2019-11-29T12:18:21.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__shadow_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.3_1 2019-11-29T12:18:21.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__multipart_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.4 2019-11-29T12:18:21.183 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__shadow_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.4_1 2019-11-29T12:18:21.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.71__multipart_key1.2~mwFW3zT-BLL4TBGeQiNkTbW8gSJHQh6.5 2019-11-29T12:18:21.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1891', time=2019-11-29T14:17:56.699360+0000, chain.objs.size()=9 2019-11-29T12:18:21.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.182+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__multipart_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.1 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__shadow_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.1_1 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__multipart_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.2 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__shadow_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.2_1 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__multipart_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.3 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__shadow_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.3_1 2019-11-29T12:18:21.238 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.237+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__multipart_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.4 2019-11-29T12:18:21.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.365+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__shadow_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.4_1 2019-11-29T12:18:21.366 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.365+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.118__multipart_key1.2~2epduc4me-ZxaXxRjBhcvQI5Gu4aqjX.5 2019-11-29T12:18:21.507 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.506+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:21.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.626+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T12:18:21.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.675+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:21.693 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.693+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:21.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:21.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1095', time=2019-11-29T14:01:31.120432+0000, chain.objs.size()=7 2019-11-29T12:18:21.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.1 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.1_1 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.1_2 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.2 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.2_1 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.2_2 2019-11-29T12:18:21.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:21.710+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~YrYwQohqbs3ktnpbB2e_Aw5a5NczjEU.3 2019-11-29T12:18:22.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.088+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:22.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.171+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T12:18:22.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.213+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.233+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:22.250 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.249+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.292 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.291+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T12:18:22.382 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.381+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.407+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:22.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.421+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.467 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.466+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T12:18:22.546 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.545+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.585 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.584+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:22.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.602+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.653+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T12:18:22.708 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.707+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.746+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:22.760 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.759+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.803 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.802+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T12:18:22.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.857+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.887+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:22.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.896+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:22.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:22.963+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T12:18:23.041 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.040+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:23.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.063+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:23.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.081+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:18:23.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.081+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.969', time=2019-11-29T13:54:56.112743+0000, chain.objs.size()=2 2019-11-29T12:18:23.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.081+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.56__shadow_.A6kz6PbhGc8yzD4ssITFGrFhZKoEU03_1 2019-11-29T12:18:23.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.081+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.56__shadow_.A6kz6PbhGc8yzD4ssITFGrFhZKoEU03_2 2019-11-29T12:18:23.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1040', time=2019-11-29T13:56:39.659015+0000, chain.objs.size()=9 2019-11-29T12:18:23.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.1 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.1_1 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.2 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.2_1 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.3 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.3_1 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.4 2019-11-29T12:18:23.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__shadow_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.4_1 2019-11-29T12:18:23.086 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.082+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.64__multipart_key1.2~CLxzgGezBDxErdQ2Idef2xOmFR6zSCt.5 2019-11-29T12:18:23.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.475+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:23.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.565+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T12:18:23.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.622+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:23.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.639+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:23.653 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.652+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:23.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.764+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T12:18:23.827 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.816+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:23.838 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.838+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:23.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:23.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1221', time=2019-11-29T14:04:53.191888+0000, chain.objs.size()=9 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.1 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.1_1 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.2 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.2_1 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.3 2019-11-29T12:18:23.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.3_1 2019-11-29T12:18:23.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.4 2019-11-29T12:18:23.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.4_1 2019-11-29T12:18:23.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:23.857+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~9lJpm9dTiMM9lZRcmCbT6yk2Qkyltxv.5 2019-11-29T12:18:24.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.150+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:24.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.221+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T12:18:24.271 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.270+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:24.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.307+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:24.336 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-29T12:18:24.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1182', time=2019-11-29T14:02:58.041242+0000, chain.objs.size()=9 2019-11-29T12:18:24.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.1 2019-11-29T12:18:24.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.1_1 2019-11-29T12:18:24.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.2 2019-11-29T12:18:24.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.2_1 2019-11-29T12:18:24.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.3 2019-11-29T12:18:24.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.3_1 2019-11-29T12:18:24.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.334+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.4 2019-11-29T12:18:24.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__shadow_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.4_1 2019-11-29T12:18:24.338 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.73__multipart_file.mpg.2~g88n217Uttd3CctdZId3HRxRCG3KnG-.5 2019-11-29T12:18:24.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1233', time=2019-11-29T14:05:56.856005+0000, chain.objs.size()=7 2019-11-29T12:18:24.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.1 2019-11-29T12:18:24.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.1_1 2019-11-29T12:18:24.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.335+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.1_2 2019-11-29T12:18:24.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.2 2019-11-29T12:18:24.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.2_1 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.2_2 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~q_j_GJlR6WoMvevyjZ8M3UuhY17d_9k.3 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='2~CcpANetvA3k8URySuuRGvlfA0bLvqoS', time=2019-11-29T14:07:48.393972+0000, chain.objs.size()=31 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.1 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.2 2019-11-29T12:18:24.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.3 2019-11-29T12:18:24.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.4 2019-11-29T12:18:24.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.5 2019-11-29T12:18:24.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.6 2019-11-29T12:18:24.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.614+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.7 2019-11-29T12:18:24.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.723+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.8 2019-11-29T12:18:24.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.852+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.9 2019-11-29T12:18:24.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.852+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.10 2019-11-29T12:18:24.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.852+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.11 2019-11-29T12:18:24.854 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.852+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.12 2019-11-29T12:18:24.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.13 2019-11-29T12:18:24.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.14 2019-11-29T12:18:24.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.tnlht_d7Vytf1ETwDwKBQwRCCYDacXj.15 2019-11-29T12:18:24.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.5yvVIE_B8w5TbgEMFn2MRCExZU6I_dr.16 2019-11-29T12:18:24.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.17 2019-11-29T12:18:24.859 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.18 2019-11-29T12:18:24.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.855+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.Xv5aqk--vPbAwJwejckne2LqMQoS_Ne.19 2019-11-29T12:18:24.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.933+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.20 2019-11-29T12:18:24.978 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.977+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.21 2019-11-29T12:18:24.978 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.977+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.22 2019-11-29T12:18:24.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:24.977+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.23 2019-11-29T12:18:25.031 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.24 2019-11-29T12:18:25.031 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.25 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.26 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.27 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.28 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.29 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.31 2019-11-29T12:18:25.032 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.030+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.78__multipart_key1.2~CcpANetvA3k8URySuuRGvlfA0bLvqoS.33 2019-11-29T12:18:25.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.115+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:25.219 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.218+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T12:18:25.281 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.280+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:25.304 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.303+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:25.319 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.318+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:25.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.318+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1243', time=2019-11-29T14:06:14.877956+0000, chain.objs.size()=7 2019-11-29T12:18:25.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.318+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.1 2019-11-29T12:18:25.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.1_1 2019-11-29T12:18:25.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.1_2 2019-11-29T12:18:25.320 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.2 2019-11-29T12:18:25.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.2_1 2019-11-29T12:18:25.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.2_2 2019-11-29T12:18:25.321 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.319+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~uURYWGUIZ1nUbZSObaLkqwSPc4GzKSy.3 2019-11-29T12:18:25.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.566+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:25.702 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.701+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T12:18:25.771 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.770+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:25.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.788+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:25.798 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.797+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:25.837 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.836+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T12:18:25.911 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.910+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:25.964 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.963+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:25.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:25.978+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.032+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T12:18:26.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.081+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.099+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:26.108 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.107+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.141+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T12:18:26.186 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.185+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.199+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:26.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.213+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:26.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1228', time=2019-11-29T14:05:26.129145+0000, chain.objs.size()=9 2019-11-29T12:18:26.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.1 2019-11-29T12:18:26.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.1_1 2019-11-29T12:18:26.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.2 2019-11-29T12:18:26.215 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.2_1 2019-11-29T12:18:26.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.3 2019-11-29T12:18:26.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.3_1 2019-11-29T12:18:26.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.4 2019-11-29T12:18:26.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.4_1 2019-11-29T12:18:26.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.214+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~adpq16FzDlItySrQsAcX9AuZwgoceV6.5 2019-11-29T12:18:26.544 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.543+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:26.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.626+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T12:18:26.682 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.681+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.700 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.699+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:26.710 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.709+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.795 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.794+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T12:18:26.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.848+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.863 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.863+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:26.871 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.871+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.904 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.904+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T12:18:26.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.941+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:26.959 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.958+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:26.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:26.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq', time=2019-11-29T14:03:39.565085+0000, chain.objs.size()=9 2019-11-29T12:18:26.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__multipart_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.7 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__shadow_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.7_1 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__multipart_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.8 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__shadow_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.8_1 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__multipart_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.9 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__shadow_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.9_1 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__multipart_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.10 2019-11-29T12:18:26.982 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__shadow_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.10_1 2019-11-29T12:18:26.983 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:26.980+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.74__multipart_key1.2~lYZihMSO4M5lrCTT7ZiYF-PiDlT8Zcq.11 2019-11-29T12:18:27.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.216+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:27.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.289+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T12:18:27.342 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.341+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:27.367 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.366+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:27.389 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:18:27.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1214', time=2019-11-29T14:04:27.604237+0000, chain.objs.size()=9 2019-11-29T12:18:27.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.1 2019-11-29T12:18:27.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.1_1 2019-11-29T12:18:27.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.2 2019-11-29T12:18:27.896 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.2_1 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.3 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.3_1 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.4 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.4_1 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~0qH8HETTdowV9gPEakeLK3ruK1HByWD.5 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1273', time=2019-11-29T14:07:20.978065+0000, chain.objs.size()=9 2019-11-29T12:18:27.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__multipart_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.1 2019-11-29T12:18:27.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__shadow_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.1_1 2019-11-29T12:18:27.898 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.387+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__multipart_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.2 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.611+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__shadow_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.2_1 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.617+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__multipart_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.3 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.617+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__shadow_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.3_1 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.617+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__multipart_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.4 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.686+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__shadow_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.4_1 2019-11-29T12:18:27.899 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.686+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.77__multipart_key1.2~gHhgWrk70pwPFhLFK7ayzhGbeahH-k6.5 2019-11-29T12:18:27.900 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.858+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:27.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:27.986+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T12:18:28.050 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.049+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:28.073 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.072+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:28.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:28.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1069', time=2019-11-29T13:59:38.512437+0000, chain.objs.size()=9 2019-11-29T12:18:28.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.1 2019-11-29T12:18:28.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.1_1 2019-11-29T12:18:28.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.2 2019-11-29T12:18:28.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.2_1 2019-11-29T12:18:28.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.3 2019-11-29T12:18:28.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.3_1 2019-11-29T12:18:28.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.4 2019-11-29T12:18:28.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.4_1 2019-11-29T12:18:28.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.094+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~W-H_OooH7Hi0pirr6Jl5wYQBTsekPzd.5 2019-11-29T12:18:28.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.292+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:28.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.371+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T12:18:28.412 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.411+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:28.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.429+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:28.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:18:28.448 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1077', time=2019-11-29T14:00:05.956162+0000, chain.objs.size()=9 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.1 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.1_1 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.2 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.2_1 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.3 2019-11-29T12:18:28.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.3_1 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.4 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.4_1 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~QBvaGnP8hVsOvMzOUPnCxQ7in4F4N_8.5 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1238', time=2019-11-29T14:06:12.140376+0000, chain.objs.size()=7 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.1 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.1_1 2019-11-29T12:18:28.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.446+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.1_2 2019-11-29T12:18:28.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.674+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.2 2019-11-29T12:18:28.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.674+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.2_1 2019-11-29T12:18:28.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.674+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__shadow_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.2_2 2019-11-29T12:18:28.675 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.674+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.75__multipart_key1.2~7AkkjC1P4uxB-agQCbkga9qo5rpf400.3 2019-11-29T12:18:28.902 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:28.901+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:29.041 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.040+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T12:18:29.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.105+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:29.126 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.125+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:29.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-29T12:18:29.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1089', time=2019-11-29T14:01:20.880734+0000, chain.objs.size()=7 2019-11-29T12:18:29.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.1 2019-11-29T12:18:29.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.1_1 2019-11-29T12:18:29.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.1_2 2019-11-29T12:18:29.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.2 2019-11-29T12:18:29.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.2_1 2019-11-29T12:18:29.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__shadow_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.2_2 2019-11-29T12:18:29.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.139+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.67__multipart_key1.2~iiTMJYYtemq1nqNVLlMPrBg5W79GhlP.3 2019-11-29T12:18:29.399 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.398+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:29.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.483+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T12:18:29.527 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.526+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:29.542 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.542+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:29.559 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.558+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.558+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1151', time=2019-11-29T14:02:40.157266+0000, chain.objs.size()=9 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.558+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__multipart_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.1 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__shadow_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.1_1 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__multipart_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.2 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__shadow_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.2_1 2019-11-29T12:18:29.560 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__multipart_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.3 2019-11-29T12:18:29.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__shadow_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.3_1 2019-11-29T12:18:29.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__multipart_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.4 2019-11-29T12:18:29.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__shadow_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.4_1 2019-11-29T12:18:29.561 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.72__multipart_key1.2~PtNRae90K_btACGbdlK910PyAjGu-u6.5 2019-11-29T12:18:29.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1258', time=2019-11-29T14:06:48.667076+0000, chain.objs.size()=9 2019-11-29T12:18:29.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__multipart_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.1 2019-11-29T12:18:29.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__shadow_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.1_1 2019-11-29T12:18:29.562 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.559+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__multipart_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.2 2019-11-29T12:18:29.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.849+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__shadow_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.2_1 2019-11-29T12:18:29.850 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.849+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__multipart_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.3 2019-11-29T12:18:29.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.962+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__shadow_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.3_1 2019-11-29T12:18:29.963 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:29.962+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__multipart_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.4 2019-11-29T12:18:30.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.105+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__shadow_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.4_1 2019-11-29T12:18:30.106 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.105+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.76__multipart_key1.2~JU8g3vNgpbzbq8ZdVtU_wqdBiVWVXG-.5 2019-11-29T12:18:30.433 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.432+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:30.545 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.544+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T12:18:30.597 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.596+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:30.617 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.616+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:30.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-29T12:18:30.639 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='2~KS85-8H-HckQdupb11IQfvWK4rcULKb', time=2019-11-29T13:54:06.312507+0000, chain.objs.size()=9 2019-11-29T12:18:30.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__multipart_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.1 2019-11-29T12:18:30.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__shadow_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.1_1 2019-11-29T12:18:30.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__multipart_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.2 2019-11-29T12:18:30.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__shadow_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.2_1 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__multipart_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.3 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__shadow_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.3_1 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__multipart_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.4 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__shadow_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.4_1 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.52__multipart_key1.2~KS85-8H-HckQdupb11IQfvWK4rcULKb.5 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 20 garbage collection: RGWGC::process iterating over entry tag='9baad822-b080-4db2-b995-bf7cc78f9da0.4358.1053', time=2019-11-29T14:01:23.465049+0000, chain.objs.size()=5 2019-11-29T12:18:30.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.66__shadow_.34PYqkOnpmY4nnTf1P4k4T2ffCAm4R0_1 2019-11-29T12:18:30.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.66__shadow_.34PYqkOnpmY4nnTf1P4k4T2ffCAm4R0_2 2019-11-29T12:18:30.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.637+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.66__shadow_.34PYqkOnpmY4nnTf1P4k4T2ffCAm4R0_3 2019-11-29T12:18:30.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.940+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.66__shadow_.34PYqkOnpmY4nnTf1P4k4T2ffCAm4R0_4 2019-11-29T12:18:30.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:30.940+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:9baad822-b080-4db2-b995-bf7cc78f9da0.4528.66__shadow_.34PYqkOnpmY4nnTf1P4k4T2ffCAm4R0_5 2019-11-29T12:18:31.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.147+0000 7f77e5fcaec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-29T12:18:31.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.338+0000 7f77e5fcaec0 20 remove_watcher() i=0 2019-11-29T12:18:31.339 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.338+0000 7f77e5fcaec0 2 removed watcher, disabling cache 2019-11-29T12:18:31.374 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.373+0000 7f77e5fcaec0 20 remove_watcher() i=1 2019-11-29T12:18:31.405 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.404+0000 7f77e5fcaec0 20 remove_watcher() i=2 2019-11-29T12:18:31.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.463+0000 7f77e5fcaec0 20 remove_watcher() i=3 2019-11-29T12:18:31.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.497+0000 7f77e5fcaec0 20 remove_watcher() i=4 2019-11-29T12:18:31.537 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.532+0000 7f77e5fcaec0 20 remove_watcher() i=5 2019-11-29T12:18:31.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.568+0000 7f77e5fcaec0 20 remove_watcher() i=6 2019-11-29T12:18:31.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.615+0000 7f77e5fcaec0 20 remove_watcher() i=7 2019-11-29T12:18:31.625 INFO:teuthology.orchestra.run.smithi182:> radosgw-admin gc process --include-all 2019-11-29T12:18:31.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.781+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:31.802 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.802+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:31.802 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.802+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:31.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.814+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:31.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.814+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:31.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.820+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:31.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.821+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:31.829 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:31.828+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:32.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.073+0000 7f4dbe958ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:32.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.073+0000 7f4dbe958ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:32.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.073+0000 7f4dbe958ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:32.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.073+0000 7f4dbe958ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:32.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.073+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.083+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:32.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.083+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.101 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.101+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:32.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.101+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.113+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:32.114 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.113+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.141+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:32.142 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.141+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.150 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.150+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:32.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.150+0000 7f4dbe958ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:32.151 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.150+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.156+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:32.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.156+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.165+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:32.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.165+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.178+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:32.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.178+0000 7f4dbe958ec0 20 zonegroup default 2019-11-29T12:18:32.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.178+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.187+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:32.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.187+0000 7f4dbe958ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:32.188 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.187+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.193+0000 7f4dbe958ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:32.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.193+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.213+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:32.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.213+0000 7f4dbe958ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:32.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.232+0000 7f4dbe958ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:32.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.232+0000 7f4dbe958ec0 20 zone default found 2019-11-29T12:18:32.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.232+0000 7f4dbe958ec0 20 started sync module instance, tier type = 2019-11-29T12:18:32.233 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.232+0000 7f4dbe958ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:32.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=0 2019-11-29T12:18:32.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=1 2019-11-29T12:18:32.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=2 2019-11-29T12:18:32.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=3 2019-11-29T12:18:32.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=4 2019-11-29T12:18:32.585 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=5 2019-11-29T12:18:32.585 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.583+0000 7f4dbe958ec0 20 add_watcher() i=6 2019-11-29T12:18:32.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.612+0000 7f4dbe958ec0 20 add_watcher() i=7 2019-11-29T12:18:32.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.612+0000 7f4dbe958ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:32.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.612+0000 7f4cfffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:32.636 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.635+0000 7f4dabb85700 0 -- 172.21.15.182:0/3738663126 >> v1:172.21.15.114:6789/0 conn(0x55d12c1960d0 legacy=0x55d12c182e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:32.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:32.741+0000 7f4dabb85700 0 -- 172.21.15.182:0/3738663126 >> [v2:172.21.15.182:6800/9955,v1:172.21.15.182:6801/9955] conn(0x55d12c1d52a0 msgr2=0x55d12c1d76c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:34.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.188+0000 7f4cea7fc700 20 reqs_thread_entry: start 2019-11-29T12:18:34.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.188+0000 7f4ce3fff700 20 reqs_thread_entry: start 2019-11-29T12:18:34.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.189+0000 7f4dbe958ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:34.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.189+0000 7f4ce27fc700 20 reqs_thread_entry: start 2019-11-29T12:18:34.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.189+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-29T12:18:34.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.259+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.289+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:34.304 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.304+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.370 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.369+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-29T12:18:34.449 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.449+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.480 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.479+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:34.494 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.493+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.566 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.565+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-29T12:18:34.652 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.651+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.676 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.676+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:34.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.692+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.735 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.734+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-29T12:18:34.778 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.778+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.793 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.793+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:34.804 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.803+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.840 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.840+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-29T12:18:34.924 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.923+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:34.950 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.949+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:34.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.959+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.000 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:34.999+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-29T12:18:35.067 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.066+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.097+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.111 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.111+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.144+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-29T12:18:35.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.193+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.212+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.221+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.254+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-29T12:18:35.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.308+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.328 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.327+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.341 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.340+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.378 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.377+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-29T12:18:35.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.440+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.462 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.462+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.475+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.660+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-29T12:18:35.751 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.751+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.781+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.795+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.835 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.834+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-29T12:18:35.912 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.911+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:35.930 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.929+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:35.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:35.953+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.000+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-29T12:18:36.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.068+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.085 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.085+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.094+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.152+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-29T12:18:36.200 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.199+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.216 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.215+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.224 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.223+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.252 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.251+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-29T12:18:36.290 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.289+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.305+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.315 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.314+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.346 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.345+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-29T12:18:36.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.384+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.400 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.400+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.409 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.409+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.440+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-29T12:18:36.532 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.531+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.565+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.581+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.649 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.649+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-29T12:18:36.753 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.745+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.774 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.773+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.788+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.843 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.843+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-29T12:18:36.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.908+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:36.925 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.925+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:36.939 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:36.934+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.006 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.006+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-29T12:18:37.049 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.049+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.065+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.075+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.102+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-29T12:18:37.150 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.149+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.166 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.165+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.174 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.174+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.230+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-29T12:18:37.292 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.291+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.309 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.309+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.326 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.324+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.368 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.367+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-29T12:18:37.433 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.432+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.451 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.450+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.459 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.458+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.502 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.502+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-29T12:18:37.564 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.563+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.605 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.604+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.619+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.676+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-29T12:18:37.717 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.716+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.731 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.730+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.739 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.739+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.773 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.771+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-29T12:18:37.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.810+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.838 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.837+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.853 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.850+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.888 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.887+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-29T12:18:37.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.955+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:37.974 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.974+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:37.988 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:37.987+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.032+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-29T12:18:38.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.102+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.128 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.127+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.143 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.141+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.190+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-29T12:18:38.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.254+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.275+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.298 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.297+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.347+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-29T12:18:38.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.420+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.456 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.455+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.477+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.536 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.536+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-29T12:18:38.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.583+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.608 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.607+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.620 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.620+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.666 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.666+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-29T12:18:38.723 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.722+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.742+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.754 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.753+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.786 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.785+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-29T12:18:38.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.857+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:38.891 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.891+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-29T12:18:38.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:38.907+0000 7f4dbe958ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-29T12:18:39.005 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.004+0000 7f4dbe958ec0 20 remove_watcher() i=0 2019-11-29T12:18:39.005 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.004+0000 7f4dbe958ec0 2 removed watcher, disabling cache 2019-11-29T12:18:39.061 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.060+0000 7f4dbe958ec0 20 remove_watcher() i=1 2019-11-29T12:18:39.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.101+0000 7f4dbe958ec0 20 remove_watcher() i=2 2019-11-29T12:18:39.167 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.167+0000 7f4dbe958ec0 20 remove_watcher() i=3 2019-11-29T12:18:39.227 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.226+0000 7f4dbe958ec0 20 remove_watcher() i=4 2019-11-29T12:18:39.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.275+0000 7f4dbe958ec0 20 remove_watcher() i=5 2019-11-29T12:18:39.315 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.315+0000 7f4dbe958ec0 20 remove_watcher() i=6 2019-11-29T12:18:39.356 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:39.355+0000 7f4dbe958ec0 20 remove_watcher() i=7 2019-11-29T12:18:39.364 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-29T12:18:39.377 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}} 2019-11-29T12:18:39.377 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-29T12:18:39.377 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-29T12:18:39.377 INFO:teuthology.orchestra.run.smithi182:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-29T12:18:39.442 INFO:teuthology.orchestra.run.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-29T12:18:39.946 INFO:tasks.s3tests:Creating rgw users... 2019-11-29T12:18:39.946 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-29T12:18:39.947 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key WBEGSUTGRRJKAENNZKCB --secret aqyrZg4YESqs9u6IFsZzsh3deW3NN2k6AeTbg212Xm6Ssu8QR1J+Dw== --email bar.client.0+test@test.test --cluster ceph 2019-11-29T12:18:40.074 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.074+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.099+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.099+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.112+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.112+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.118+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.118+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.126 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.126+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:40.310 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.309+0000 7f80adf09ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:40.310 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.309+0000 7f80adf09ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:40.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.309+0000 7f80adf09ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:40.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.309+0000 7f80adf09ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:40.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.309+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.317+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:40.317 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.317+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.336+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:40.337 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.336+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.347+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:40.348 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.347+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.364+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:40.365 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.364+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.374+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.374+0000 7f80adf09ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:40.375 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.374+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.383 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.382+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.383 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.382+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.391 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.390+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:40.391 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.391+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.402+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:40.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.402+0000 7f80adf09ec0 20 zonegroup default 2019-11-29T12:18:40.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.402+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.410 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.409+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.410 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.410+0000 7f80adf09ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:40.411 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.410+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.419 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.418+0000 7f80adf09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:40.419 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.418+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.428+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:40.429 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.428+0000 7f80adf09ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:40.444 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.443+0000 7f80adf09ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:40.444 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.444+0000 7f80adf09ec0 20 zone default found 2019-11-29T12:18:40.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.444+0000 7f80adf09ec0 20 started sync module instance, tier type = 2019-11-29T12:18:40.445 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.444+0000 7f80adf09ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:40.805 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=0 2019-11-29T12:18:40.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=1 2019-11-29T12:18:40.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=2 2019-11-29T12:18:40.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=3 2019-11-29T12:18:40.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=4 2019-11-29T12:18:40.806 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=5 2019-11-29T12:18:40.807 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.805+0000 7f80adf09ec0 20 add_watcher() i=6 2019-11-29T12:18:40.842 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.841+0000 7f80adf09ec0 20 add_watcher() i=7 2019-11-29T12:18:40.842 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.841+0000 7f80adf09ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:40.843 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.841+0000 7f806bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:40.849 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:40.848+0000 7f809b136700 0 -- 172.21.15.182:0/240621931 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x565023501ff0 msgr2=0x565023504410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T12:18:41.051 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:41.050+0000 7f809b136700 0 --2- 172.21.15.182:0/240621931 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x565023501ff0 0x565023504410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:18:41.116 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:41.115+0000 7f8092935700 0 -- 172.21.15.182:0/261931904 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x56502350a820 msgr2=0x56502350cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:42.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f7fda7fc700 20 reqs_thread_entry: start 2019-11-29T12:18:42.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f7fd3fff700 20 reqs_thread_entry: start 2019-11-29T12:18:42.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f80adf09ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:42.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f7fd27fc700 20 reqs_thread_entry: start 2019-11-29T12:18:42.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f80adf09ec0 20 get_system_obj_state: rctx=0x7ffedb6d0128 obj=default.rgw.meta:users.uid:bar.client.0 state=0x56502357ba70 s->prefetch_data=0 2019-11-29T12:18:42.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.590+0000 7f80adf09ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T12:18:42.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.615+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-29T12:18:42.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.615+0000 7f80adf09ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:42.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.615+0000 7f80adf09ec0 20 get_system_obj_state: rctx=0x7ffedb6d0138 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x56502357d800 s->prefetch_data=0 2019-11-29T12:18:42.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.615+0000 7f80adf09ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-29T12:18:42.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.625+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-29T12:18:42.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.625+0000 7f80adf09ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T12:18:42.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.625+0000 7f80adf09ec0 20 get_system_obj_state: rctx=0x7ffedb6d0138 obj=default.rgw.meta:users.keys:WBEGSUTGRRJKAENNZKCB state=0x56502357d800 s->prefetch_data=0 2019-11-29T12:18:42.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.625+0000 7f80adf09ec0 10 cache get: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB : miss 2019-11-29T12:18:42.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.640+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB info.flags=0x0 2019-11-29T12:18:42.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.640+0000 7f80adf09ec0 10 adding default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB to cache LRU end 2019-11-29T12:18:42.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.640+0000 7f80adf09ec0 20 get_system_obj_state: rctx=0x7ffedb6cfd48 obj=default.rgw.meta:users.keys:WBEGSUTGRRJKAENNZKCB state=0x56502357d800 s->prefetch_data=0 2019-11-29T12:18:42.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.640+0000 7f80adf09ec0 10 cache get: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB : type miss (requested=0x6, cached=0x0) 2019-11-29T12:18:42.653 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.652+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB info.flags=0x0 2019-11-29T12:18:42.653 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.652+0000 7f80adf09ec0 10 moving default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB to cache LRU end 2019-11-29T12:18:42.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.652+0000 7f80adf09ec0 20 get_system_obj_state: rctx=0x7ffedb6cfec8 obj=default.rgw.meta:users.keys:WBEGSUTGRRJKAENNZKCB state=0x56502357d800 s->prefetch_data=0 2019-11-29T12:18:42.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.652+0000 7f80adf09ec0 10 cache get: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB : type miss (requested=0x6, cached=0x0) 2019-11-29T12:18:42.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.662+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB info.flags=0x0 2019-11-29T12:18:42.662 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.662+0000 7f80adf09ec0 10 moving default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB to cache LRU end 2019-11-29T12:18:42.734 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.733+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T12:18:42.734 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.733+0000 7f80adf09ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:42.735 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.733+0000 7f80adf09ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-29T12:18:42.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.743+0000 7f8090931700 10 RGWWatcher::handle_notify() notify_id 554050781218 cookie 94902189681744 notifier 4622 bl.length()=617 2019-11-29T12:18:42.745 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.744+0000 7f8090931700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T12:18:42.745 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:42.744+0000 7f8090931700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:43.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.164+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T12:18:43.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.164+0000 7f80adf09ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T12:18:43.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.164+0000 7f80adf09ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-29T12:18:43.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.175+0000 7f8090931700 10 RGWWatcher::handle_notify() notify_id 554050781219 cookie 94902189681744 notifier 4622 bl.length()=194 2019-11-29T12:18:43.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.175+0000 7f8090931700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T12:18:43.176 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.175+0000 7f8090931700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T12:18:43.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.370+0000 7f80adf09ec0 10 cache put: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB info.flags=0x7 2019-11-29T12:18:43.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.370+0000 7f80adf09ec0 10 moving default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB to cache LRU end 2019-11-29T12:18:43.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.371+0000 7f80adf09ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=186 2019-11-29T12:18:43.384 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.384+0000 7f8090931700 10 RGWWatcher::handle_notify() notify_id 554050781211 cookie 94902189678288 notifier 4622 bl.length()=186 2019-11-29T12:18:43.384 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.384+0000 7f8090931700 10 cache put: name=default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB info.flags=0x7 2019-11-29T12:18:43.385 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:43.384+0000 7f8090931700 10 moving default.rgw.meta+users.keys+WBEGSUTGRRJKAENNZKCB to cache LRU end 2019-11-29T12:18:43.982 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T12:18:43.982 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "bar.client.0", 2019-11-29T12:18:43.982 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. bar.client.0", 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "bar.client.0+test@test.test", 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T12:18:43.983 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "bar.client.0", 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "WBEGSUTGRRJKAENNZKCB", 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "aqyrZg4YESqs9u6IFsZzsh3deW3NN2k6AeTbg212Xm6Ssu8QR1J+Dw==" 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T12:18:43.984 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T12:18:43.985 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T12:18:43.985 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T12:18:43.989 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T12:18:43.989 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:18:43.989 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:18:43.989 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:18:43.990 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T12:18:43.991 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:44.052 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.051+0000 7f80adf09ec0 20 remove_watcher() i=0 2019-11-29T12:18:44.052 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.051+0000 7f80adf09ec0 2 removed watcher, disabling cache 2019-11-29T12:18:44.095 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.095+0000 7f80adf09ec0 20 remove_watcher() i=1 2019-11-29T12:18:44.136 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.136+0000 7f80adf09ec0 20 remove_watcher() i=2 2019-11-29T12:18:44.214 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.213+0000 7f80adf09ec0 20 remove_watcher() i=3 2019-11-29T12:18:44.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.265+0000 7f80adf09ec0 20 remove_watcher() i=4 2019-11-29T12:18:44.334 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.333+0000 7f80adf09ec0 20 remove_watcher() i=5 2019-11-29T12:18:44.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.392+0000 7f80adf09ec0 20 remove_watcher() i=6 2019-11-29T12:18:44.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.441+0000 7f80adf09ec0 20 remove_watcher() i=7 2019-11-29T12:18:44.449 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0236420615 --totp-seed MYYARHGC2GJHWALYX5WN75GBWW26IT5SNPJLIKHONRNAZVPRKV62ZRBVN26E5TKZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T12:18:44.751 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.750+0000 7fc3c43ce700 0 --2- 172.21.15.182:0/972420175 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x56417d011ca0 0x56417d018540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:18:44.860 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.859+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:44.889 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.889+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:44.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.889+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:44.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.900+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:44.901 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.900+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:44.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.907+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:44.908 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.907+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:44.923 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:44.922+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:45.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.118+0000 7fc3d79a2ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:45.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.118+0000 7fc3d79a2ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:45.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.118+0000 7fc3d79a2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:45.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.118+0000 7fc3d79a2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:45.119 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.118+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.127 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.127+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:45.127 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.127+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.140+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:45.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.140+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.151+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:45.152 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.151+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.163+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:45.164 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.163+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.171+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:45.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.171+0000 7fc3d79a2ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:45.172 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.171+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.178 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.177+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:45.178 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.177+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.185+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:45.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.185+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.204+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:45.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.204+0000 7fc3d79a2ec0 20 zonegroup default 2019-11-29T12:18:45.205 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.204+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.212+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:45.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.212+0000 7fc3d79a2ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:45.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.212+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.225+0000 7fc3d79a2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:45.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.225+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.237 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.236+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:45.237 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.236+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:45.248 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.247+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:45.248 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.247+0000 7fc3d79a2ec0 20 zone default found 2019-11-29T12:18:45.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.247+0000 7fc3d79a2ec0 20 started sync module instance, tier type = 2019-11-29T12:18:45.249 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.247+0000 7fc3d79a2ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:45.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=0 2019-11-29T12:18:45.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=1 2019-11-29T12:18:45.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=2 2019-11-29T12:18:45.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=3 2019-11-29T12:18:45.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=4 2019-11-29T12:18:45.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=5 2019-11-29T12:18:45.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3d79a2ec0 20 add_watcher() i=6 2019-11-29T12:18:45.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.795+0000 7fc3c4bcf700 0 -- 172.21.15.182:0/752882732 >> [v2:172.21.15.114:6810/10009,v1:172.21.15.114:6811/10009] conn(0x56417d045f50 msgr2=0x56417d048370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:18:45.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.864+0000 7fc3d79a2ec0 20 add_watcher() i=7 2019-11-29T12:18:45.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.864+0000 7fc3d79a2ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:45.865 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.864+0000 7fc3957e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:45.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:45.886+0000 7fc3c43ce700 0 -- 172.21.15.182:0/2330953038 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x56417d05fc30 msgr2=0x56417d062050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:46.089 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:46.088+0000 7fc3c43ce700 0 --2- 172.21.15.182:0/2330953038 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x56417d05fc30 0x56417d062050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:18:47.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc3077fe700 20 reqs_thread_entry: start 2019-11-29T12:18:47.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc3057fa700 20 reqs_thread_entry: start 2019-11-29T12:18:47.943 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc3d79a2ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:47.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc2f37fe700 20 reqs_thread_entry: start 2019-11-29T12:18:47.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc3d79a2ec0 20 get_system_obj_state: rctx=0x7ffe2870e518 obj=default.rgw.meta:users.uid:bar.client.0 state=0x56417d0d74d0 s->prefetch_data=0 2019-11-29T12:18:47.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.942+0000 7fc3d79a2ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T12:18:47.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-29T12:18:47.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:47.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:18:47.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:18:47.960 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T12:18:47.961 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.959+0000 7fc3d79a2ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:47.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.985+0000 7fc3d79a2ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-29T12:18:47.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.985+0000 7fc3d79a2ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-29T12:18:47.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:47.985+0000 7fc3d79a2ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:50.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.224+0000 7fc3d79a2ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T12:18:50.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.224+0000 7fc3d79a2ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:50.225 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.224+0000 7fc3d79a2ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-29T12:18:50.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.242+0000 7fc3ba7fc700 10 RGWWatcher::handle_notify() notify_id 562640715812 cookie 94839270273776 notifier 4927 bl.length()=631 2019-11-29T12:18:50.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.242+0000 7fc3ba7fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T12:18:50.243 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.242+0000 7fc3ba7fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T12:18:50.534 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.533+0000 7fc3d79a2ec0 20 remove_watcher() i=0 2019-11-29T12:18:50.534 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.533+0000 7fc3d79a2ec0 2 removed watcher, disabling cache 2019-11-29T12:18:50.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.586+0000 7fc3d79a2ec0 20 remove_watcher() i=1 2019-11-29T12:18:50.618 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.617+0000 7fc3d79a2ec0 20 remove_watcher() i=2 2019-11-29T12:18:50.687 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.687+0000 7fc3d79a2ec0 20 remove_watcher() i=3 2019-11-29T12:18:50.730 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.729+0000 7fc3d79a2ec0 20 remove_watcher() i=4 2019-11-29T12:18:50.824 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:50.823+0000 7fc3d79a2ec0 20 remove_watcher() i=5 2019-11-29T12:18:51.113 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.113+0000 7fc3d79a2ec0 20 remove_watcher() i=6 2019-11-29T12:18:51.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.153+0000 7fc3d79a2ec0 20 remove_watcher() i=7 2019-11-29T12:18:51.160 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-29T12:18:51.161 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key KBNYYCBLDYXMUGHJYSUR --secret LFvKLk/GYrVjcZJsazHb3DUS6p86w7dYChq7rhkZUX72cpwMyz5bkQ== --email foo.client.0+test@test.test --cluster ceph 2019-11-29T12:18:51.297 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.295+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.356+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.358 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.356+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.371+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.371+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.377 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.377+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.378 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.377+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.386 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.386+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:51.591 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.590+0000 7f2d66a98ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:51.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.590+0000 7f2d66a98ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:51.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.590+0000 7f2d66a98ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:51.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.590+0000 7f2d66a98ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:51.592 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.591+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.597+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:51.598 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.597+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.625+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:51.625 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.625+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.641+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:51.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.641+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.650+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:51.651 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.650+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.657+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.657+0000 7f2d66a98ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:51.658 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.657+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.664 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.663+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.664 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.663+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.673 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.672+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:51.673 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.672+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.683+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:51.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.683+0000 7f2d66a98ec0 20 zonegroup default 2019-11-29T12:18:51.684 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.683+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.691+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.691+0000 7f2d66a98ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:51.692 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.691+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.698+0000 7f2d66a98ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:51.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.698+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.707+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:51.707 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.707+0000 7f2d66a98ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.725+0000 7f2d66a98ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.725+0000 7f2d66a98ec0 20 zone default found 2019-11-29T12:18:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.725+0000 7f2d66a98ec0 20 started sync module instance, tier type = 2019-11-29T12:18:51.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:51.725+0000 7f2d66a98ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:52.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=0 2019-11-29T12:18:52.064 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=1 2019-11-29T12:18:52.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=2 2019-11-29T12:18:52.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=3 2019-11-29T12:18:52.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=4 2019-11-29T12:18:52.065 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.063+0000 7f2d66a98ec0 20 add_watcher() i=5 2019-11-29T12:18:52.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.086+0000 7f2d66a98ec0 20 add_watcher() i=6 2019-11-29T12:18:52.097 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.095+0000 7f2d66a98ec0 20 add_watcher() i=7 2019-11-29T12:18:52.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.095+0000 7f2d66a98ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:52.098 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.096+0000 7f2ca7fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:52.100 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.099+0000 7f2d544c6700 0 -- 172.21.15.182:0/1024430058 >> v2:172.21.15.182:3300/0 conn(0x556a27ad3c90 msgr2=0x556a27ad40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:18:52.149 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:52.148+0000 7f2d4bfff700 0 -- 172.21.15.182:0/1138501200 >> [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] conn(0x556a27aec370 msgr2=0x556a27aee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.734+0000 7f2c927fc700 20 reqs_thread_entry: start 2019-11-29T12:18:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.734+0000 7f2c8bfff700 20 reqs_thread_entry: start 2019-11-29T12:18:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.734+0000 7f2d66a98ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.735+0000 7f2c8a7fc700 20 reqs_thread_entry: start 2019-11-29T12:18:53.741 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.735+0000 7f2d66a98ec0 20 get_system_obj_state: rctx=0x7fff79de79b8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x556a27b58e70 s->prefetch_data=0 2019-11-29T12:18:53.742 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.735+0000 7f2d66a98ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T12:18:53.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.748+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-29T12:18:53.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.748+0000 7f2d66a98ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:53.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.748+0000 7f2d66a98ec0 20 get_system_obj_state: rctx=0x7fff79de79c8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x556a27b5ac00 s->prefetch_data=0 2019-11-29T12:18:53.750 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.748+0000 7f2d66a98ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-29T12:18:53.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.764+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-29T12:18:53.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.764+0000 7f2d66a98ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T12:18:53.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.764+0000 7f2d66a98ec0 20 get_system_obj_state: rctx=0x7fff79de79c8 obj=default.rgw.meta:users.keys:KBNYYCBLDYXMUGHJYSUR state=0x556a27b5ac00 s->prefetch_data=0 2019-11-29T12:18:53.765 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.764+0000 7f2d66a98ec0 10 cache get: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR : miss 2019-11-29T12:18:53.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.771+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR info.flags=0x0 2019-11-29T12:18:53.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.771+0000 7f2d66a98ec0 10 adding default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR to cache LRU end 2019-11-29T12:18:53.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.771+0000 7f2d66a98ec0 20 get_system_obj_state: rctx=0x7fff79de75d8 obj=default.rgw.meta:users.keys:KBNYYCBLDYXMUGHJYSUR state=0x556a27b5ac00 s->prefetch_data=0 2019-11-29T12:18:53.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.771+0000 7f2d66a98ec0 10 cache get: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR : type miss (requested=0x6, cached=0x0) 2019-11-29T12:18:53.780 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.780+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR info.flags=0x0 2019-11-29T12:18:53.781 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.780+0000 7f2d66a98ec0 10 moving default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR to cache LRU end 2019-11-29T12:18:53.781 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.780+0000 7f2d66a98ec0 20 get_system_obj_state: rctx=0x7fff79de7758 obj=default.rgw.meta:users.keys:KBNYYCBLDYXMUGHJYSUR state=0x556a27b5ac00 s->prefetch_data=0 2019-11-29T12:18:53.781 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.780+0000 7f2d66a98ec0 10 cache get: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR : type miss (requested=0x6, cached=0x0) 2019-11-29T12:18:53.788 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.787+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR info.flags=0x0 2019-11-29T12:18:53.788 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.787+0000 7f2d66a98ec0 10 moving default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR to cache LRU end 2019-11-29T12:18:53.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.850+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T12:18:53.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.850+0000 7f2d66a98ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:53.851 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.850+0000 7f2d66a98ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-29T12:18:53.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.865+0000 7f2d497fa700 10 RGWWatcher::handle_notify() notify_id 566935683100 cookie 93914420465968 notifier 4649 bl.length()=617 2019-11-29T12:18:53.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.865+0000 7f2d497fa700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T12:18:53.866 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:53.865+0000 7f2d497fa700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:54.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.032+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T12:18:54.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.032+0000 7f2d66a98ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T12:18:54.033 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.032+0000 7f2d66a98ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-29T12:18:54.052 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.052+0000 7f2d497fa700 10 RGWWatcher::handle_notify() notify_id 566935683133 cookie 93914420507456 notifier 4649 bl.length()=194 2019-11-29T12:18:54.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.052+0000 7f2d497fa700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T12:18:54.053 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.052+0000 7f2d497fa700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T12:18:54.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.183+0000 7f2d66a98ec0 10 cache put: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR info.flags=0x7 2019-11-29T12:18:54.184 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.183+0000 7f2d66a98ec0 10 moving default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR to cache LRU end 2019-11-29T12:18:54.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.183+0000 7f2d66a98ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=186 2019-11-29T12:18:54.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.203+0000 7f2d497fa700 10 RGWWatcher::handle_notify() notify_id 566935683134 cookie 93914420507456 notifier 4649 bl.length()=186 2019-11-29T12:18:54.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.203+0000 7f2d497fa700 10 cache put: name=default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR info.flags=0x7 2019-11-29T12:18:54.204 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.203+0000 7f2d497fa700 10 moving default.rgw.meta+users.keys+KBNYYCBLDYXMUGHJYSUR to cache LRU end 2019-11-29T12:18:54.327 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T12:18:54.327 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "foo.client.0", 2019-11-29T12:18:54.327 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. foo.client.0", 2019-11-29T12:18:54.327 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "foo.client.0+test@test.test", 2019-11-29T12:18:54.327 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "foo.client.0", 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "KBNYYCBLDYXMUGHJYSUR", 2019-11-29T12:18:54.328 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "LFvKLk/GYrVjcZJsazHb3DUS6p86w7dYChq7rhkZUX72cpwMyz5bkQ==" 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T12:18:54.329 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:18:54.330 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:18:54.331 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T12:18:54.332 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:18:54.427 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.424+0000 7f2d66a98ec0 20 remove_watcher() i=0 2019-11-29T12:18:54.427 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.424+0000 7f2d66a98ec0 2 removed watcher, disabling cache 2019-11-29T12:18:54.471 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.471+0000 7f2d66a98ec0 20 remove_watcher() i=1 2019-11-29T12:18:54.513 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.512+0000 7f2d66a98ec0 20 remove_watcher() i=2 2019-11-29T12:18:54.587 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.586+0000 7f2d66a98ec0 20 remove_watcher() i=3 2019-11-29T12:18:54.631 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.631+0000 7f2d66a98ec0 20 remove_watcher() i=4 2019-11-29T12:18:54.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.672+0000 7f2d66a98ec0 20 remove_watcher() i=5 2019-11-29T12:18:54.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.747+0000 7f2d66a98ec0 20 remove_watcher() i=6 2019-11-29T12:18:54.796 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.795+0000 7f2d66a98ec0 20 remove_watcher() i=7 2019-11-29T12:18:54.803 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 7932329843 --totp-seed IRNT72XLNLXNDKOFKZ3ADJGGSIS5CUOI7VSP6HDX63LCOPQJ6N56XJ6XTVEBSEEL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T12:18:54.923 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.922+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:54.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.943+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:54.944 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.943+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:54.956 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.956+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:54.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.956+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:54.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.962+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:54.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.962+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:54.969 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:54.969+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:55.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.152+0000 7f4c3da29ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:55.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.152+0000 7f4c3da29ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:55.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.152+0000 7f4c3da29ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:55.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.152+0000 7f4c3da29ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:55.153 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.152+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.164+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:55.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.164+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.178 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.177+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:55.178 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.177+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.188+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:55.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.188+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.211+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:55.212 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.211+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.227+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:55.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.227+0000 7f4c3da29ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:55.230 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.227+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.234+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:55.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.234+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.243+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:55.244 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.243+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.261+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:55.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.261+0000 7f4c3da29ec0 20 zonegroup default 2019-11-29T12:18:55.262 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.261+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.268+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:55.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.268+0000 7f4c3da29ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:55.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.268+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.275+0000 7f4c3da29ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:55.276 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.275+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.284+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:55.284 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.284+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:55.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.294+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:55.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.294+0000 7f4c3da29ec0 20 zone default found 2019-11-29T12:18:55.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.294+0000 7f4c3da29ec0 20 started sync module instance, tier type = 2019-11-29T12:18:55.295 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.294+0000 7f4c3da29ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:55.677 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=0 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=1 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=2 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=3 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=4 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=5 2019-11-29T12:18:55.678 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.671+0000 7f4c3da29ec0 20 add_watcher() i=6 2019-11-29T12:18:55.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.714+0000 7f4c3da29ec0 20 add_watcher() i=7 2019-11-29T12:18:55.715 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.714+0000 7f4c3da29ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:55.716 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.714+0000 7f4bfb7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:55.721 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.721+0000 7f4c2ac56700 0 -- 172.21.15.182:0/3142313872 >> v2:172.21.15.114:3300/0 conn(0x565272381660 msgr2=0x565272387a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T12:18:55.924 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.923+0000 7f4c2ac56700 0 --2- 172.21.15.182:0/3142313872 >> v2:172.21.15.114:3300/0 conn(0x565272381660 0x565272387a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:18:55.957 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:55.957+0000 7f4c23fff700 0 -- 172.21.15.182:0/3582133969 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x5652723909d0 msgr2=0x565272392df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:18:57.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.474+0000 7f4b69ffb700 20 reqs_thread_entry: start 2019-11-29T12:18:57.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.474+0000 7f4b637fe700 20 reqs_thread_entry: start 2019-11-29T12:18:57.475 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.474+0000 7f4c3da29ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:18:57.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.475+0000 7f4b61ffb700 20 reqs_thread_entry: start 2019-11-29T12:18:57.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.475+0000 7f4c3da29ec0 20 get_system_obj_state: rctx=0x7fff613da108 obj=default.rgw.meta:users.uid:foo.client.0 state=0x565272403410 s->prefetch_data=0 2019-11-29T12:18:57.476 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.475+0000 7f4c3da29ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T12:18:57.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.496+0000 7f4c3da29ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-29T12:18:57.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.496+0000 7f4c3da29ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:57.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.496+0000 7f4c3da29ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:18:57.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.496+0000 7f4c3da29ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:18:57.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.496+0000 7f4c3da29ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T12:18:57.498 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.497+0000 7f4c3da29ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:57.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.523+0000 7f4c3da29ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-29T12:18:57.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.523+0000 7f4c3da29ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-29T12:18:57.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.523+0000 7f4c3da29ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:57.710 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.709+0000 7f4c3da29ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T12:18:57.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.709+0000 7f4c3da29ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:57.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.709+0000 7f4c3da29ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-29T12:18:57.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.730+0000 7f4c0bfff700 10 RGWWatcher::handle_notify() notify_id 566935683101 cookie 94912103489920 notifier 4963 bl.length()=631 2019-11-29T12:18:57.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.730+0000 7f4c0bfff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T12:18:57.737 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:57.730+0000 7f4c0bfff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T12:18:58.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.159+0000 7f4c3da29ec0 20 remove_watcher() i=0 2019-11-29T12:18:58.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.159+0000 7f4c3da29ec0 2 removed watcher, disabling cache 2019-11-29T12:18:58.217 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.216+0000 7f4c3da29ec0 20 remove_watcher() i=1 2019-11-29T12:18:58.247 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.246+0000 7f4c3da29ec0 20 remove_watcher() i=2 2019-11-29T12:18:58.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.304+0000 7f4c3da29ec0 20 remove_watcher() i=3 2019-11-29T12:18:58.354 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.354+0000 7f4c3da29ec0 20 remove_watcher() i=4 2019-11-29T12:18:58.419 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.418+0000 7f4c3da29ec0 20 remove_watcher() i=5 2019-11-29T12:18:58.460 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.460+0000 7f4c3da29ec0 20 remove_watcher() i=6 2019-11-29T12:18:58.508 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.507+0000 7f4c3da29ec0 20 remove_watcher() i=7 2019-11-29T12:18:58.515 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-29T12:18:58.516 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key ISJIKRASVNIAAQBSQBPT --secret H6viqJGs2ZJrR7GBpDBEHqCB6okX61A9Vkxe018RqXYPth2oqkv8nA== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-29T12:18:58.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.653+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.682+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:58.683 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.682+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.695 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.694+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:58.695 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.694+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.703+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:58.704 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.703+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.711+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:58.933 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.932+0000 7f0517461ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:18:58.933 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.932+0000 7f0517461ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:18:58.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.932+0000 7f0517461ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:18:58.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.932+0000 7f0517461ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:18:58.934 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.932+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.942 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.942+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:58.942 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.942+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.953+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:58.954 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.953+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.961+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:58.962 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.961+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.971+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:58.972 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.971+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.978+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:58.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.978+0000 7f0517461ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:18:58.985 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.978+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.986+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:58.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.986+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:58.996 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.996+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:58.997 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:58.996+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:59.012 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.011+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:18:59.012 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.011+0000 7f0517461ec0 20 zonegroup default 2019-11-29T12:18:59.012 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.011+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:59.018 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.018+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:59.019 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.018+0000 7f0517461ec0 10 Cannot find current period zone using local zone 2019-11-29T12:18:59.019 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.018+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:59.027 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.026+0000 7f0517461ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:18:59.027 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.026+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:59.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.035+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:18:59.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.035+0000 7f0517461ec0 20 rados->read ofs=0 len=0 2019-11-29T12:18:59.051 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.050+0000 7f0517461ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:18:59.051 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.050+0000 7f0517461ec0 20 zone default found 2019-11-29T12:18:59.051 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.050+0000 7f0517461ec0 20 started sync module instance, tier type = 2019-11-29T12:18:59.051 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.050+0000 7f0517461ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:18:59.371 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=0 2019-11-29T12:18:59.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=1 2019-11-29T12:18:59.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=2 2019-11-29T12:18:59.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=3 2019-11-29T12:18:59.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=4 2019-11-29T12:18:59.372 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.370+0000 7f0517461ec0 20 add_watcher() i=5 2019-11-29T12:18:59.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.391+0000 7f0517461ec0 20 add_watcher() i=6 2019-11-29T12:18:59.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.411+0000 7f0517461ec0 20 add_watcher() i=7 2019-11-29T12:18:59.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.411+0000 7f0517461ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:18:59.413 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.412+0000 7f04d4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:18:59.419 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.417+0000 7f050468e700 0 -- 172.21.15.182:0/2021774417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x564b5982a100 msgr2=0x564b5982c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T12:18:59.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.620+0000 7f050468e700 0 --2- 172.21.15.182:0/2021774417 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x564b5982a100 0x564b5982c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T12:18:59.672 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:18:59.670+0000 7f0503e8d700 0 -- 172.21.15.182:0/2614319330 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x564b59832e40 msgr2=0x564b59835350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T12:19:01.137 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.134+0000 7f0446ffd700 20 reqs_thread_entry: start 2019-11-29T12:19:01.137 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.135+0000 7f0444ff9700 20 reqs_thread_entry: start 2019-11-29T12:19:01.137 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.135+0000 7f0517461ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:19:01.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.136+0000 7f043affd700 20 reqs_thread_entry: start 2019-11-29T12:19:01.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.136+0000 7f0517461ec0 20 get_system_obj_state: rctx=0x7fff14ce1f38 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x564b598a7e00 s->prefetch_data=0 2019-11-29T12:19:01.138 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.136+0000 7f0517461ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T12:19:01.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.145+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-29T12:19:01.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.145+0000 7f0517461ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:01.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.145+0000 7f0517461ec0 20 get_system_obj_state: rctx=0x7fff14ce1f48 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x564b598a9bb0 s->prefetch_data=0 2019-11-29T12:19:01.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.145+0000 7f0517461ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-29T12:19:01.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.155+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-29T12:19:01.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.155+0000 7f0517461ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T12:19:01.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.155+0000 7f0517461ec0 20 get_system_obj_state: rctx=0x7fff14ce1f48 obj=default.rgw.meta:users.keys:ISJIKRASVNIAAQBSQBPT state=0x564b598a9bb0 s->prefetch_data=0 2019-11-29T12:19:01.157 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.155+0000 7f0517461ec0 10 cache get: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT : miss 2019-11-29T12:19:01.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.169+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT info.flags=0x0 2019-11-29T12:19:01.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.169+0000 7f0517461ec0 10 adding default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT to cache LRU end 2019-11-29T12:19:01.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.169+0000 7f0517461ec0 20 get_system_obj_state: rctx=0x7fff14ce1b58 obj=default.rgw.meta:users.keys:ISJIKRASVNIAAQBSQBPT state=0x564b598a9bb0 s->prefetch_data=0 2019-11-29T12:19:01.171 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.169+0000 7f0517461ec0 10 cache get: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT : type miss (requested=0x6, cached=0x0) 2019-11-29T12:19:01.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.177+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT info.flags=0x0 2019-11-29T12:19:01.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.177+0000 7f0517461ec0 10 moving default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT to cache LRU end 2019-11-29T12:19:01.180 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.177+0000 7f0517461ec0 20 get_system_obj_state: rctx=0x7fff14ce1cd8 obj=default.rgw.meta:users.keys:ISJIKRASVNIAAQBSQBPT state=0x564b598a9bb0 s->prefetch_data=0 2019-11-29T12:19:01.180 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.177+0000 7f0517461ec0 10 cache get: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT : type miss (requested=0x6, cached=0x0) 2019-11-29T12:19:01.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.183+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT info.flags=0x0 2019-11-29T12:19:01.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.183+0000 7f0517461ec0 10 moving default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT to cache LRU end 2019-11-29T12:19:01.265 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.263+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T12:19:01.265 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.263+0000 7f0517461ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:01.266 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.263+0000 7f0517461ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-29T12:19:01.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.275+0000 7f04e9ffb700 10 RGWWatcher::handle_notify() notify_id 566935683134 cookie 94881624188096 notifier 4914 bl.length()=691 2019-11-29T12:19:01.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.275+0000 7f04e9ffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T12:19:01.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.275+0000 7f04e9ffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:01.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.868+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-29T12:19:01.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.868+0000 7f0517461ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T12:19:01.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.868+0000 7f0517461ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-29T12:19:01.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.884+0000 7f04e9ffb700 10 RGWWatcher::handle_notify() notify_id 566935683135 cookie 94881624205792 notifier 4914 bl.length()=224 2019-11-29T12:19:01.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.884+0000 7f04e9ffb700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-29T12:19:01.887 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:01.884+0000 7f04e9ffb700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-29T12:19:02.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.392+0000 7f0517461ec0 10 cache put: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT info.flags=0x7 2019-11-29T12:19:02.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.392+0000 7f0517461ec0 10 moving default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT to cache LRU end 2019-11-29T12:19:02.393 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.392+0000 7f0517461ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=201 2019-11-29T12:19:02.402 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.402+0000 7f04e9ffb700 10 RGWWatcher::handle_notify() notify_id 566935683135 cookie 94881624167824 notifier 4914 bl.length()=201 2019-11-29T12:19:02.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.402+0000 7f04e9ffb700 10 cache put: name=default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT info.flags=0x7 2019-11-29T12:19:02.403 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.402+0000 7f04e9ffb700 10 moving default.rgw.meta+users.keys+ISJIKRASVNIAAQBSQBPT to cache LRU end 2019-11-29T12:19:02.495 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T12:19:02.495 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-29T12:19:02.495 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-29T12:19:02.495 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-29T12:19:02.495 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [], 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [ 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "testx$tenanteduser.client.0", 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "access_key": "ISJIKRASVNIAAQBSQBPT", 2019-11-29T12:19:02.496 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "H6viqJGs2ZJrR7GBpDBEHqCB6okX61A9Vkxe018RqXYPth2oqkv8nA==" 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [], 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T12:19:02.497 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:19:02.498 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T12:19:02.499 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T12:19:02.500 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:02.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.571+0000 7f0517461ec0 20 remove_watcher() i=0 2019-11-29T12:19:02.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.571+0000 7f0517461ec0 2 removed watcher, disabling cache 2019-11-29T12:19:02.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.622+0000 7f0517461ec0 20 remove_watcher() i=1 2019-11-29T12:19:02.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.659+0000 7f0517461ec0 20 remove_watcher() i=2 2019-11-29T12:19:02.730 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.729+0000 7f0517461ec0 20 remove_watcher() i=3 2019-11-29T12:19:02.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.788+0000 7f0517461ec0 20 remove_watcher() i=4 2019-11-29T12:19:02.840 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.839+0000 7f0517461ec0 20 remove_watcher() i=5 2019-11-29T12:19:02.897 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.897+0000 7f0517461ec0 20 remove_watcher() i=6 2019-11-29T12:19:02.955 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:02.955+0000 7f0517461ec0 20 remove_watcher() i=7 2019-11-29T12:19:02.965 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 8527574322 --totp-seed UYXVJIDGIUNPDIXLU46CNAIZNDVLZ3HKIVWOTLCXPCTCOWIOJMY62UBABO7YFWW5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-29T12:19:03.140 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.139+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.165+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.165+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.178+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.179 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.178+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.185+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.186 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.185+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.193+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:19:03.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.423+0000 7f19b7527ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T12:19:03.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.423+0000 7f19b7527ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T12:19:03.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.423+0000 7f19b7527ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T12:19:03.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.423+0000 7f19b7527ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T12:19:03.424 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.423+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.432 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.431+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:19:03.432 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.431+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.449+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:19:03.450 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.449+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.457 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.457+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:19:03.457 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.457+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.476+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:19:03.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.476+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.483+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.483+0000 7f19b7527ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T12:19:03.484 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.483+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.490+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.490 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.490+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.496+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:19:03.497 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.496+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.513 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.512+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T12:19:03.513 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.513+0000 7f19b7527ec0 20 zonegroup default 2019-11-29T12:19:03.513 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.513+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.524+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.524+0000 7f19b7527ec0 10 Cannot find current period zone using local zone 2019-11-29T12:19:03.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.524+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.530 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.529+0000 7f19b7527ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T12:19:03.530 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.529+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.539 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.539+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T12:19:03.540 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.539+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:03.557 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.556+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T12:19:03.557 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.556+0000 7f19b7527ec0 20 zone default found 2019-11-29T12:19:03.557 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.556+0000 7f19b7527ec0 20 started sync module instance, tier type = 2019-11-29T12:19:03.557 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:03.556+0000 7f19b7527ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T12:19:04.056 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=0 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=1 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=2 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=3 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=4 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=5 2019-11-29T12:19:04.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.055+0000 7f19b7527ec0 20 add_watcher() i=6 2019-11-29T12:19:04.090 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.089+0000 7f19b7527ec0 20 add_watcher() i=7 2019-11-29T12:19:04.090 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.089+0000 7f19b7527ec0 2 all 8 watchers are set, enabling cache 2019-11-29T12:19:04.091 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.090+0000 7f1974fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T12:19:04.099 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.099+0000 7f19a4f55700 0 -- 172.21.15.182:0/3377096907 >> v2:172.21.15.114:3300/0 conn(0x55651f2e8a90 msgr2=0x55651f2e8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T12:19:04.154 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:04.154+0000 7f19a4f55700 0 -- 172.21.15.182:0/447423725 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7f18e8019810 msgr2=0x7f18e801bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T12:19:05.571 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f18e6ffd700 20 reqs_thread_entry: start 2019-11-29T12:19:05.571 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f18e4ff9700 20 reqs_thread_entry: start 2019-11-29T12:19:05.571 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f19b7527ec0 20 init_complete bucket index max shards: 0 2019-11-29T12:19:05.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f18daffd700 20 reqs_thread_entry: start 2019-11-29T12:19:05.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f19b7527ec0 20 get_system_obj_state: rctx=0x7ffd873bef38 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55651f36de00 s->prefetch_data=0 2019-11-29T12:19:05.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.570+0000 7f19b7527ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.584+0000 7f19b7527ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.585+0000 7f19b7527ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.585+0000 7f19b7527ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.585+0000 7f19b7527ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.585+0000 7f19b7527ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T12:19:05.586 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.585+0000 7f19b7527ec0 20 rados->read ofs=0 len=0 2019-11-29T12:19:05.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.598+0000 7f19b7527ec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-29T12:19:05.599 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.598+0000 7f19b7527ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-29T12:19:05.600 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.598+0000 7f19b7527ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:05.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.789+0000 7f19b7527ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T12:19:05.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.789+0000 7f19b7527ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:05.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.789+0000 7f19b7527ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-29T12:19:05.807 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.807+0000 7f1999ffb700 10 RGWWatcher::handle_notify() notify_id 566935683136 cookie 93892803133312 notifier 4990 bl.length()=705 2019-11-29T12:19:05.808 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.807+0000 7f1999ffb700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-29T12:19:05.808 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:05.807+0000 7f1999ffb700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T12:19:05.885 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:03:14.019 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:05.888 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:03:14.024 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:05.893 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:03:14.078 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:05.894 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:03:14.077 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:05.897 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:03:14.080 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:05.898 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:03:14.083 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:06.028 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:03:14.211 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:06.034 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:03:14.218 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:06.058 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:03:14.194 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:19:06.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.095+0000 7f19b7527ec0 20 remove_watcher() i=0 2019-11-29T12:19:06.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.095+0000 7f19b7527ec0 2 removed watcher, disabling cache 2019-11-29T12:19:06.156 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.156+0000 7f19b7527ec0 20 remove_watcher() i=1 2019-11-29T12:19:06.203 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.200+0000 7f19b7527ec0 20 remove_watcher() i=2 2019-11-29T12:19:06.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.234+0000 7f19b7527ec0 20 remove_watcher() i=3 2019-11-29T12:19:06.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.280+0000 7f19b7527ec0 20 remove_watcher() i=4 2019-11-29T12:19:06.327 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.327+0000 7f19b7527ec0 20 remove_watcher() i=5 2019-11-29T12:19:06.379 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.378+0000 7f19b7527ec0 20 remove_watcher() i=6 2019-11-29T12:19:06.421 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T12:19:06.420+0000 7f19b7527ec0 20 remove_watcher() i=7 2019-11-29T12:19:06.427 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-29T12:19:06.427 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-29T12:19:11.787 INFO:teuthology.orchestra.run.smithi182.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-29T12:19:11.936 INFO:teuthology.orchestra.run.smithi182.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-29T12:19:11.978 INFO:teuthology.orchestra.run.smithi182.stdout:Loading mirror speeds from cached hostfile 2019-11-29T12:19:11.979 INFO:teuthology.orchestra.run.smithi182.stdout: * base: mirror.math.princeton.edu 2019-11-29T12:19:11.980 INFO:teuthology.orchestra.run.smithi182.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-29T12:19:11.980 INFO:teuthology.orchestra.run.smithi182.stdout: * extras: mirrors.greenmountainaccess.net 2019-11-29T12:19:11.980 INFO:teuthology.orchestra.run.smithi182.stdout: * updates: mirror.datto.com 2019-11-29T12:19:12.715 INFO:teuthology.orchestra.run.smithi182.stdout:7 packages excluded due to repository priority protections 2019-11-29T12:19:13.059 INFO:teuthology.orchestra.run.smithi182.stdout:Resolving Dependencies 2019-11-29T12:19:13.060 INFO:teuthology.orchestra.run.smithi182.stdout:--> Running transaction check 2019-11-29T12:19:13.060 INFO:teuthology.orchestra.run.smithi182.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-29T12:19:13.463 INFO:teuthology.orchestra.run.smithi182.stdout:--> Finished Dependency Resolution 2019-11-29T12:19:13.697 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:13.697 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies Resolved 2019-11-29T12:19:13.698 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:13.698 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T12:19:13.698 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2019-11-29T12:19:13.698 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout:Installing: 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout:Install 1 Package 2019-11-29T12:19:13.699 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:13.700 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 23 k 2019-11-29T12:19:13.700 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 27 k 2019-11-29T12:19:13.700 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading packages: 2019-11-29T12:19:13.813 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2019-11-29T12:19:13.818 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2019-11-29T12:19:13.820 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded 2019-11-29T12:19:13.820 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2019-11-29T12:19:14.324 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-29T12:19:14.757 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-29T12:19:14.757 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:14.757 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2019-11-29T12:19:14.757 INFO:teuthology.orchestra.run.smithi182.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-29T12:19:14.757 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:14.758 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2019-11-29T12:19:14.931 INFO:teuthology.orchestra.run.smithi182.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-29T12:19:16.302 INFO:teuthology.orchestra.run.smithi182.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T12:19:16.666 INFO:teuthology.orchestra.run.smithi182.stderr:Cache entry deserialization failed, entry ignored 2019-11-29T12:19:16.806 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting pip 2019-11-29T12:19:16.891 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-29T12:19:16.959 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: pip 2019-11-29T12:19:16.960 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: pip 9.0.1 2019-11-29T12:19:17.023 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling pip-9.0.1: 2019-11-29T12:19:17.067 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T12:19:17.680 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed pip-19.3.1 2019-11-29T12:19:17.958 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:19:18.428 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting setuptools==32.3.1 2019-11-29T12:19:18.431 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-29T12:19:18.469 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: setuptools 2019-11-29T12:19:18.470 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T12:19:18.484 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T12:19:18.492 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T12:19:18.613 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed setuptools-32.3.1 2019-11-29T12:19:19.065 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T12:19:19.304 INFO:teuthology.orchestra.run.smithi182.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-29T12:19:19.373 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting nose>=1.0.0 2019-11-29T12:19:19.375 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-29T12:19:19.473 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting boto>=2.6.0 2019-11-29T12:19:19.479 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-29T12:19:19.990 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting boto3>=1.0.0 2019-11-29T12:19:20.056 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/67/17/567f679dac6ec93611ce05637094e9736afa40e41c9ed0aaefd90de6f7e8/boto3-1.10.28-py2.py3-none-any.whl (128kB) 2019-11-29T12:19:20.215 INFO:teuthology.orchestra.run.smithi182.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-29T12:19:20.492 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting gevent>=1.0 2019-11-29T12:19:20.506 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T12:19:20.751 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting isodate>=0.4.4 2019-11-29T12:19:20.760 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-29T12:19:20.911 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting requests>=0.14.0 2019-11-29T12:19:20.920 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-29T12:19:21.171 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting pytz>=2011k 2019-11-29T12:19:21.181 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-29T12:19:21.378 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting ordereddict 2019-11-29T12:19:21.389 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-29T12:19:21.726 INFO:teuthology.orchestra.run.smithi182.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-29T12:19:22.103 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting lxml 2019-11-29T12:19:22.117 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T12:19:22.886 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting botocore<1.14.0,>=1.13.28 2019-11-29T12:19:22.897 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/8e/b3/ab9044d3aa14208f5b6f69665d5f82ad9b028809666e4e70dac1ab0bfd3a/botocore-1.13.28-py2.py3-none-any.whl (5.7MB) 2019-11-29T12:19:23.465 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-29T12:19:23.477 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-29T12:19:23.582 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-29T12:19:23.593 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-29T12:19:23.766 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T12:19:23.767 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T12:19:23.858 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting six 2019-11-29T12:19:23.869 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-29T12:19:23.955 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-29T12:19:23.966 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-29T12:19:24.070 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting idna<2.9,>=2.5 2019-11-29T12:19:24.083 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-29T12:19:24.218 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-29T12:19:24.227 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-29T12:19:24.358 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting certifi>=2017.4.17 2019-11-29T12:19:24.369 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-11-29T12:19:24.481 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting docutils<0.16,>=0.10 2019-11-29T12:19:24.492 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-29T12:19:24.675 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-29T12:19:24.685 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-29T12:19:24.808 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-29T12:19:24.819 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-29T12:19:24.886 INFO:teuthology.orchestra.run.smithi182.stdout:Building wheels for collected packages: ordereddict 2019-11-29T12:19:24.887 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for ordereddict (setup.py): started 2019-11-29T12:19:25.157 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-29T12:19:25.157 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=64bca0a5c4f0d776ca7ab6a47794e6a96e63dc61024e73569aef3def73d8c13c 2019-11-29T12:19:25.157 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-29T12:19:25.161 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully built ordereddict 2019-11-29T12:19:25.271 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-29T12:19:27.543 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.28 botocore-1.13.28 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-29T12:19:27.856 INFO:teuthology.orchestra.run.smithi182.stdout:running develop 2019-11-29T12:19:27.912 INFO:teuthology.orchestra.run.smithi182.stdout:running egg_info 2019-11-29T12:19:27.912 INFO:teuthology.orchestra.run.smithi182.stdout:creating s3tests.egg-info 2019-11-29T12:19:27.912 INFO:teuthology.orchestra.run.smithi182.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-29T12:19:27.912 INFO:teuthology.orchestra.run.smithi182.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-29T12:19:27.912 INFO:teuthology.orchestra.run.smithi182.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-29T12:19:27.913 INFO:teuthology.orchestra.run.smithi182.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-29T12:19:27.915 INFO:teuthology.orchestra.run.smithi182.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-29T12:19:27.916 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T12:19:27.916 INFO:teuthology.orchestra.run.smithi182.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T12:19:27.917 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-29T12:19:27.917 INFO:teuthology.orchestra.run.smithi182.stdout:running build_ext 2019-11-29T12:19:27.918 INFO:teuthology.orchestra.run.smithi182.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-29T12:19:27.918 INFO:teuthology.orchestra.run.smithi182.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-29T12:19:27.920 INFO:teuthology.orchestra.run.smithi182.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T12:19:27.920 INFO:teuthology.orchestra.run.smithi182.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T12:19:27.921 INFO:teuthology.orchestra.run.smithi182.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T12:19:27.921 INFO:teuthology.orchestra.run.smithi182.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T12:19:27.921 INFO:teuthology.orchestra.run.smithi182.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-29T12:19:27.921 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.921 INFO:teuthology.orchestra.run.smithi182.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-29T12:19:27.922 INFO:teuthology.orchestra.run.smithi182.stdout:Processing dependencies for s3tests==0.0.1 2019-11-29T12:19:27.971 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for isodate==0.6.0 2019-11-29T12:19:27.971 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: isodate 0.6.0 2019-11-29T12:19:27.972 INFO:teuthology.orchestra.run.smithi182.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-29T12:19:27.972 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.972 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.973 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for gevent==1.4.0 2019-11-29T12:19:27.973 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: gevent 1.4.0 2019-11-29T12:19:27.973 INFO:teuthology.orchestra.run.smithi182.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-29T12:19:27.973 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.973 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for bunch==1.0.1 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: bunch 1.0.1 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for PyYAML==5.1.2 2019-11-29T12:19:27.975 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: PyYAML 5.1.2 2019-11-29T12:19:27.976 INFO:teuthology.orchestra.run.smithi182.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-29T12:19:27.976 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.976 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for boto3==1.10.28 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: boto3 1.10.28 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout:Adding boto3 1.10.28 to easy-install.pth file 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.977 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for boto==2.49.0 2019-11-29T12:19:27.978 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: boto 2.49.0 2019-11-29T12:19:27.979 INFO:teuthology.orchestra.run.smithi182.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-29T12:19:27.979 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.979 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.979 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for six==1.13.0 2019-11-29T12:19:27.980 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: six 1.13.0 2019-11-29T12:19:27.980 INFO:teuthology.orchestra.run.smithi182.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-29T12:19:27.980 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.980 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.981 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for greenlet==0.4.15 2019-11-29T12:19:27.981 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: greenlet 0.4.15 2019-11-29T12:19:27.981 INFO:teuthology.orchestra.run.smithi182.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for s3transfer==0.2.1 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: s3transfer 0.2.1 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-29T12:19:27.982 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.983 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.985 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for jmespath==0.9.4 2019-11-29T12:19:27.985 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: jmespath 0.9.4 2019-11-29T12:19:27.985 INFO:teuthology.orchestra.run.smithi182.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-29T12:19:27.985 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for botocore==1.13.28 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: botocore 1.13.28 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Adding botocore 1.13.28 to easy-install.pth file 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.986 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for futures==3.3.0 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: futures 3.3.0 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for urllib3==1.25.7 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: urllib3 1.25.7 2019-11-29T12:19:27.987 INFO:teuthology.orchestra.run.smithi182.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for python-dateutil==2.8.0 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: python-dateutil 2.8.0 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.988 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.989 INFO:teuthology.orchestra.run.smithi182.stdout:Searching for docutils==0.15.2 2019-11-29T12:19:27.989 INFO:teuthology.orchestra.run.smithi182.stdout:Best match: docutils 0.15.2 2019-11-29T12:19:27.990 INFO:teuthology.orchestra.run.smithi182.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-29T12:19:27.990 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T12:19:27.990 INFO:teuthology.orchestra.run.smithi182.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-29T12:19:27.990 INFO:teuthology.orchestra.run.smithi182.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-29T12:19:27.998 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-29T12:19:28.043 INFO:tasks.s3tests:Configuring boto... 2019-11-29T12:19:28.043 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-29T12:19:28.158 INFO:teuthology.orchestra.run.smithi182:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-29T12:19:32.337 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-29T12:19:34.969 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-29T12:19:38.047 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-29T12:19:40.785 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-29T12:19:43.172 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-29T12:19:45.179 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-29T12:19:48.860 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-29T12:19:50.855 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-29T12:19:52.019 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-29T12:19:52.337 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-29T12:19:54.436 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-29T12:19:57.191 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-29T12:19:59.640 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-29T12:20:01.967 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-29T12:20:02.037 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-29T12:20:02.126 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-29T12:20:02.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-29T12:20:02.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-29T12:20:02.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-29T12:20:02.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-29T12:20:02.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-29T12:20:02.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-29T12:20:02.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-29T12:20:02.132 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-29T12:20:02.132 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-29T12:20:02.132 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-29T12:20:02.133 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-29T12:20:02.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-29T12:20:02.135 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-29T12:20:02.135 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-29T12:20:09.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-29T12:20:09.062 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-29T12:20:09.062 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-29T12:20:09.062 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-29T12:20:09.062 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-29T12:20:16.137 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-29T12:20:21.770 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-29T12:20:28.322 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-29T12:20:31.807 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-29T12:20:36.449 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-29T12:20:39.866 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-29T12:20:43.220 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-29T12:20:50.183 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-29T12:20:50.183 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-29T12:20:50.183 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-29T12:20:50.183 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-29T12:20:50.183 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-29T12:20:50.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-29T12:20:50.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-29T12:20:50.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-29T12:20:50.187 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-29T12:20:50.187 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-29T12:20:50.187 INFO:teuthology.orchestra.run.smithi182.stderr:SKIP 2019-11-29T12:20:50.191 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-29T12:22:16.080 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-29T12:22:16.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-29T12:22:16.426 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-29T12:22:16.588 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-29T12:22:16.937 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-29T12:22:16.960 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-29T12:22:16.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-29T12:22:16.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-29T12:22:16.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-29T12:22:16.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-29T12:22:16.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-29T12:22:16.982 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-29T12:22:16.985 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-29T12:22:16.986 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-29T12:22:16.986 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-29T12:22:16.986 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-29T12:22:16.990 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-29T12:22:16.991 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-29T12:22:16.991 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-29T12:22:16.991 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-29T12:22:17.014 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-29T12:22:17.039 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-29T12:22:17.039 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-29T12:22:17.192 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-29T12:22:19.217 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-11-29T12:22:31.209 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-11-29T12:22:32.494 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-11-29T12:22:36.554 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-11-29T12:22:41.572 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-11-29T12:22:45.505 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-11-29T12:22:51.597 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-11-29T12:22:54.435 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-11-29T12:22:58.720 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-11-29T12:23:01.526 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-11-29T12:23:05.295 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-11-29T12:23:07.585 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-11-29T12:23:09.889 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-11-29T12:23:12.049 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-11-29T12:23:12.241 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-11-29T12:23:14.307 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-11-29T12:23:19.911 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-11-29T12:23:26.155 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-11-29T12:23:28.926 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-11-29T12:23:31.039 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-11-29T12:23:33.205 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-11-29T12:23:36.698 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-11-29T12:23:39.143 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-11-29T12:23:40.857 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:07:48.993 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:40.875 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:07:49.012 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:40.912 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:07:49.095 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:40.912 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:07:49.096 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:40.913 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:07:49.097 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:40.945 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:07:49.129 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:41.047 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:07:49.230 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:41.094 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:07:49.279 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:41.142 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:07:49.278 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:23:41.220 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-11-29T12:23:43.445 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-11-29T12:23:43.612 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-11-29T12:23:43.759 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-11-29T12:23:43.881 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-11-29T12:23:44.034 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-11-29T12:23:44.069 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-11-29T12:23:47.632 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-11-29T12:23:55.615 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-11-29T12:24:03.826 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-11-29T12:24:10.126 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-11-29T12:24:17.677 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:08:25.814 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.683 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:08:25.820 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.697 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:08:25.880 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.704 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:08:25.888 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.707 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:08:25.891 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.722 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:08:25.906 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.750 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:08:25.886 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.754 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:08:25.937 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:17.790 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:08:25.974 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:24:18.610 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-11-29T12:24:25.542 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-11-29T12:24:31.934 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-11-29T12:24:43.636 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-11-29T12:24:56.949 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-11-29T12:25:01.258 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-11-29T12:25:05.942 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-11-29T12:25:12.701 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-11-29T12:25:20.045 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-11-29T12:25:31.391 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-11-29T12:25:42.736 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-11-29T12:25:51.972 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-11-29T12:25:58.974 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-11-29T12:26:06.331 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-11-29T12:26:12.781 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-11-29T12:26:19.614 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-11-29T12:26:28.139 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-11-29T12:26:36.482 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-11-29T12:26:44.569 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-11-29T12:26:51.725 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-11-29T12:26:58.591 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-11-29T12:27:06.640 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-11-29T12:27:13.218 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-11-29T12:27:20.177 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-11-29T12:27:26.818 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-11-29T12:27:32.234 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-11-29T12:27:37.937 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-11-29T12:27:43.757 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-11-29T12:29:31.201 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:13:39.337 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.206 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:13:39.342 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.216 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:13:39.400 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.221 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:13:39.405 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.239 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:13:39.423 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.242 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:13:39.426 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.387 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:13:39.523 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.412 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:13:39.596 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:29:31.420 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:13:39.604 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.600 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:16:10.736 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.604 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:16:10.740 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.645 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:16:10.828 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.646 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:16:10.829 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.648 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:16:10.832 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.653 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:16:10.837 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.709 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:16:10.845 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.725 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:16:10.909 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:32:02.737 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:16:10.921 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.528 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:18:50.665 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.540 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:18:50.676 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.541 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:18:50.725 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.546 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:18:50.729 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.547 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:18:50.732 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.552 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:18:50.736 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.648 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:18:50.784 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.656 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:18:50.840 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:34:42.666 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:18:50.850 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.259 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:03.395 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.265 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:03.401 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.268 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:03.452 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.273 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:03.456 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.274 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:03.458 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.277 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:03.462 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.461 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:03.645 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.476 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:03.659 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:39:55.485 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:03.621 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.375 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:32.511 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.383 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:32.519 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.403 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:32.587 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.418 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:24:32.554 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.453 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:32.637 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.453 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:32.637 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.459 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:32.643 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.497 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:24:32.681 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:40:24.509 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:24:32.693 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.842 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:29:14.978 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.848 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:29:14.983 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.854 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:29:15.038 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.857 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:29:15.040 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.858 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:29:15.043 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:06.862 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:29:15.046 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:07.015 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:29:15.149 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:07.111 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:29:15.295 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:45:07.118 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:29:15.302 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:47:26.732 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-11-29T12:47:33.765 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-11-29T12:47:41.333 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-11-29T12:47:47.692 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-11-29T12:47:53.549 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-11-29T12:47:57.886 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-11-29T12:48:01.974 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-11-29T12:48:07.315 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-11-29T12:48:12.816 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-11-29T12:48:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-11-29T12:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-11-29T12:48:30.224 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-11-29T12:48:34.769 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-11-29T12:48:41.019 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-11-29T12:48:46.103 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:32:54.238 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.115 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:32:54.250 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.156 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:32:54.340 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.158 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:32:54.341 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.186 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:32:54.370 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.190 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:32:54.374 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.212 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:32:54.347 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.291 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:32:54.474 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.316 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:32:54.500 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:48:46.886 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-11-29T12:48:51.765 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-11-29T12:48:57.924 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-11-29T12:49:06.338 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-11-29T12:49:15.280 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-11-29T12:49:20.292 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-11-29T12:49:27.615 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-11-29T12:49:35.273 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-29T12:49:42.980 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-29T12:49:52.796 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-11-29T12:50:00.870 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-11-29T12:50:08.211 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-11-29T12:50:14.978 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-11-29T12:50:19.101 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:34:27.237 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.112 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:34:27.247 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.116 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:34:27.300 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.121 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:34:27.305 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.124 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:34:27.308 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.127 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:34:27.311 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.216 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:34:27.352 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.220 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:34:27.404 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:19.223 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:34:27.407 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:50:21.251 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-11-29T12:50:30.728 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-11-29T12:51:02.635 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-11-29T12:51:36.711 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-11-29T12:51:44.542 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-11-29T12:51:49.058 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-11-29T12:51:56.996 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-11-29T12:52:03.129 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-11-29T12:52:08.325 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-11-29T12:52:15.316 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-11-29T12:52:21.463 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-11-29T12:52:29.688 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-11-29T12:52:34.753 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-11-29T12:52:42.856 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-11-29T12:52:50.018 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-11-29T12:53:10.577 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-11-29T12:53:15.079 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-11-29T12:53:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-11-29T12:53:21.646 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-11-29T12:53:24.702 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-11-29T12:53:25.028 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-11-29T12:53:25.375 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-11-29T12:53:25.887 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-11-29T12:53:30.285 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-11-29T12:53:37.523 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-11-29T12:53:38.673 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-11-29T12:53:46.971 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-11-29T12:53:49.514 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-11-29T12:53:51.967 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-11-29T12:54:04.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-11-29T12:54:15.063 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-11-29T12:54:19.169 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-11-29T12:54:22.507 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-11-29T12:54:26.519 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-11-29T12:54:30.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-11-29T12:54:37.908 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-11-29T12:54:42.193 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-11-29T12:54:46.329 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-11-29T12:54:53.519 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-11-29T12:54:56.522 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-11-29T12:55:01.917 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-11-29T12:55:06.824 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-11-29T12:55:10.705 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-11-29T12:55:14.386 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-11-29T12:55:18.613 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-11-29T12:55:21.124 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-11-29T12:55:25.209 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-11-29T12:55:29.082 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-11-29T12:55:32.014 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:39:40.149 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.028 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:39:40.163 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.030 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:39:40.214 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.035 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:39:40.219 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.035 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:39:40.219 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.039 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:39:40.223 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.216 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:39:40.399 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.243 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:39:40.427 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:32.304 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:39:40.439 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:55:33.282 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-11-29T12:55:36.743 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-11-29T12:55:42.256 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-11-29T12:55:45.185 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-11-29T12:55:48.595 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-11-29T12:55:53.338 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-11-29T12:55:56.712 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-11-29T12:55:58.993 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-11-29T12:56:00.929 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-11-29T12:56:04.318 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-11-29T12:56:06.377 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-11-29T12:56:09.417 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-11-29T12:56:14.012 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-11-29T12:56:16.946 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-11-29T12:56:19.625 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-11-29T12:56:23.832 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-11-29T12:56:27.322 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-11-29T12:56:30.772 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-11-29T12:56:33.946 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-11-29T12:56:36.410 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-11-29T12:56:39.394 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-11-29T12:56:41.945 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-11-29T12:56:44.731 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-11-29T12:56:47.572 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-11-29T12:56:49.873 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-11-29T12:56:55.991 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-11-29T12:56:59.759 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-11-29T12:57:03.785 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-11-29T12:57:06.488 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-11-29T12:57:07.984 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:41:16.119 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:07.989 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:41:16.125 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.018 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:41:16.202 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.039 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:41:16.223 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.042 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:41:16.226 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.044 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:41:16.228 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.062 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:41:16.198 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.107 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:41:16.291 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:08.121 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:41:16.304 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:57:09.663 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-11-29T12:57:16.186 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-11-29T12:57:20.406 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-11-29T12:57:23.041 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-11-29T12:57:28.905 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-11-29T12:57:32.476 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-11-29T12:57:37.586 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-11-29T12:57:39.485 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-11-29T12:57:47.482 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-11-29T12:57:52.826 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-11-29T12:57:55.899 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-11-29T12:57:59.356 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-11-29T12:58:01.841 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-11-29T12:58:08.993 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-11-29T12:58:13.488 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:42:21.623 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.495 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:42:21.631 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.539 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:42:21.723 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.571 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:42:21.707 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.580 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:42:21.764 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.587 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:42:21.772 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.594 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:42:21.778 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.648 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:42:21.831 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:13.655 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:42:21.839 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T12:58:15.026 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-11-29T12:58:21.085 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-11-29T12:58:23.078 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-11-29T12:58:28.727 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-11-29T12:58:31.857 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-11-29T12:58:34.225 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-11-29T12:58:36.913 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-11-29T12:58:40.554 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-11-29T12:58:43.456 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-11-29T12:58:47.085 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-11-29T12:58:54.840 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-11-29T12:58:57.427 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-11-29T12:59:00.845 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-11-29T12:59:04.155 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-11-29T12:59:07.432 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-11-29T12:59:10.421 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-11-29T12:59:13.399 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-11-29T12:59:18.628 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-11-29T12:59:22.458 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-11-29T12:59:25.464 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-11-29T12:59:26.138 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-11-29T12:59:26.509 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-11-29T12:59:27.338 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-11-29T12:59:28.281 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-11-29T12:59:32.208 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-11-29T12:59:35.279 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-11-29T12:59:39.628 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-11-29T12:59:42.707 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-11-29T12:59:44.163 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-11-29T12:59:47.480 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-11-29T12:59:49.813 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-11-29T12:59:52.527 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-11-29T12:59:57.329 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-11-29T13:00:00.512 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-11-29T13:00:06.924 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-11-29T13:00:12.030 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-11-29T13:00:17.218 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-11-29T13:00:23.063 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-11-29T13:00:27.868 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-11-29T13:00:33.924 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-11-29T13:00:39.128 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-11-29T13:00:43.614 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:44:51.750 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.621 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:44:51.756 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.629 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:44:51.813 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.633 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:44:51.817 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.634 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:44:51.818 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.636 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:44:51.821 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.732 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:44:51.916 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.738 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:44:51.874 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.740 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:44:51.924 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:00:43.827 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-11-29T13:00:47.255 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-11-29T13:00:53.305 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-11-29T13:01:00.387 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-11-29T13:01:05.572 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-11-29T13:01:11.630 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-11-29T13:01:18.821 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-11-29T13:01:23.313 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-11-29T13:01:27.771 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-11-29T13:01:31.813 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-11-29T13:01:37.132 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-11-29T13:01:38.765 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-11-29T13:01:44.799 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-11-29T13:01:47.748 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-11-29T13:01:52.449 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-11-29T13:01:55.127 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-11-29T13:01:58.514 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-11-29T13:02:04.311 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-11-29T13:02:13.061 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-11-29T13:02:19.943 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-11-29T13:02:27.785 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-11-29T13:02:37.650 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-11-29T13:02:45.763 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-11-29T13:02:53.925 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-11-29T13:02:59.848 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-11-29T13:03:09.671 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-11-29T13:03:20.691 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-11-29T13:03:32.400 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-11-29T13:03:45.001 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-11-29T13:03:56.025 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-11-29T13:04:10.230 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-11-29T13:04:10.940 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-11-29T13:04:11.434 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-11-29T13:04:11.536 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-11-29T13:04:22.341 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-11-29T13:04:32.279 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-11-29T13:04:34.313 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-11-29T13:04:36.256 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-11-29T13:04:45.134 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-11-29T13:05:14.813 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-11-29T13:05:23.178 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-11-29T13:05:30.510 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:49:38.645 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.516 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:49:38.651 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.556 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:49:38.741 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.558 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:49:38.743 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.587 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:49:38.771 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.590 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:49:38.774 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.633 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:49:38.768 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.722 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:49:38.907 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:30.751 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:49:38.935 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:31.105 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-11-29T13:05:36.590 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-11-29T13:05:42.239 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-11-29T13:05:45.651 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-11-29T13:05:51.178 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-11-29T13:05:55.695 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:50:03.829 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.703 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:50:03.839 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.717 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:50:03.902 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.717 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:50:03.902 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.723 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:50:03.907 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.723 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:50:03.907 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.766 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:50:03.902 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.787 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:50:03.971 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:55.788 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:50:03.973 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:05:57.536 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-11-29T13:06:03.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-11-29T13:06:11.351 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-11-29T13:06:21.235 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-11-29T13:06:33.130 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-11-29T13:06:46.099 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-11-29T13:06:49.646 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-11-29T13:06:52.125 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-11-29T13:07:34.200 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-11-29T13:07:46.583 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-11-29T13:08:24.289 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:08:24.273+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:08:59.161 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-11-29T13:09:01.882 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-11-29T13:09:08.206 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-11-29T13:09:21.869 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:09:21.799+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:09:22.546 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-11-29T13:09:26.984 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-11-29T13:09:38.954 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-11-29T13:10:07.750 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:10:07.747+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:10:21.328 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:10:21.316+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:10:36.545 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-11-29T13:11:08.643 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:55:16.775 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.655 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:55:16.790 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.660 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:55:16.845 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.661 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:55:16.846 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.662 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:55:16.847 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.665 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:55:16.850 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.845 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:55:17.030 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.852 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:55:17.036 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:08.899 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:55:17.035 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:11:11.621 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:11:11.596+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:11:40.770 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:11:40.667+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:11:44.305 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-11-29T13:12:36.587 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:12:36.488+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:12:54.805 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:12:54.736+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:12:56.960 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:12:56.942+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:13:15.543 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:13:15.524+0000 40a60700 -1 handle_data failed with exit code -5 2019-11-29T13:13:17.515 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:13:17.506+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:13:19.263 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-11-29T13:13:19.281 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:13:19.275+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:13:50.907 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:13:50.826+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:13:52.226 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:58:00.362 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.235 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:58:00.371 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.274 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:58:00.459 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.275 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:58:00.460 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.277 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:58:00.462 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.288 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:58:00.472 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.354 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:01:58:00.539 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.359 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:01:58:00.495 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:13:52.362 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:01:58:00.547 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:14:19.494 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:14:19.470+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:14:51.164 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:14:51.043+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:15:16.748 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:15:16.727+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:16:16.963 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:00:25.098 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:16.973 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:00:25.109 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:16.984 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:00:25.169 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:16.990 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:00:25.174 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:16.990 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:00:25.175 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:16.995 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:00:25.180 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:17.087 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:00:25.223 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:17.090 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:00:25.274 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:16:17.099 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:00:25.285 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:17:27.393 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:17:27.324+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:17:54.272 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:17:54.222+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:18:40.211 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:18:40.183+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:19:01.228 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:19:01.213+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:19:03.150 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-11-29T13:20:15.081 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-11-29T13:20:32.792 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:20:32.777+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:20:45.233 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:20:45.165+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:20:57.615 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:20:57.546+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:21:14.825 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:21:14.657+0000 3fa5e700 -1 handle_data failed with exit code -5 2019-11-29T13:21:29.763 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:05:37.898 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.773 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:05:37.909 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.779 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:05:37.965 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.781 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:05:37.966 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.783 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:05:37.968 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.791 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:05:37.976 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.975 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:05:38.111 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.995 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:05:38.180 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:29.995 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:05:38.181 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:21:32.897 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:21:32.854+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:21:47.597 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T13:21:47.489+0000 4025f700 -1 handle_data failed with exit code -5 2019-11-29T13:21:48.427 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-11-29T13:22:13.841 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:06:21.967 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.841 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:06:21.973 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.845 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:06:22.030 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.853 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:06:22.036 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.864 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:06:22.049 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:06:22.059 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.883 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:06:22.018 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.925 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:06:22.110 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:13.942 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:06:22.127 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:22:15.473 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-11-29T13:22:33.717 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-11-29T13:22:49.500 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-11-29T13:23:01.108 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-11-29T13:23:05.074 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-11-29T13:23:28.481 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-11-29T13:23:33.430 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-11-29T13:23:39.105 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-11-29T13:23:43.695 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-11-29T13:23:47.593 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-11-29T13:24:08.749 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-11-29T13:24:16.569 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-11-29T13:24:24.692 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-11-29T13:24:32.713 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-11-29T13:24:43.884 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-11-29T13:24:53.583 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-11-29T13:25:02.937 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-11-29T13:25:15.465 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-11-29T13:25:33.102 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-11-29T13:25:46.433 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-11-29T13:26:01.293 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-11-29T13:26:27.037 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-11-29T13:26:34.206 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-11-29T13:26:39.385 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:10:47.520 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.390 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:10:47.526 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.401 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:10:47.586 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.403 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:10:47.588 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.468 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:10:47.653 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.474 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:10:47.659 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.563 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:10:47.699 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.574 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:10:47.759 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:39.716 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:10:47.900 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:26:41.592 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-11-29T13:27:01.046 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-11-29T13:27:05.338 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-11-29T13:27:14.649 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-11-29T13:27:16.885 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-11-29T13:27:21.441 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-11-29T13:27:27.060 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-11-29T13:27:31.401 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-11-29T13:27:39.069 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-11-29T13:30:35.957 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:14:44.092 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:35.964 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:14:44.100 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:35.990 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:14:44.175 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.003 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:14:44.188 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.026 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:14:44.210 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.027 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:14:44.212 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.114 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:14:44.250 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.124 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:14:44.309 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:30:36.145 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:14:44.330 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:39.152 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-11-29T13:31:49.572 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:15:57.708 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.583 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:15:57.719 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.587 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:15:57.772 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.592 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:15:57.777 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.594 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:15:57.779 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.600 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:15:57.785 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.661 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:15:57.846 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.662 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:15:57.847 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:31:49.692 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:15:57.825 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:32:31.925 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-11-29T13:32:40.826 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-11-29T13:32:58.100 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-11-29T13:33:13.554 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-11-29T13:35:09.209 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-11-29T13:36:49.614 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-11-29T13:36:59.778 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:21:07.913 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.791 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:21:07.927 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.799 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:21:07.984 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.809 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:21:07.988 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.817 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:21:07.992 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.823 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:21:07.995 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:36:59.990 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:21:08.175 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:37:00.035 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:21:08.219 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:37:00.043 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:21:08.179 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.670 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:22:50.806 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.683 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:22:50.819 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.752 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:22:50.937 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.754 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:22:50.938 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.773 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:22:50.958 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.775 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:22:50.961 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.808 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:22:50.943 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.840 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:22:51.024 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:42.856 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:22:51.040 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.808 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:23:05.944 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.811 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:23:05.948 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.855 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:23:06.040 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.859 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:23:06.043 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.860 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:23:06.046 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.864 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:23:06.049 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.867 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:23:06.003 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.879 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:23:06.064 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:38:57.887 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:23:06.072 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.038 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:26:19.174 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.046 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:26:19.182 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.058 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:26:19.243 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.062 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:26:19.247 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.062 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:26:19.246 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.068 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:26:19.253 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.203 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:26:19.339 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.248 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:26:19.433 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:42:11.251 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:26:19.435 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:43:06.552 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-11-29T13:44:47.806 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-11-29T13:45:28.141 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-11-29T13:46:09.029 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-11-29T13:46:35.774 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-11-29T13:47:06.204 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-11-29T13:47:14.038 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-11-29T13:47:19.621 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:27.758 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.623 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:27.760 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.688 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:27.873 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.725 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:27.909 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.725 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:27.911 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.728 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:27.912 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.748 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:27.885 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.852 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:28.037 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:19.900 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:28.085 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.161 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:32.297 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.167 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:32.352 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.172 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:32.357 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.173 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:32.358 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.174 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:32.311 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.175 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:32.360 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.200 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:31:32.385 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.205 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:31:32.390 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:24.207 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:31:32.343 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:47:30.076 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-11-29T13:47:47.064 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-11-29T13:47:52.889 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... Exception in thread Thread-53: 2019-11-29T13:47:52.889 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:47:52.889 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:47:52.889 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:47:52.889 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:47:52.890 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:47:52.891 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:47:52.891 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-54: 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:47:52.958 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:47:52.959 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:47:52.959 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:47:52.959 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:47:52.959 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:47:52.959 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:47:52.960 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:47:52.960 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:47:52.960 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:47:53.260 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-55: 2019-11-29T13:47:53.260 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:47:53.260 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:47:53.261 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:47:53.262 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:47:53.262 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:47:53.262 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:47:53.262 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:47:53.266 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-52: 2019-11-29T13:47:53.266 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:47:53.266 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:47:53.267 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:47:53.268 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:47:53.268 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:47:53.268 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:47:53.268 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:47:53.268 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-62: 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:03.292 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:03.293 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:03.294 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:03.324 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-65: 2019-11-29T13:48:03.324 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:03.324 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:03.324 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:03.325 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:03.326 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:03.326 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:03.326 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:03.331 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-63: 2019-11-29T13:48:03.331 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:03.331 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:03.331 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:03.332 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:03.333 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:03.333 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:03.333 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:03.333 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:03.406 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-61: 2019-11-29T13:48:03.406 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:03.406 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:03.406 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:03.406 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:03.407 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:03.408 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:03.408 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:03.408 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:13.212 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-73: 2019-11-29T13:48:13.212 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:13.213 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:13.214 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:13.214 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:13.214 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:13.214 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:13.214 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:13.240 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-75: 2019-11-29T13:48:13.240 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:13.240 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:13.240 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:13.240 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:13.241 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:13.241 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:13.244 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:13.245 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:13.245 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:13.245 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:13.245 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:13.246 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:13.246 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:13.354 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-74: 2019-11-29T13:48:13.354 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:13.355 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:13.356 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:13.356 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:13.356 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:13.356 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:13.356 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:13.603 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-72: 2019-11-29T13:48:13.603 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:13.603 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:13.603 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:13.604 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:13.605 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:13.605 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:13.605 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:13.605 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:24.916 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-81: 2019-11-29T13:48:24.916 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:24.916 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:24.916 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:24.917 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:24.918 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:24.918 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-82: 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:25.082 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:25.083 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:25.091 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-85: 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:25.092 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:25.093 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:25.094 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-83: 2019-11-29T13:48:25.094 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:25.094 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:25.095 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:25.096 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:25.096 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:25.096 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:25.096 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:25.097 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-95: 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:37.209 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:37.210 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:37.211 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:37.231 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-94: 2019-11-29T13:48:37.231 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:37.231 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:37.231 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:37.232 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-92: 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:37.233 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:37.234 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:37.235 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:37.235 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:37.338 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-91: 2019-11-29T13:48:37.340 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:37.340 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:37.341 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:37.342 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:37.342 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:37.342 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:37.342 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:44.204 INFO:teuthology.orchestra.run.smithi182.stderr:ok 2019-11-29T13:48:51.014 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... Exception in thread Thread-104: 2019-11-29T13:48:51.014 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.015 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.016 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.016 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.016 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.016 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.016 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.150 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-105: 2019-11-29T13:48:51.150 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.151 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.152 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.152 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.152 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.152 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.152 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.193 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-101: 2019-11-29T13:48:51.193 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.193 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.194 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.195 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.195 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.195 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.195 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.195 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-107: 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.196 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.197 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.227 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-103: 2019-11-29T13:48:51.227 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.228 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.229 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.229 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.229 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.229 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.229 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.335 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-109: 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.336 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.337 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.352 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-106: 2019-11-29T13:48:51.352 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.352 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.352 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.352 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.353 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.354 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.354 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr:Exception in thread Thread-108: 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr:Traceback (most recent call last): 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr: self.run() 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-11-29T13:48:51.382 INFO:teuthology.orchestra.run.smithi182.stderr: self.__target(*self.__args, **self.__kwargs) 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 357, in _api_call 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: return self._make_api_call(operation_name, kwargs) 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 661, in _make_api_call 2019-11-29T13:48:51.383 INFO:teuthology.orchestra.run.smithi182.stderr: raise error_class(parsed_response, operation_name) 2019-11-29T13:48:51.384 INFO:teuthology.orchestra.run.smithi182.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-11-29T13:48:51.384 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T13:49:07.447 INFO:teuthology.orchestra.run.smithi182.stderr:ok 2019-11-29T13:49:11.197 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-11-29T13:49:18.079 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-11-29T13:49:23.974 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-11-29T13:49:26.441 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-11-29T13:49:29.422 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-11-29T13:49:32.227 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-11-29T13:49:37.436 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-11-29T13:49:39.754 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-11-29T13:49:45.533 INFO:teuthology.orchestra.run.smithi182.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-11-29T13:49:52.399 INFO:teuthology.orchestra.run.smithi182.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-11-29T13:49:58.433 INFO:teuthology.orchestra.run.smithi182.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-11-29T13:50:08.363 INFO:teuthology.orchestra.run.smithi182.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-11-29T13:50:14.119 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-11-29T13:50:18.979 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-11-29T13:50:22.853 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-11-29T13:50:27.114 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-11-29T13:50:33.949 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-11-29T13:50:37.861 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-11-29T13:50:41.455 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-11-29T13:50:46.406 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-11-29T13:50:50.927 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-11-29T13:50:55.404 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-11-29T13:50:59.345 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-11-29T13:51:02.799 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-11-29T13:51:05.883 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-11-29T13:51:08.497 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-11-29T13:51:11.772 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-11-29T13:51:13.756 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-11-29T13:52:35.388 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-11-29T13:52:35.756 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:36:43.893 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.762 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:36:43.899 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.772 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:36:43.956 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.773 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:36:43.958 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.775 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:36:43.960 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.776 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:36:43.960 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:35.947 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:36:44.083 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:36.006 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:36:44.191 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:52:36.011 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:36:44.195 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:53:09.613 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-11-29T13:53:14.295 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-11-29T13:53:19.161 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-11-29T13:53:22.696 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-11-29T13:53:24.488 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-11-29T13:53:26.960 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-11-29T13:54:48.926 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-11-29T13:55:23.007 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-11-29T13:55:41.355 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:39:49.492 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.414 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:39:49.550 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.433 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:39:49.616 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.443 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:39:49.628 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.478 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:39:49.662 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.499 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:39:49.683 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.528 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:39:49.665 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.580 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:39:49.764 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:41.648 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:39:49.832 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:55:53.398 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-11-29T13:55:57.775 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-11-29T13:56:01.231 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-11-29T13:56:05.724 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-11-29T13:56:10.347 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-11-29T13:56:14.964 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-11-29T13:56:18.927 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-11-29T13:56:24.501 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-11-29T13:56:30.087 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-11-29T13:56:38.640 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-11-29T13:56:47.767 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-11-29T13:56:58.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-11-29T13:57:07.461 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-11-29T13:57:14.246 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-11-29T13:57:21.184 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-11-29T13:57:28.460 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-11-29T13:57:36.210 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-11-29T13:57:44.330 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-11-29T13:57:46.556 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:41:54.693 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.569 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:41:54.705 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.579 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:41:54.764 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.583 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:41:54.767 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.585 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:41:54.770 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.586 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:41:54.771 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.684 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:41:54.868 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.685 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:41:54.870 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:46.740 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:41:54.877 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T13:57:49.148 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-11-29T13:57:55.710 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-11-29T13:58:01.849 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-11-29T13:58:08.017 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-11-29T13:58:11.055 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-11-29T13:58:13.477 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-11-29T13:58:17.791 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-11-29T13:58:24.263 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-11-29T13:58:30.066 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-11-29T13:58:38.197 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-11-29T13:58:50.495 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-11-29T14:00:14.659 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-11-29T14:00:23.195 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-11-29T14:00:34.543 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-11-29T14:00:46.259 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-11-29T14:01:01.004 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-11-29T14:01:13.723 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-11-29T14:01:19.864 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-11-29T14:01:31.625 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-11-29T14:01:43.427 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-11-29T14:01:48.015 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-11-29T14:01:50.085 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-11-29T14:01:52.942 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-11-29T14:01:55.727 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-11-29T14:01:58.653 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-11-29T14:02:01.310 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-11-29T14:02:03.623 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-11-29T14:02:08.590 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-11-29T14:02:11.237 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-11-29T14:02:22.767 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-11-29T14:02:25.927 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-11-29T14:02:32.388 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-11-29T14:02:43.518 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-11-29T14:02:47.295 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-11-29T14:02:58.286 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:47:06.423 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.300 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:47:06.434 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.303 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:47:06.487 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.308 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:47:06.492 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.311 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:47:06.495 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.315 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:47:06.499 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.496 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:47:06.680 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.501 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:47:06.638 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:02:58.503 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:47:06.687 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:03:00.545 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-11-29T14:03:12.329 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-11-29T14:03:24.837 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-11-29T14:03:33.059 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-11-29T14:03:47.339 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-11-29T14:03:58.286 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-11-29T14:04:03.487 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:48:11.624 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.492 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:48:11.629 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.502 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:48:11.686 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.510 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:48:11.694 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.519 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:48:11.703 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.521 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:48:11.706 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.542 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:48:11.679 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.581 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:48:11.765 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:03.582 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:48:11.767 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:04:04.450 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-11-29T14:04:07.703 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-11-29T14:04:15.309 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-11-29T14:04:26.154 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-11-29T14:04:30.305 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-11-29T14:04:39.792 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-11-29T14:04:50.275 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-11-29T14:05:04.677 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-11-29T14:05:18.848 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-11-29T14:05:18.865 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-29T14:08:09.439 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:52:17.576 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.454 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:52:17.591 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.459 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:52:17.644 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.464 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:52:17.648 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.467 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:52:17.650 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.482 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:52:17.667 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.641 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:52:17.825 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.649 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:52:17.786 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:08:09.655 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:52:17.840 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.273 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:56:33.410 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.280 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:56:33.417 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.321 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:56:33.506 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.326 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:56:33.511 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.331 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:56:33.515 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.332 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:56:33.517 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.428 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:56:33.613 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.446 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:56:33.630 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:12:25.538 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:56:33.675 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.195 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:57:27.332 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.213 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:57:27.397 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.218 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:57:27.403 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.220 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:57:27.357 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.230 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:57:27.414 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.237 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:57:27.421 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.266 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:02:57:27.451 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.296 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:02:57:27.480 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:13:19.346 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:02:57:27.483 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.134 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:02:39.271 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.141 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:02:39.278 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.148 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:02:39.333 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.153 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:02:39.338 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.155 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:02:39.339 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.167 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:02:39.345 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.318 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:02:39.455 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.356 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:02:39.540 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:18:31.363 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:02:39.547 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.007 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:03:10.144 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.008 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:03:10.145 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.064 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:03:10.248 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.066 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:03:10.251 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.094 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:03:10.231 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.114 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:03:10.298 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.114 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:03:10.298 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.137 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:03:10.321 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:19:02.171 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:03:10.354 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.612 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:04:55.748 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.616 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:04:55.753 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.635 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:04:55.820 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.657 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:04:55.842 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.666 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:04:55.850 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.680 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:04:55.852 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.698 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:04:55.834 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.723 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:04:55.905 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:20:47.736 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:04:55.919 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.123 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:07:49.260 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.132 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:07:49.269 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.135 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:07:49.320 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:07:49.322 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:07:49.325 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.144 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:07:49.326 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.254 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:07:49.438 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.258 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:07:49.443 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:23:41.266 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:07:49.403 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.658 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:01.794 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.664 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:01.801 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.669 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:01.853 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.670 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:01.854 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.671 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:01.856 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.677 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:01.860 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.855 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:02.039 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.864 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:02.001 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:28:53.922 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:02.106 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.475 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:22.612 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.496 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:22.681 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.501 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:22.638 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.502 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:22.687 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.516 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:22.700 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.522 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:22.706 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.532 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:13:22.669 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.535 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:13:22.720 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:29:14.548 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:13:22.732 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.513 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:18:13.651 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.525 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:18:13.662 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.526 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:18:13.711 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.527 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:18:13.711 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.531 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:18:13.716 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.533 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:18:13.717 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.724 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:18:13.908 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.739 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:18:13.923 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:34:05.744 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:18:13.881 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.198 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:21:44.335 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.242 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:21:44.379 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.248 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:21:44.432 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.249 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:21:44.434 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.253 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:21:44.438 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.261 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:21:44.446 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.339 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:21:44.524 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.353 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:21:44.537 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:37:36.388 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:21:44.525 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.286 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:23:26.423 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.293 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:23:26.430 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.319 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:23:26.504 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.321 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:23:26.506 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.321 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:23:26.506 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.323 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:23:26.508 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.386 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:23:26.571 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.389 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:23:26.574 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:39:18.393 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:23:26.531 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.552 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:28:38.688 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.588 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:28:38.726 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.596 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:28:38.780 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.603 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:28:38.788 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.639 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:28:38.824 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.642 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:28:38.826 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.789 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:28:38.974 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.808 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:28:38.992 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:44:30.828 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:28:38.965 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.884 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:30:06.021 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.893 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:30:06.030 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.930 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:30:06.114 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.933 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:30:06.117 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.948 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:30:06.133 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.954 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:30:06.139 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:57.987 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:30:06.124 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:58.035 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:30:06.219 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:45:58.051 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:30:06.236 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.727 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:27.912 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.728 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:27.912 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.737 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:27.874 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.746 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:27.883 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.752 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:27.937 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.765 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:27.949 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.934 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:28.072 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.956 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:28.140 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:19.956 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:28.141 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.962 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:59.099 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.968 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:59.106 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.976 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:59.161 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.979 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:59.163 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.981 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:59.167 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:50.984 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:59.168 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:51.015 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:38:59.153 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:51.020 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:38:59.205 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T14:54:51.027 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:38:59.212 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.277 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:44:09.414 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.288 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:44:09.425 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.297 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:44:09.482 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.300 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:44:09.484 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.303 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:44:09.488 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.304 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:44:09.489 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.475 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:44:09.613 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.492 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:44:09.677 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:00:01.506 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:44:09.690 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.670 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:46:49.808 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.679 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:46:49.817 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.722 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:46:49.906 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.730 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:46:49.915 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.731 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:46:49.915 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.733 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:46:49.917 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.803 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:46:49.940 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.806 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:46:49.990 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:02:41.820 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:46:50.004 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.478 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:49:21.616 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.484 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:49:21.621 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.492 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:49:21.676 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.496 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:49:21.680 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.497 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:49:21.682 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.502 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:49:21.687 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.623 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:49:21.808 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.638 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:49:21.775 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:05:13.640 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:49:21.824 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.526 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:54:35.664 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.542 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:54:35.680 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.553 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:54:35.738 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.557 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:54:35.741 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.557 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:54:35.742 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.560 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:54:35.745 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.766 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:54:35.951 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.804 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:54:35.988 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:10:27.822 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:54:35.960 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.539 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:55:11.676 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.552 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:55:11.690 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.569 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:55:11.754 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.581 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:55:11.766 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.585 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:55:11.770 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.593 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:55:11.731 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.611 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:55:11.795 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.622 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:55:11.807 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:11:03.647 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:55:11.831 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.474 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:59:48.612 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.489 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:59:48.627 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.500 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:59:48.684 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.503 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:59:48.688 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.508 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:59:48.692 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.511 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:59:48.696 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.674 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:03:59:48.859 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.731 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:03:59:48.869 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:15:40.800 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:03:59:48.984 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.201 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:03:33.339 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.220 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:03:33.358 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.263 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:03:33.448 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.264 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:03:33.449 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.274 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:03:33.459 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.276 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:03:33.460 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.327 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:03:33.465 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.355 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:03:33.540 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:19:25.438 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:03:33.622 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.587 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:04:58.725 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.597 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:04:58.735 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.609 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:04:58.794 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.611 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:04:58.795 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.612 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:04:58.797 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.617 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:04:58.801 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.669 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:04:58.807 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.677 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:04:58.862 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:20:50.687 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:04:58.871 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.211 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:10:09.349 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.221 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:10:09.359 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.223 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:10:09.408 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.223 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:10:09.408 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.226 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:10:09.411 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.227 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:10:09.412 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.406 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:10:09.591 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.415 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:10:09.599 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:26:01.460 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:10:09.598 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.051 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:11:55.189 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.053 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:11:55.191 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.091 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:11:55.276 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.093 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:11:55.279 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.124 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:11:55.308 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.128 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:11:55.266 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.137 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:11:55.322 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.165 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:11:55.350 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:27:47.186 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:11:55.371 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.465 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:15:20.602 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.474 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:15:20.612 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.486 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:15:20.671 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.487 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:15:20.672 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.491 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:15:20.676 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.492 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:15:20.677 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.617 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:15:20.802 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.622 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:15:20.760 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:31:12.644 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:15:20.829 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.185 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:17.323 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.194 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:17.332 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.240 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:17.425 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.242 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:17.427 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.257 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:17.442 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.279 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:17.464 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.355 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:17.493 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.397 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:17.582 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:09.399 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:17.584 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.549 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:30.687 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.553 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:30.691 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.560 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:30.745 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.563 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:30.748 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.564 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:30.749 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.573 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:30.758 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.589 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:20:30.727 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.603 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:20:30.789 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:36:22.604 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:20:30.789 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.433 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:24:53.570 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.435 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:24:53.574 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.484 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:24:53.668 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.489 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:24:53.673 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.530 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:24:53.714 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.531 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:24:53.716 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.613 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:24:53.751 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.689 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:24:53.873 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:45.721 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:24:53.897 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:40:49.617 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-29T15:40:49.624 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-29T15:40:49.624 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-29T15:40:49.624 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-29T15:40:49.624 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-29T15:40:49.624 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-29T15:40:49.625 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-29T15:40:49.981 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-29T15:40:50.143 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-29T15:40:50.484 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-29T15:40:50.510 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-29T15:40:50.532 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-29T15:40:50.532 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-29T15:40:50.532 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-29T15:40:50.532 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-29T15:40:50.532 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-29T15:40:50.533 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-29T15:40:50.533 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-29T15:40:50.533 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-29T15:40:50.533 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-29T15:40:50.534 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-29T15:40:50.534 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-29T15:40:50.537 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-29T15:40:50.537 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-29T15:40:50.538 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-29T15:40:50.538 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-29T15:40:50.542 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-29T15:40:50.543 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-29T15:40:50.543 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-29T15:40:50.543 INFO:teuthology.orchestra.run.smithi182.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-29T15:40:50.563 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-29T15:40:50.584 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-29T15:40:50.584 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-29T15:40:50.735 INFO:teuthology.orchestra.run.smithi182.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-29T15:40:50.735 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T15:40:50.736 INFO:teuthology.orchestra.run.smithi182.stderr:---------------------------------------------------------------------- 2019-11-29T15:40:50.736 INFO:teuthology.orchestra.run.smithi182.stderr:Ran 611 tests in 12082.265s 2019-11-29T15:40:50.736 INFO:teuthology.orchestra.run.smithi182.stderr: 2019-11-29T15:40:50.736 INFO:teuthology.orchestra.run.smithi182.stderr:OK (SKIP=75) 2019-11-29T15:40:50.782 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-29T15:40:50.783 INFO:teuthology.orchestra.run.smithi182:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-29T15:40:50.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-29T15:40:50.906 INFO:tasks.s3tests:Cleaning up boto... 2019-11-29T15:40:50.907 INFO:teuthology.orchestra.run.smithi182:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-29T15:40:50.973 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-29T15:40:51.096 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.096+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.121 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.121+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.121 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.121+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.133 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.132+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.133 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.133+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.139+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.139 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.139+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.146 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.146+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:51.414 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.414+0000 7f4ded0f6ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T15:40:51.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.414+0000 7f4ded0f6ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T15:40:51.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.414+0000 7f4ded0f6ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:40:51.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.414+0000 7f4ded0f6ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:40:51.415 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.414+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.422 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.422+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:51.422 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.422+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.440 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.440+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:40:51.441 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.440+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.446+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:51.447 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.446+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.472+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:40:51.473 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.472+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.486 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.486+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.487 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.486+0000 7f4ded0f6ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:40:51.487 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.486+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.494 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.494+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.494 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.494+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.504 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.504+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:51.505 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.504+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.523+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:40:51.524 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.523+0000 7f4ded0f6ec0 20 zonegroup default 2019-11-29T15:40:51.525 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.523+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.533 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.532+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.533 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.532+0000 7f4ded0f6ec0 10 Cannot find current period zone using local zone 2019-11-29T15:40:51.533 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.532+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.541 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.540+0000 7f4ded0f6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:51.541 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.540+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.548+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:51.548 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.548+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:51.568 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.568+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:40:51.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.568+0000 7f4ded0f6ec0 20 zone default found 2019-11-29T15:40:51.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.568+0000 7f4ded0f6ec0 20 started sync module instance, tier type = 2019-11-29T15:40:51.569 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.568+0000 7f4ded0f6ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T15:40:51.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=0 2019-11-29T15:40:51.909 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=1 2019-11-29T15:40:51.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=2 2019-11-29T15:40:51.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=3 2019-11-29T15:40:51.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=4 2019-11-29T15:40:51.910 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=5 2019-11-29T15:40:51.911 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.909+0000 7f4ded0f6ec0 20 add_watcher() i=6 2019-11-29T15:40:51.940 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.940+0000 7f4ded0f6ec0 20 add_watcher() i=7 2019-11-29T15:40:51.940 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.940+0000 7f4ded0f6ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:40:51.940 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.940+0000 7f4da9feb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:40:51.941 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.942+0000 7f4dda323700 0 -- 172.21.15.182:0/3299507622 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55d49a7e4ea0 msgr2=0x55d49a7eb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-29T15:40:51.981 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:51.981+0000 7f4dda323700 0 -- 172.21.15.182:0/1014037645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x55d49a7eef90 msgr2=0x55d49a7f13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:40:53.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.221+0000 7f4d1bfff700 20 reqs_thread_entry: start 2019-11-29T15:40:53.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.221+0000 7f4d19ffb700 20 reqs_thread_entry: start 2019-11-29T15:40:53.222 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.221+0000 7f4ded0f6ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:40:53.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.222+0000 7f4d07fff700 20 reqs_thread_entry: start 2019-11-29T15:40:53.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.222+0000 7f4ded0f6ec0 20 get_system_obj_state: rctx=0x7ffe0e02a3c8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55d49a862c20 s->prefetch_data=0 2019-11-29T15:40:53.223 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.222+0000 7f4ded0f6ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T15:40:53.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-29T15:40:53.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:40:53.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T15:40:53.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T15:40:53.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T15:40:53.235 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.233+0000 7f4ded0f6ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:53.260 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.261+0000 7f4ded0f6ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T15:40:53.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.261+0000 7f4ded0f6ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-29T15:40:53.261 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.261+0000 7f4ded0f6ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:40:53.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.288+0000 7f4ded0f6ec0 10 removing key index: WBEGSUTGRRJKAENNZKCB 2019-11-29T15:40:53.288 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.288+0000 7f4ded0f6ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-11-29T15:40:53.308 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.308+0000 7f4dcb7fe700 10 RGWWatcher::handle_notify() notify_id 566935683480 cookie 94371613301280 notifier 4682 bl.length()=170 2019-11-29T15:40:53.418 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.419+0000 7f4ded0f6ec0 10 removing email index: bar.client.0+test@test.test 2019-11-29T15:40:53.419 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.419+0000 7f4ded0f6ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-29T15:40:53.426 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:53.426+0000 7f4dcb7fe700 10 RGWWatcher::handle_notify() notify_id 566935683123 cookie 94371613304640 notifier 4682 bl.length()=178 2019-11-29T15:40:54.075 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.076+0000 7f4ded0f6ec0 10 removing user buckets index 2019-11-29T15:40:54.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.076+0000 7f4ded0f6ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-29T15:40:54.087 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.088+0000 7f4dcb7fe700 10 RGWWatcher::handle_notify() notify_id 566935683221 cookie 94371613302144 notifier 4682 bl.length()=169 2019-11-29T15:40:54.264 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.264+0000 7f4ded0f6ec0 10 removing user index: bar.client.0 2019-11-29T15:40:54.264 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.264+0000 7f4ded0f6ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-29T15:40:54.264 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.264+0000 7f4ded0f6ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-29T15:40:54.277 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.277+0000 7f4dcb7fe700 10 RGWWatcher::handle_notify() notify_id 566935683124 cookie 94371613304640 notifier 4682 bl.length()=161 2019-11-29T15:40:54.589 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.589+0000 7f4ded0f6ec0 20 remove_watcher() i=0 2019-11-29T15:40:54.589 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.589+0000 7f4ded0f6ec0 2 removed watcher, disabling cache 2019-11-29T15:40:54.626 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.626+0000 7f4ded0f6ec0 20 remove_watcher() i=1 2019-11-29T15:40:54.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.657+0000 7f4ded0f6ec0 20 remove_watcher() i=2 2019-11-29T15:40:54.709 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.709+0000 7f4ded0f6ec0 20 remove_watcher() i=3 2019-11-29T15:40:54.749 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.749+0000 7f4ded0f6ec0 20 remove_watcher() i=4 2019-11-29T15:40:54.835 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.835+0000 7f4ded0f6ec0 20 remove_watcher() i=5 2019-11-29T15:40:54.874 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.875+0000 7f4ded0f6ec0 20 remove_watcher() i=6 2019-11-29T15:40:54.912 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:54.912+0000 7f4ded0f6ec0 20 remove_watcher() i=7 2019-11-29T15:40:54.920 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-29T15:40:55.057 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.057+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.082+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.082 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.082+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.094+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.094+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.102 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.103+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.103+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.112 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.112+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:55.395 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.395+0000 7f67013c8ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T15:40:55.395 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.395+0000 7f67013c8ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T15:40:55.395 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.395+0000 7f67013c8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:40:55.395 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.395+0000 7f67013c8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:40:55.395 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.395+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.408+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:55.408 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.408+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.426 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.426+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:40:55.426 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.426+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.436+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:55.436 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.436+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.453+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:40:55.453 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.453+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.464+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.464+0000 7f67013c8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:40:55.464 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.464+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.471 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.471+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.471 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.471+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.477+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:55.477 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.477+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.491+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:40:55.491 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.491+0000 7f67013c8ec0 20 zonegroup default 2019-11-29T15:40:55.492 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.491+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.499 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.500+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.500+0000 7f67013c8ec0 10 Cannot find current period zone using local zone 2019-11-29T15:40:55.500 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.500+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.506 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.506+0000 7f67013c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:40:55.506 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.506+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.517 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.517+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:40:55.518 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.517+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:55.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.529+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:40:55.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.529+0000 7f67013c8ec0 20 zone default found 2019-11-29T15:40:55.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.529+0000 7f67013c8ec0 20 started sync module instance, tier type = 2019-11-29T15:40:55.529 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:55.529+0000 7f67013c8ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T15:40:56.001 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=0 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=1 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=2 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=3 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=4 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=5 2019-11-29T15:40:56.002 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.001+0000 7f67013c8ec0 20 add_watcher() i=6 2019-11-29T15:40:56.030 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.029+0000 7f67013c8ec0 20 add_watcher() i=7 2019-11-29T15:40:56.031 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.029+0000 7f67013c8ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:40:56.031 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.030+0000 7f66befdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:40:56.036 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.035+0000 7f66ee5f5700 0 -- 172.21.15.182:0/1912945616 >> v2:172.21.15.114:3300/0 conn(0x55925d855320 msgr2=0x55925d857740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T15:40:56.239 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.238+0000 7f66ee5f5700 0 --2- 172.21.15.182:0/1912945616 >> v2:172.21.15.114:3300/0 conn(0x55925d855320 0x55925d857740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T15:40:56.293 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:56.291+0000 7f66eedf6700 0 -- 172.21.15.182:0/3619109369 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55925d858220 msgr2=0x55925d858630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:40:57.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.781+0000 7f662d7fa700 20 reqs_thread_entry: start 2019-11-29T15:40:57.789 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.782+0000 7f6626ffd700 20 reqs_thread_entry: start 2019-11-29T15:40:57.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.782+0000 7f67013c8ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:40:57.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.782+0000 7f66257fa700 20 reqs_thread_entry: start 2019-11-29T15:40:57.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.782+0000 7f67013c8ec0 20 get_system_obj_state: rctx=0x7ffd17da7e58 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55925d8d4220 s->prefetch_data=0 2019-11-29T15:40:57.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.782+0000 7f67013c8ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T15:40:57.810 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-29T15:40:57.810 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:40:57.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T15:40:57.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T15:40:57.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T15:40:57.811 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.805+0000 7f67013c8ec0 20 rados->read ofs=0 len=0 2019-11-29T15:40:57.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.831+0000 7f67013c8ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-29T15:40:57.832 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.831+0000 7f67013c8ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-29T15:40:57.833 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.831+0000 7f67013c8ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:40:57.862 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.861+0000 7f67013c8ec0 10 removing key index: KBNYYCBLDYXMUGHJYSUR 2019-11-29T15:40:57.862 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.861+0000 7f67013c8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-29T15:40:57.877 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:57.876+0000 7f66cf7fe700 10 RGWWatcher::handle_notify() notify_id 566935683222 cookie 94087122521600 notifier 5023 bl.length()=170 2019-11-29T15:40:58.438 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.436+0000 7f67013c8ec0 10 removing email index: foo.client.0+test@test.test 2019-11-29T15:40:58.438 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.436+0000 7f67013c8ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-29T15:40:58.452 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.452+0000 7f66cf7fe700 10 RGWWatcher::handle_notify() notify_id 566935683223 cookie 94087122521600 notifier 5023 bl.length()=178 2019-11-29T15:40:58.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.611+0000 7f67013c8ec0 10 removing user buckets index 2019-11-29T15:40:58.612 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.611+0000 7f67013c8ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-29T15:40:58.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:58.621+0000 7f66cf7fe700 10 RGWWatcher::handle_notify() notify_id 566935683125 cookie 94087122495616 notifier 5023 bl.length()=169 2019-11-29T15:40:59.144 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.144+0000 7f67013c8ec0 10 removing user index: foo.client.0 2019-11-29T15:40:59.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.144+0000 7f67013c8ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-29T15:40:59.145 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.144+0000 7f67013c8ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-29T15:40:59.165 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.165+0000 7f66cf7fe700 10 RGWWatcher::handle_notify() notify_id 566935683481 cookie 94087122493648 notifier 5023 bl.length()=161 2019-11-29T15:40:59.656 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.656+0000 7f67013c8ec0 20 remove_watcher() i=0 2019-11-29T15:40:59.657 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.656+0000 7f67013c8ec0 2 removed watcher, disabling cache 2019-11-29T15:40:59.699 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.699+0000 7f67013c8ec0 20 remove_watcher() i=1 2019-11-29T15:40:59.762 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.762+0000 7f67013c8ec0 20 remove_watcher() i=2 2019-11-29T15:40:59.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.815+0000 7f67013c8ec0 20 remove_watcher() i=3 2019-11-29T15:40:59.868 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.868+0000 7f67013c8ec0 20 remove_watcher() i=4 2019-11-29T15:40:59.932 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.932+0000 7f67013c8ec0 20 remove_watcher() i=5 2019-11-29T15:40:59.970 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:40:59.970+0000 7f67013c8ec0 20 remove_watcher() i=6 2019-11-29T15:41:00.017 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.017+0000 7f67013c8ec0 20 remove_watcher() i=7 2019-11-29T15:41:00.025 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-29T15:41:00.162 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.162+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.185+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.185 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.185+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.199+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.199 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.199+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.206+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.206 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.206+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.213 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.213+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:00.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.521+0000 7efe501a5ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T15:41:00.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.521+0000 7efe501a5ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T15:41:00.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.521+0000 7efe501a5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:41:00.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.521+0000 7efe501a5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:41:00.522 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.521+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.531+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:00.531 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.531+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.541 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.541+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:00.541 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.541+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.549 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.549+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:00.549 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.549+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.558 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.558+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:00.558 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.558+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.567+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.567+0000 7efe501a5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:41:00.567 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.567+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.580+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.580 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.580+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.593+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:00.593 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.593+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.607 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.607+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:00.608 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.607+0000 7efe501a5ec0 20 zonegroup default 2019-11-29T15:41:00.608 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.607+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.615+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.615+0000 7efe501a5ec0 10 Cannot find current period zone using local zone 2019-11-29T15:41:00.616 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.615+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.622 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.622+0000 7efe501a5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:00.623 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.622+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.630 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.630+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:00.630 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.630+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:00.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.640+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:00.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.640+0000 7efe501a5ec0 20 zone default found 2019-11-29T15:41:00.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.640+0000 7efe501a5ec0 20 started sync module instance, tier type = 2019-11-29T15:41:00.641 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.640+0000 7efe501a5ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T15:41:00.986 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=0 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=1 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=2 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=3 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=4 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=5 2019-11-29T15:41:00.987 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:00.986+0000 7efe501a5ec0 20 add_watcher() i=6 2019-11-29T15:41:01.020 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.020+0000 7efe501a5ec0 20 add_watcher() i=7 2019-11-29T15:41:01.020 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.020+0000 7efe501a5ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:41:01.020 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.020+0000 7efe0dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:41:01.025 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.025+0000 7efe3d3d2700 0 -- 172.21.15.182:0/990334618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55f4617d22c0 msgr2=0x55f4617d8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-29T15:41:01.226 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.227+0000 7efe3d3d2700 0 --2- 172.21.15.182:0/990334618 >> [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] conn(0x55f4617d22c0 0x55f4617d8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-29T15:41:01.265 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:01.265+0000 7efe3d3d2700 0 -- 172.21.15.182:0/4181567720 >> [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] conn(0x55f4617d8610 msgr2=0x55f4617defe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:41:02.814 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.813+0000 7efd7ffff700 20 reqs_thread_entry: start 2019-11-29T15:41:02.814 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.814+0000 7efd7dffb700 20 reqs_thread_entry: start 2019-11-29T15:41:02.814 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.814+0000 7efe501a5ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:41:02.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.814+0000 7efd6bfff700 20 reqs_thread_entry: start 2019-11-29T15:41:02.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.814+0000 7efe501a5ec0 20 get_system_obj_state: rctx=0x7ffdc8eaf518 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55f461854320 s->prefetch_data=0 2019-11-29T15:41:02.815 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.814+0000 7efe501a5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-29T15:41:02.824 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-29T15:41:02.824 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:41:02.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-29T15:41:02.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-29T15:41:02.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-29T15:41:02.825 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.824+0000 7efe501a5ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:02.836 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.836+0000 7efe501a5ec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-29T15:41:02.836 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.836+0000 7efe501a5ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-29T15:41:02.836 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.836+0000 7efe501a5ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-29T15:41:02.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.858+0000 7efe501a5ec0 10 removing key index: ISJIKRASVNIAAQBSQBPT 2019-11-29T15:41:02.858 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.858+0000 7efe501a5ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=170 2019-11-29T15:41:02.870 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:02.870+0000 7efe1e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683222 cookie 94508095883904 notifier 4962 bl.length()=170 2019-11-29T15:41:03.283 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.283+0000 7efe501a5ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-29T15:41:03.283 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.283+0000 7efe501a5ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-29T15:41:03.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.305+0000 7efe1e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683224 cookie 94508095919808 notifier 4962 bl.length()=193 2019-11-29T15:41:03.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.890+0000 7efe501a5ec0 10 removing user buckets index 2019-11-29T15:41:03.890 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.890+0000 7efe501a5ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-29T15:41:03.912 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:03.912+0000 7efe1e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683225 cookie 94508095919072 notifier 4962 bl.length()=184 2019-11-29T15:41:04.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.196+0000 7efe501a5ec0 10 removing user index: testx$tenanteduser.client.0 2019-11-29T15:41:04.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.196+0000 7efe501a5ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-29T15:41:04.196 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.196+0000 7efe501a5ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-29T15:41:04.209 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.209+0000 7efe1e7fc700 10 RGWWatcher::handle_notify() notify_id 566935683223 cookie 94508095903472 notifier 4962 bl.length()=176 2019-11-29T15:41:04.570 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.570+0000 7efe501a5ec0 20 remove_watcher() i=0 2019-11-29T15:41:04.570 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.570+0000 7efe501a5ec0 2 removed watcher, disabling cache 2019-11-29T15:41:04.611 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.611+0000 7efe501a5ec0 20 remove_watcher() i=1 2019-11-29T15:41:04.640 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.640+0000 7efe501a5ec0 20 remove_watcher() i=2 2019-11-29T15:41:04.701 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.701+0000 7efe501a5ec0 20 remove_watcher() i=3 2019-11-29T15:41:04.744 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.744+0000 7efe501a5ec0 20 remove_watcher() i=4 2019-11-29T15:41:04.787 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.787+0000 7efe501a5ec0 20 remove_watcher() i=5 2019-11-29T15:41:04.834 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.834+0000 7efe501a5ec0 20 remove_watcher() i=6 2019-11-29T15:41:04.894 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:04.894+0000 7efe501a5ec0 20 remove_watcher() i=7 2019-11-29T15:41:04.902 INFO:tasks.s3tests:Removing s3-tests... 2019-11-29T15:41:04.902 INFO:teuthology.orchestra.run.smithi182:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-29T15:41:05.045 INFO:teuthology.run_tasks:Running task swift... 2019-11-29T15:41:05.067 INFO:tasks.swift:clients=['client.0'] 2019-11-29T15:41:05.067 INFO:tasks.swift:Downloading swift... 2019-11-29T15:41:05.067 INFO:teuthology.orchestra.run.smithi182:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-29T15:41:05.170 INFO:teuthology.orchestra.run.smithi182.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-29T15:41:05.593 INFO:tasks.swift:Creating rgw users... 2019-11-29T15:41:05.594 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret 0OMnLNIXarkdqbaOdC34RvCXdWm0FDTFuXgtcdTvid6012ynZnF89A== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-29T15:41:05.752 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.752+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:05.772 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.772+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:05.773 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.772+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:05.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.784+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:05.784 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.784+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:05.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.791+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:05.790 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.791+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:05.797 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:05.798+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:06.129 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.129+0000 7ff77d6c2ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T15:41:06.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.129+0000 7ff77d6c2ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T15:41:06.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.129+0000 7ff77d6c2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:41:06.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.129+0000 7ff77d6c2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:41:06.130 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.129+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.141+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:06.141 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.141+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.160 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.160+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:06.161 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.161+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.172+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:06.173 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.172+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.189 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.190+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:06.190 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.190+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.210 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.210+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:06.210 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.210+0000 7ff77d6c2ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:41:06.210 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.210+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.218+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:06.218 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.218+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.234+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:06.234 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.234+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.254+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:06.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.254+0000 7ff77d6c2ec0 20 zonegroup default 2019-11-29T15:41:06.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.254+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.269+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:06.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.269+0000 7ff77d6c2ec0 10 Cannot find current period zone using local zone 2019-11-29T15:41:06.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.269+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.279+0000 7ff77d6c2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:06.280 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.279+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.291+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:06.291 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.291+0000 7ff77d6c2ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:06.310 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.309+0000 7ff77d6c2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:06.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.310+0000 7ff77d6c2ec0 20 zone default found 2019-11-29T15:41:06.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.310+0000 7ff77d6c2ec0 20 started sync module instance, tier type = 2019-11-29T15:41:06.311 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.310+0000 7ff77d6c2ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T15:41:06.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=0 2019-11-29T15:41:06.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=1 2019-11-29T15:41:06.688 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=2 2019-11-29T15:41:06.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=3 2019-11-29T15:41:06.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=4 2019-11-29T15:41:06.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=5 2019-11-29T15:41:06.689 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.687+0000 7ff77d6c2ec0 20 add_watcher() i=6 2019-11-29T15:41:06.725 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.725+0000 7ff77d6c2ec0 20 add_watcher() i=7 2019-11-29T15:41:06.725 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.725+0000 7ff77d6c2ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:41:06.726 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.725+0000 7ff73b7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:41:06.739 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.739+0000 7ff76b0f0700 0 -- >> v2:172.21.15.182:3300/0 conn(0x55b02b4cfa50 msgr2=0x55b02b4cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-29T15:41:06.807 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:06.807+0000 7ff76b0f0700 0 -- 172.21.15.182:0/3414597314 >> [v2:172.21.15.182:6816/9952,v1:172.21.15.182:6817/9952] conn(0x55b02b4e5060 msgr2=0x55b02b4e7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:41:08.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.068+0000 7ff6a9ffb700 20 reqs_thread_entry: start 2019-11-29T15:41:08.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.068+0000 7ff6a37fe700 20 reqs_thread_entry: start 2019-11-29T15:41:08.068 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.068+0000 7ff77d6c2ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:41:08.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.069+0000 7ff6a1ffb700 20 reqs_thread_entry: start 2019-11-29T15:41:08.069 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.069+0000 7ff77d6c2ec0 20 get_system_obj_state: rctx=0x7fff0c575bf8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x55b02b54bf80 s->prefetch_data=0 2019-11-29T15:41:08.070 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.069+0000 7ff77d6c2ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-29T15:41:08.076 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.076+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-29T15:41:08.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.076+0000 7ff77d6c2ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:41:08.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.076+0000 7ff77d6c2ec0 20 get_system_obj_state: rctx=0x7fff0c575c08 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x55b02b54dd10 s->prefetch_data=0 2019-11-29T15:41:08.077 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.076+0000 7ff77d6c2ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-29T15:41:08.083 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.083+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-29T15:41:08.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.083+0000 7ff77d6c2ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:41:08.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.083+0000 7ff77d6c2ec0 20 get_system_obj_state: rctx=0x7fff0c575818 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55b02b54dd10 s->prefetch_data=0 2019-11-29T15:41:08.084 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.083+0000 7ff77d6c2ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-29T15:41:08.093 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.093+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T15:41:08.093 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.093+0000 7ff77d6c2ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T15:41:08.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.093+0000 7ff77d6c2ec0 20 get_system_obj_state: rctx=0x7fff0c575998 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x55b02b54dfc0 s->prefetch_data=0 2019-11-29T15:41:08.094 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.093+0000 7ff77d6c2ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-29T15:41:08.103 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.104+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-29T15:41:08.104 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.104+0000 7ff77d6c2ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T15:41:08.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.177+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:41:08.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.177+0000 7ff77d6c2ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:41:08.177 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.177+0000 7ff77d6c2ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-29T15:41:08.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.193+0000 7ff74bfff700 10 RGWWatcher::handle_notify() notify_id 566935683482 cookie 94215128952480 notifier 5062 bl.length()=612 2019-11-29T15:41:08.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.193+0000 7ff74bfff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:41:08.194 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.193+0000 7ff74bfff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:41:08.286 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.280+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T15:41:08.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.280+0000 7ff77d6c2ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:41:08.287 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.280+0000 7ff77d6c2ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-29T15:41:08.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.294+0000 7ff74bfff700 10 RGWWatcher::handle_notify() notify_id 566935683226 cookie 94215128980656 notifier 5062 bl.length()=194 2019-11-29T15:41:08.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.294+0000 7ff74bfff700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-29T15:41:08.294 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.294+0000 7ff74bfff700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-29T15:41:08.431 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.431+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T15:41:08.432 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.431+0000 7ff77d6c2ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T15:41:08.432 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.431+0000 7ff77d6c2ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-29T15:41:08.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.442+0000 7ff74bfff700 10 RGWWatcher::handle_notify() notify_id 566935683126 cookie 94215128955856 notifier 5062 bl.length()=183 2019-11-29T15:41:08.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.442+0000 7ff74bfff700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-29T15:41:08.443 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.442+0000 7ff74bfff700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-29T15:41:08.711 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.712+0000 7ff77d6c2ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:41:08.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.712+0000 7ff77d6c2ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:41:08.712 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.712+0000 7ff77d6c2ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-29T15:41:08.724 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.724+0000 7ff74bfff700 10 RGWWatcher::handle_notify() notify_id 566935683483 cookie 94215128952480 notifier 5062 bl.length()=636 2019-11-29T15:41:08.724 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.724+0000 7ff74bfff700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-29T15:41:08.725 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.724+0000 7ff74bfff700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-29T15:41:08.774 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T15:41:08.774 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "foo.client.0", 2019-11-29T15:41:08.774 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-29T15:41:08.774 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "foo.client.0+test@test.test", 2019-11-29T15:41:08.775 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T15:41:08.775 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T15:41:08.775 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [ 2019-11-29T15:41:08.775 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T15:41:08.776 INFO:teuthology.orchestra.run.smithi182.stdout: "id": "foo.client.0:foo", 2019-11-29T15:41:08.776 INFO:teuthology.orchestra.run.smithi182.stdout: "permissions": "full-control" 2019-11-29T15:41:08.776 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T15:41:08.776 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T15:41:08.776 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [], 2019-11-29T15:41:08.777 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [ 2019-11-29T15:41:08.777 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T15:41:08.777 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "foo.client.0:foo", 2019-11-29T15:41:08.777 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "0OMnLNIXarkdqbaOdC34RvCXdWm0FDTFuXgtcdTvid6012ynZnF89A==" 2019-11-29T15:41:08.778 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T15:41:08.779 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T15:41:08.779 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T15:41:08.779 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T15:41:08.779 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T15:41:08.779 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T15:41:08.780 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T15:41:08.780 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T15:41:08.780 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T15:41:08.780 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T15:41:08.781 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T15:41:08.781 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T15:41:08.781 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T15:41:08.781 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T15:41:08.782 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T15:41:08.782 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T15:41:08.782 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T15:41:08.782 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T15:41:08.782 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T15:41:08.783 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T15:41:08.783 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T15:41:08.783 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T15:41:08.783 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T15:41:08.784 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T15:41:08.784 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T15:41:08.784 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T15:41:08.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.818+0000 7ff77d6c2ec0 20 remove_watcher() i=0 2019-11-29T15:41:08.821 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.818+0000 7ff77d6c2ec0 2 removed watcher, disabling cache 2019-11-29T15:41:08.876 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.876+0000 7ff77d6c2ec0 20 remove_watcher() i=1 2019-11-29T15:41:08.916 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.916+0000 7ff77d6c2ec0 20 remove_watcher() i=2 2019-11-29T15:41:08.979 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:08.979+0000 7ff77d6c2ec0 20 remove_watcher() i=3 2019-11-29T15:41:09.022 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.022+0000 7ff77d6c2ec0 20 remove_watcher() i=4 2019-11-29T15:41:09.063 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.063+0000 7ff77d6c2ec0 20 remove_watcher() i=5 2019-11-29T15:41:09.107 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.107+0000 7ff77d6c2ec0 20 remove_watcher() i=6 2019-11-29T15:41:09.155 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.155+0000 7ff77d6c2ec0 20 remove_watcher() i=7 2019-11-29T15:41:09.165 INFO:teuthology.orchestra.run.smithi182:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret F2U2lwOfX6oGrnd7OPgMnwl7dE8oKvYn9WmmVKMco+xemLhc+3YcqQ== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-29T15:41:09.305 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.305+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.332+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.333 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.332+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.343 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.344+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.344 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.344+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.350 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.350+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.350 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.350+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.357 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.357+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:09.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.572+0000 7f63431f9ec0 20 RGWRados::pool_iterate: got zone_info.9baad822-b080-4db2-b995-bf7cc78f9da0 2019-11-29T15:41:09.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.572+0000 7f63431f9ec0 20 RGWRados::pool_iterate: got zonegroup_info.08a7ed15-821b-4267-a635-f91b24b6870c 2019-11-29T15:41:09.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.572+0000 7f63431f9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-29T15:41:09.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.572+0000 7f63431f9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-29T15:41:09.572 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.572+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.581+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:09.581 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.581+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.602+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:09.602 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.602+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.614 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.614+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:09.615 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.614+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.627+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:09.627 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.627+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.660+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.660 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.660+0000 7f63431f9ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-29T15:41:09.661 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.660+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.697 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.697+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.697 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.697+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.706+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:09.706 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.706+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.722 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.722+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-29T15:41:09.723 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.722+0000 7f63431f9ec0 20 zonegroup default 2019-11-29T15:41:09.723 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.722+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.732+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.732+0000 7f63431f9ec0 10 Cannot find current period zone using local zone 2019-11-29T15:41:09.733 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.732+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.739 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.740+0000 7f63431f9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-29T15:41:09.740 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.740+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.747+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-29T15:41:09.747 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.747+0000 7f63431f9ec0 20 rados->read ofs=0 len=0 2019-11-29T15:41:09.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.762+0000 7f63431f9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-29T15:41:09.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.762+0000 7f63431f9ec0 20 zone default found 2019-11-29T15:41:09.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.762+0000 7f63431f9ec0 20 started sync module instance, tier type = 2019-11-29T15:41:09.764 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:09.762+0000 7f63431f9ec0 20 started zone id=9baad822-b080-4db2-b995-bf7cc78f9da0 (name=default) with tier type = 2019-11-29T15:41:10.147 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=0 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=1 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=2 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=3 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=4 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=5 2019-11-29T15:41:10.148 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.147+0000 7f63431f9ec0 20 add_watcher() i=6 2019-11-29T15:41:10.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.198+0000 7f63431f9ec0 20 add_watcher() i=7 2019-11-29T15:41:10.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.198+0000 7f63431f9ec0 2 all 8 watchers are set, enabling cache 2019-11-29T15:41:10.198 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.198+0000 7f6300fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-29T15:41:10.210 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.211+0000 7f632fc25700 0 -- 172.21.15.182:0/2695533070 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x56134f0193e0 msgr2=0x56134f01b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:41:10.245 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:10.245+0000 7f6330c27700 0 -- 172.21.15.182:0/1144734442 >> [v2:172.21.15.114:6800/8580,v1:172.21.15.114:6801/8580] conn(0x7f6274017580 msgr2=0x7f6274019a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-29T15:41:11.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.564+0000 7f6272ffd700 20 reqs_thread_entry: start 2019-11-29T15:41:11.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.565+0000 7f6270ff9700 20 reqs_thread_entry: start 2019-11-29T15:41:11.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.565+0000 7f63431f9ec0 20 init_complete bucket index max shards: 0 2019-11-29T15:41:11.566 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.565+0000 7f6266ffd700 20 reqs_thread_entry: start 2019-11-29T15:41:11.566 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.566+0000 7f63431f9ec0 20 get_system_obj_state: rctx=0x7ffe8487caa8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x56134f095e80 s->prefetch_data=0 2019-11-29T15:41:11.566 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.566+0000 7f63431f9ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-29T15:41:11.577 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.577+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-29T15:41:11.578 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.577+0000 7f63431f9ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:41:11.578 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.577+0000 7f63431f9ec0 20 get_system_obj_state: rctx=0x7ffe8487cab8 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x56134f097c10 s->prefetch_data=0 2019-11-29T15:41:11.578 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.577+0000 7f63431f9ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-29T15:41:11.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.584+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-29T15:41:11.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.584+0000 7f63431f9ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T15:41:11.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.584+0000 7f63431f9ec0 20 get_system_obj_state: rctx=0x7ffe8487c6c8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x56134f097c10 s->prefetch_data=0 2019-11-29T15:41:11.584 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.584+0000 7f63431f9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-29T15:41:11.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.595+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T15:41:11.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.595+0000 7f63431f9ec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T15:41:11.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.595+0000 7f63431f9ec0 20 get_system_obj_state: rctx=0x7ffe8487c848 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x56134f097ec0 s->prefetch_data=0 2019-11-29T15:41:11.595 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.595+0000 7f63431f9ec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-29T15:41:11.604 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.604+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-29T15:41:11.604 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.604+0000 7f63431f9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T15:41:11.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.686+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T15:41:11.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.686+0000 7f63431f9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:41:11.686 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.686+0000 7f63431f9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-29T15:41:11.695 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.695+0000 7f6325ffb700 10 RGWWatcher::handle_notify() notify_id 566935683127 cookie 94640929746448 notifier 5077 bl.length()=612 2019-11-29T15:41:11.695 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.695+0000 7f6325ffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T15:41:11.695 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:11.695+0000 7f6325ffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:41:12.254 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.254+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T15:41:12.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.254+0000 7f63431f9ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T15:41:12.255 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.254+0000 7f63431f9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-29T15:41:12.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.269+0000 7f6325ffb700 10 RGWWatcher::handle_notify() notify_id 566935683128 cookie 94640929746448 notifier 5077 bl.length()=194 2019-11-29T15:41:12.269 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.269+0000 7f6325ffb700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-29T15:41:12.270 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.269+0000 7f6325ffb700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-29T15:41:12.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.642+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T15:41:12.642 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.642+0000 7f63431f9ec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T15:41:12.643 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.642+0000 7f63431f9ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-29T15:41:12.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.654+0000 7f6325ffb700 10 RGWWatcher::handle_notify() notify_id 566935683224 cookie 94640929769856 notifier 5077 bl.length()=183 2019-11-29T15:41:12.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.654+0000 7f6325ffb700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-29T15:41:12.654 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.654+0000 7f6325ffb700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-29T15:41:12.787 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.788+0000 7f63431f9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T15:41:12.788 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.788+0000 7f63431f9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:41:12.788 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.788+0000 7f63431f9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-29T15:41:12.799 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.799+0000 7f6325ffb700 10 RGWWatcher::handle_notify() notify_id 566935683129 cookie 94640929746448 notifier 5077 bl.length()=636 2019-11-29T15:41:12.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.799+0000 7f6325ffb700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-29T15:41:12.800 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:12.799+0000 7f6325ffb700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-29T15:41:13.336 INFO:teuthology.orchestra.run.smithi182.stdout:{ 2019-11-29T15:41:13.337 INFO:teuthology.orchestra.run.smithi182.stdout: "user_id": "bar.client.0", 2019-11-29T15:41:13.337 INFO:teuthology.orchestra.run.smithi182.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-29T15:41:13.337 INFO:teuthology.orchestra.run.smithi182.stdout: "email": "bar.client.0+test@test.test", 2019-11-29T15:41:13.337 INFO:teuthology.orchestra.run.smithi182.stdout: "suspended": 0, 2019-11-29T15:41:13.338 INFO:teuthology.orchestra.run.smithi182.stdout: "max_buckets": 1000, 2019-11-29T15:41:13.338 INFO:teuthology.orchestra.run.smithi182.stdout: "subusers": [ 2019-11-29T15:41:13.338 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T15:41:13.338 INFO:teuthology.orchestra.run.smithi182.stdout: "id": "bar.client.0:bar", 2019-11-29T15:41:13.338 INFO:teuthology.orchestra.run.smithi182.stdout: "permissions": "full-control" 2019-11-29T15:41:13.339 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T15:41:13.339 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T15:41:13.339 INFO:teuthology.orchestra.run.smithi182.stdout: "keys": [], 2019-11-29T15:41:13.339 INFO:teuthology.orchestra.run.smithi182.stdout: "swift_keys": [ 2019-11-29T15:41:13.340 INFO:teuthology.orchestra.run.smithi182.stdout: { 2019-11-29T15:41:13.340 INFO:teuthology.orchestra.run.smithi182.stdout: "user": "bar.client.0:bar", 2019-11-29T15:41:13.340 INFO:teuthology.orchestra.run.smithi182.stdout: "secret_key": "F2U2lwOfX6oGrnd7OPgMnwl7dE8oKvYn9WmmVKMco+xemLhc+3YcqQ==" 2019-11-29T15:41:13.340 INFO:teuthology.orchestra.run.smithi182.stdout: } 2019-11-29T15:41:13.341 INFO:teuthology.orchestra.run.smithi182.stdout: ], 2019-11-29T15:41:13.341 INFO:teuthology.orchestra.run.smithi182.stdout: "caps": [], 2019-11-29T15:41:13.341 INFO:teuthology.orchestra.run.smithi182.stdout: "op_mask": "read, write, delete", 2019-11-29T15:41:13.341 INFO:teuthology.orchestra.run.smithi182.stdout: "default_placement": "", 2019-11-29T15:41:13.341 INFO:teuthology.orchestra.run.smithi182.stdout: "default_storage_class": "", 2019-11-29T15:41:13.342 INFO:teuthology.orchestra.run.smithi182.stdout: "placement_tags": [], 2019-11-29T15:41:13.342 INFO:teuthology.orchestra.run.smithi182.stdout: "bucket_quota": { 2019-11-29T15:41:13.342 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T15:41:13.343 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T15:41:13.343 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T15:41:13.343 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T15:41:13.343 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T15:41:13.343 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T15:41:13.344 INFO:teuthology.orchestra.run.smithi182.stdout: "user_quota": { 2019-11-29T15:41:13.344 INFO:teuthology.orchestra.run.smithi182.stdout: "enabled": false, 2019-11-29T15:41:13.344 INFO:teuthology.orchestra.run.smithi182.stdout: "check_on_raw": false, 2019-11-29T15:41:13.344 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size": -1, 2019-11-29T15:41:13.345 INFO:teuthology.orchestra.run.smithi182.stdout: "max_size_kb": 0, 2019-11-29T15:41:13.345 INFO:teuthology.orchestra.run.smithi182.stdout: "max_objects": -1 2019-11-29T15:41:13.345 INFO:teuthology.orchestra.run.smithi182.stdout: }, 2019-11-29T15:41:13.345 INFO:teuthology.orchestra.run.smithi182.stdout: "temp_url_keys": [], 2019-11-29T15:41:13.346 INFO:teuthology.orchestra.run.smithi182.stdout: "type": "rgw", 2019-11-29T15:41:13.346 INFO:teuthology.orchestra.run.smithi182.stdout: "mfa_ids": [] 2019-11-29T15:41:13.346 INFO:teuthology.orchestra.run.smithi182.stdout:} 2019-11-29T15:41:13.346 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T15:41:13.407 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.407+0000 7f63431f9ec0 20 remove_watcher() i=0 2019-11-29T15:41:13.407 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.407+0000 7f63431f9ec0 2 removed watcher, disabling cache 2019-11-29T15:41:13.462 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.462+0000 7f63431f9ec0 20 remove_watcher() i=1 2019-11-29T15:41:13.496 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.495+0000 7f63431f9ec0 20 remove_watcher() i=2 2019-11-29T15:41:13.565 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.565+0000 7f63431f9ec0 20 remove_watcher() i=3 2019-11-29T15:41:13.613 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.613+0000 7f63431f9ec0 20 remove_watcher() i=4 2019-11-29T15:41:13.680 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.680+0000 7f63431f9ec0 20 remove_watcher() i=5 2019-11-29T15:41:13.728 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.728+0000 7f63431f9ec0 20 remove_watcher() i=6 2019-11-29T15:41:13.782 INFO:teuthology.orchestra.run.smithi182.stderr:2019-11-29T15:41:13.782+0000 7f63431f9ec0 20 remove_watcher() i=7 2019-11-29T15:41:13.789 INFO:tasks.swift:Configuring testswift... 2019-11-29T15:41:13.790 INFO:teuthology.orchestra.run.smithi182:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-29T15:41:16.154 INFO:teuthology.orchestra.run.smithi182.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-29T15:41:17.363 INFO:teuthology.orchestra.run.smithi182.stdout:Installing setuptools, pip, wheel...done. 2019-11-29T15:41:17.675 INFO:teuthology.orchestra.run.smithi182.stderr:Cache entry deserialization failed, entry ignored 2019-11-29T15:41:17.795 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting pip 2019-11-29T15:41:17.872 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-29T15:41:17.935 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: pip 2019-11-29T15:41:17.935 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: pip 9.0.1 2019-11-29T15:41:17.993 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling pip-9.0.1: 2019-11-29T15:41:18.034 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled pip-9.0.1 2019-11-29T15:41:18.607 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed pip-19.3.1 2019-11-29T15:41:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T15:41:19.406 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting setuptools==32.3.1 2019-11-29T15:41:19.408 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-29T15:41:19.451 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: setuptools 2019-11-29T15:41:19.451 INFO:teuthology.orchestra.run.smithi182.stdout: Found existing installation: setuptools 28.8.0 2019-11-29T15:41:19.467 INFO:teuthology.orchestra.run.smithi182.stdout: Uninstalling setuptools-28.8.0: 2019-11-29T15:41:19.479 INFO:teuthology.orchestra.run.smithi182.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-29T15:41:19.648 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed setuptools-32.3.1 2019-11-29T15:41:20.543 INFO:teuthology.orchestra.run.smithi182.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-29T15:41:20.752 INFO:teuthology.orchestra.run.smithi182.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-29T15:41:20.815 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting nose>=1.0.0 2019-11-29T15:41:20.816 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-29T15:41:20.944 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting boto>=2.0b4 2019-11-29T15:41:20.950 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-29T15:41:21.097 INFO:teuthology.orchestra.run.smithi182.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-29T15:41:21.374 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting gevent>=0.14 2019-11-29T15:41:21.390 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:41:21.652 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting isodate>=0.4.4 2019-11-29T15:41:21.654 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-29T15:41:21.729 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting eventlet>=0.9.14 2019-11-29T15:41:21.793 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-29T15:41:21.987 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting netifaces>=0.5 2019-11-29T15:41:21.998 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:41:22.086 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-29T15:41:22.095 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-29T15:41:22.502 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting simplejson>=2.1.3 2019-11-29T15:41:22.512 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-29T15:41:22.853 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting WebOb==1.0 2019-11-29T15:41:22.865 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-29T15:41:23.301 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-29T15:41:23.302 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-29T15:41:23.367 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting six 2019-11-29T15:41:23.369 INFO:teuthology.orchestra.run.smithi182.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-29T15:41:23.410 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting monotonic>=1.4 2019-11-29T15:41:23.420 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-29T15:41:23.495 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting dnspython>=1.15.0 2019-11-29T15:41:23.517 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-29T15:41:23.633 INFO:teuthology.orchestra.run.smithi182.stdout:Collecting enum34; python_version < "3.4" 2019-11-29T15:41:23.643 INFO:teuthology.orchestra.run.smithi182.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-29T15:41:23.683 INFO:teuthology.orchestra.run.smithi182.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-29T15:41:23.683 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for xattr (setup.py): started 2019-11-29T15:41:24.140 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-29T15:41:24.140 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24124 sha256=e099e239ca1bd88198b23aa9ab2545eed72eefe656e144c98b01f067dffc220f 2019-11-29T15:41:24.141 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-29T15:41:24.146 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for simplejson (setup.py): started 2019-11-29T15:41:25.090 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-29T15:41:25.090 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113115 sha256=577d338b2f496fe704775c63516904520174ed9bc2330fbfc924c4e576555a78 2019-11-29T15:41:25.090 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-29T15:41:25.098 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for WebOb (setup.py): started 2019-11-29T15:41:25.331 INFO:teuthology.orchestra.run.smithi182.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-29T15:41:25.332 INFO:teuthology.orchestra.run.smithi182.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=f6a7a5d570ca6f1359f84ab3b51b85a9c0344b9c1eb3264dcbf89756e68b1aa8 2019-11-29T15:41:25.333 INFO:teuthology.orchestra.run.smithi182.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-29T15:41:25.353 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully built xattr simplejson WebOb 2019-11-29T15:41:25.430 INFO:teuthology.orchestra.run.smithi182.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-29T15:41:27.065 INFO:teuthology.orchestra.run.smithi182.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-29T15:41:27.336 INFO:teuthology.orchestra.run.smithi182.stdout:running develop 2019-11-29T15:41:27.379 INFO:teuthology.orchestra.run.smithi182.stdout:running egg_info 2019-11-29T15:41:27.380 INFO:teuthology.orchestra.run.smithi182.stdout:creating swift.egg-info 2019-11-29T15:41:27.380 INFO:teuthology.orchestra.run.smithi182.stdout:writing swift.egg-info/PKG-INFO 2019-11-29T15:41:27.380 INFO:teuthology.orchestra.run.smithi182.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-29T15:41:27.380 INFO:teuthology.orchestra.run.smithi182.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-29T15:41:27.384 INFO:teuthology.orchestra.run.smithi182.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-29T15:41:27.384 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T15:41:27.388 INFO:teuthology.orchestra.run.smithi182.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T15:41:27.388 INFO:teuthology.orchestra.run.smithi182.stdout:reading manifest template 'MANIFEST.in' 2019-11-29T15:41:27.388 INFO:teuthology.orchestra.run.smithi182.stderr:warning: no files found matching 'ChangeLog' 2019-11-29T15:41:27.401 INFO:teuthology.orchestra.run.smithi182.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-29T15:41:27.401 INFO:teuthology.orchestra.run.smithi182.stdout:running build_ext 2019-11-29T15:41:27.401 INFO:teuthology.orchestra.run.smithi182.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-29T15:41:27.402 INFO:teuthology.orchestra.run.smithi182.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-29T15:41:27.408 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.409 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.411 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.412 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.413 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.414 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.415 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.416 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.416 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.417 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.418 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.419 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.420 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.421 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.422 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.423 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.424 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.425 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.426 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.427 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.428 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.431 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.433 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.438 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.440 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.442 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.443 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.445 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.447 INFO:teuthology.orchestra.run.smithi182.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-29T15:41:27.447 INFO:teuthology.orchestra.run.smithi182.stdout: 2019-11-29T15:41:27.447 INFO:teuthology.orchestra.run.smithi182.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-29T15:41:27.448 INFO:teuthology.orchestra.run.smithi182.stdout:Processing dependencies for swift==1.4.4 2019-11-29T15:41:27.448 INFO:teuthology.orchestra.run.smithi182.stdout:Finished processing dependencies for swift==1.4.4 2019-11-29T15:41:27.459 INFO:teuthology.orchestra.run.smithi182:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-29T15:41:27.538 INFO:teuthology.orchestra.run.smithi182:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-29T15:41:34.669 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:25:42.807 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.676 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:25:42.814 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.686 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:25:42.870 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.688 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:25:42.874 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.690 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:25:42.875 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.691 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:25:42.877 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.737 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:25:42.875 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.779 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:25:42.962 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:34.779 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:25:42.963 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:41:57.738 INFO:teuthology.orchestra.run.smithi182.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-29T15:42:10.838 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-29T15:44:31.398 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:28:39.536 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.402 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:28:39.541 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.441 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:28:39.625 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.441 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:28:39.625 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.443 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:28:39.628 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.463 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:28:39.647 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.506 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:28:39.645 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.537 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:28:39.722 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:44:31.557 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:28:39.741 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.233 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:30:51.371 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.244 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:30:51.382 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.250 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:30:51.435 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.256 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:30:51.441 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.258 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:30:51.442 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.262 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:30:51.446 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.391 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:30:51.529 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.402 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:30:51.586 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:43.409 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:30:51.593 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:46:46.146 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-29T15:46:58.374 INFO:teuthology.orchestra.run.smithi182.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-29T15:46:59.226 INFO:teuthology.orchestra.run.smithi182.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-29T15:47:11.219 INFO:teuthology.orchestra.run.smithi182.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-29T15:47:28.685 INFO:teuthology.orchestra.run.smithi182.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-29T15:48:07.771 INFO:teuthology.orchestra.run.smithi182.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-29T15:48:07.866 INFO:teuthology.orchestra.run.smithi182.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-29T15:51:57.125 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:36:05.262 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.139 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:36:05.277 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:36:05.327 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.146 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:36:05.330 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.149 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:36:05.333 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.151 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:36:05.335 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.329 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:36:05.467 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.357 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:36:05.541 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:51:57.359 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:36:05.543 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.283 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:37:01.416 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.290 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:37:01.421 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.336 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:37:01.474 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.359 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:37:01.543 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.363 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:37:01.548 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.366 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:37:01.550 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.371 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:37:01.555 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.408 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:37:01.592 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:52:53.415 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:37:01.598 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:54:08.565 INFO:teuthology.orchestra.run.smithi182.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-29T15:54:10.562 INFO:teuthology.orchestra.run.smithi182.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-29T15:54:40.229 INFO:teuthology.orchestra.run.smithi182.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:54:53.166 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:57:09.169 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:41:17.306 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.176 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:41:17.313 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.194 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:41:17.378 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.199 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:41:17.384 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.226 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:41:17.409 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.228 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:41:17.411 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.339 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:41:17.477 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.385 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:41:17.568 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T15:57:09.388 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:41:17.572 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T15:59:03.928 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:59:13.261 INFO:teuthology.orchestra.run.smithi182.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:59:14.148 INFO:teuthology.orchestra.run.smithi182.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:59:23.384 INFO:teuthology.orchestra.run.smithi182.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T15:59:39.305 INFO:teuthology.orchestra.run.smithi182.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T16:01:03.488 INFO:teuthology.orchestra.run.smithi182.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T16:01:03.503 INFO:teuthology.orchestra.run.smithi182.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-29T16:01:14.911 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:45:23.049 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:14.953 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:45:23.090 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:14.966 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:45:23.150 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:14.970 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:45:23.154 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:14.995 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:45:23.178 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:15.003 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:45:23.187 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:15.081 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:45:23.264 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:15.082 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:45:23.217 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:01:15.108 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:45:23.292 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.608 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:46:27.745 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.613 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:46:27.750 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.618 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:46:27.802 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.622 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:46:27.806 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.626 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:46:27.810 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.627 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:46:27.811 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.687 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:46:27.870 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.689 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:46:27.873 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:02:19.707 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:46:27.844 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.392 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:51:39.529 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.396 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:51:39.534 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.424 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:51:39.608 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.429 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:51:39.613 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.435 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:51:39.618 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.445 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:51:39.628 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.657 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:51:39.795 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.688 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:51:39.872 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:31.703 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:51:39.887 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:07:33.619 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:35.367 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:36.535 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:39.457 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:39.871 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:40.096 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:47.850 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T16:07:51.936 INFO:teuthology.orchestra.run.smithi182.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:01.611 INFO:teuthology.orchestra.run.smithi182.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:01.837 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:06.116 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:06.387 INFO:teuthology.orchestra.run.smithi182.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:54.816 INFO:teuthology.orchestra.run.smithi182.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-29T16:08:57.749 INFO:teuthology.orchestra.run.smithi182.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-29T16:09:07.080 INFO:teuthology.orchestra.run.smithi182.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-29T16:09:10.657 INFO:teuthology.orchestra.run.smithi182.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-29T16:09:36.572 INFO:teuthology.orchestra.run.smithi182.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-29T16:09:41.730 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:53:49.867 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.734 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:53:49.871 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.776 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:53:49.958 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.777 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:53:49.961 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.823 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:53:50.006 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.825 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:53:50.008 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.866 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:53:50.003 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.879 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:53:50.061 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:09:41.907 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:53:50.090 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:10:29.881 INFO:teuthology.orchestra.run.smithi182.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-11-29T16:10:29.984 INFO:teuthology.orchestra.run.smithi182.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-11-29T16:11:31.961 INFO:teuthology.orchestra.run.smithi182.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-11-29T16:12:42.338 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:56:50.475 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.348 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:56:50.485 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.363 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:56:50.547 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.364 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:56:50.548 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.367 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:56:50.551 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.368 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:56:50.552 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.475 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:04:56:50.658 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.479 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:04:56:50.617 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:12:42.501 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:04:56:50.684 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:15:30.028 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T16:15:39.115 INFO:teuthology.orchestra.run.smithi182.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T16:15:51.712 INFO:teuthology.orchestra.run.smithi182.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-11-29T16:17:15.550 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:18.851 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:19.805 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:22.767 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:23.163 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:23.579 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:31.728 INFO:teuthology.orchestra.run.smithi182.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:37.214 INFO:teuthology.orchestra.run.smithi182.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:46.987 INFO:teuthology.orchestra.run.smithi182.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:47.217 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:51.885 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:52.219 INFO:teuthology.orchestra.run.smithi182.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:17:54.431 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:02.568 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.441 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:02.576 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.442 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:02.626 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.443 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:02.626 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.446 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:02.630 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.448 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:02.632 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.656 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:02.839 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.660 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:02.844 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:17:54.685 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:02.822 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.437 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:11.574 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.450 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:11.586 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.476 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:02:11.613 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.505 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:11.685 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.506 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:11.689 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.509 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:11.692 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.512 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:11.695 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.534 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:02:11.718 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:03.535 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:02:11.719 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:18:34.516 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:34.506+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:35.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:35.561+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:36.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:36.525+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:37.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:37.561+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:38.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:38.538+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:39.556 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:39.547+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:40.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:40.563+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:41.558 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:41.555+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:42.555 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:42.549+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:43.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:43.508+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:44.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:44.503+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:45.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:45.493+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:46.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:46.531+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:47.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:47.561+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:48.588 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:48.585+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:49.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:49.577+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:50.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:50.562+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:51.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:51.601+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:52.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:52.633+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:53.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:53.668+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:54.635 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:54.632+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:55.616 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:55.613+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:56.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:56.640+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:57.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:57.638+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:58.613 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:58.608+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:18:59.575 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:18:59.571+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:00.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:00.568+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:01.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:01.606+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:02.438 INFO:teuthology.orchestra.run.smithi182.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:19:02.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:02.641+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:03.662 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:03.657+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:04.557 INFO:teuthology.orchestra.run.smithi182.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:19:04.624 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:04.619+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:05.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:05.607+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:06.609 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:06.606+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:07.628 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:07.623+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:08.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:08.627+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:09.664 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:09.661+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:10.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:10.642+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:11.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:11.684+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:12.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:12.690+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:13.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:13.646+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:14.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:14.688+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:15.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:15.717+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:16.690 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:16.687+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:17.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:17.736+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:18.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:18.689+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:19.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:19.680+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:20.729 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:20.726+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:21.636 INFO:teuthology.orchestra.run.smithi182.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:19:21.743 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:21.739+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:22.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:22.769+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:23.728 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:23.725+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:24.728 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:24.724+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:25.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:25.717+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:26.219 INFO:teuthology.orchestra.run.smithi182.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:19:26.701 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:26.697+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:27.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:27.736+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:28.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:28.738+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:29.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:29.722+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:30.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:30.746+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:31.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:31.737+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:32.727 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:32.724+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:33.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:33.722+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:33.940 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:19:33.881+0000 1694c700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:54.315853+0000 front 2019-11-29T16:18:54.318864+0000 (oldest deadline 2019-11-29T16:19:33.794213+0000) 2019-11-29T16:19:34.083 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:03:42.219 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.095 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:03:42.228 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.157 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:03:42.340 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.160 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:03:42.343 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.169 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:03:42.353 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.172 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:03:42.309 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.174 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:03:42.358 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.257 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:03:42.440 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.323 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:03:42.502 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:19:34.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:19:34.622+0000 1694c700 -1 osd.7 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.489916+0000 front 2019-11-29T16:18:48.728041+0000 (oldest deadline 2019-11-29T16:19:33.740647+0000) 2019-11-29T16:19:34.767 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:34.760+0000 1694c700 -1 osd.6 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.723924+0000 front 2019-11-29T16:18:48.787147+0000 (oldest deadline 2019-11-29T16:19:33.742744+0000) 2019-11-29T16:19:34.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:34.764+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:34.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:19:34.923+0000 1694c700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:54.315853+0000 front 2019-11-29T16:18:54.318864+0000 (oldest deadline 2019-11-29T16:19:33.794213+0000) 2019-11-29T16:19:35.136 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:19:35.131+0000 1694c700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:53.687536+0000 front 2019-11-29T16:18:54.313829+0000 (oldest deadline 2019-11-29T16:19:34.237244+0000) 2019-11-29T16:19:35.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:19:35.649+0000 1694c700 -1 osd.7 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.489916+0000 front 2019-11-29T16:18:48.728041+0000 (oldest deadline 2019-11-29T16:19:33.740647+0000) 2019-11-29T16:19:35.821 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:35.814+0000 1694c700 -1 osd.6 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.723924+0000 front 2019-11-29T16:18:48.787147+0000 (oldest deadline 2019-11-29T16:19:33.742744+0000) 2019-11-29T16:19:35.822 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:35.817+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:35.972 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:19:35.967+0000 1694c700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:54.315853+0000 front 2019-11-29T16:18:54.318864+0000 (oldest deadline 2019-11-29T16:19:33.794213+0000) 2019-11-29T16:19:36.178 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:19:36.174+0000 1694c700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:53.687536+0000 front 2019-11-29T16:18:54.313829+0000 (oldest deadline 2019-11-29T16:19:34.237244+0000) 2019-11-29T16:19:36.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:19:36.649+0000 1694c700 -1 osd.2 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:50.018536+0000 front 2019-11-29T16:18:49.888964+0000 (oldest deadline 2019-11-29T16:19:35.745511+0000) 2019-11-29T16:19:36.665 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:19:36.661+0000 1694c700 -1 osd.7 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.489916+0000 front 2019-11-29T16:18:48.728041+0000 (oldest deadline 2019-11-29T16:19:33.740647+0000) 2019-11-29T16:19:36.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:36.820+0000 1694c700 -1 osd.6 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.723924+0000 front 2019-11-29T16:18:48.787147+0000 (oldest deadline 2019-11-29T16:19:33.742744+0000) 2019-11-29T16:19:36.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:36.834+0000 1694c700 -1 osd.6 132 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:36.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:19:36.922+0000 1694c700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:54.315853+0000 front 2019-11-29T16:18:54.318864+0000 (oldest deadline 2019-11-29T16:19:33.794213+0000) 2019-11-29T16:19:37.206 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:19:37.202+0000 1694c700 -1 osd.3 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:53.687536+0000 front 2019-11-29T16:18:54.313829+0000 (oldest deadline 2019-11-29T16:19:34.237244+0000) 2019-11-29T16:19:37.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:19:37.425+0000 1694c700 -1 osd.4 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:52.567347+0000 front 2019-11-29T16:18:54.298336+0000 (oldest deadline 2019-11-29T16:19:36.598420+0000) 2019-11-29T16:19:37.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:19:37.649+0000 1694c700 -1 osd.2 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:50.018536+0000 front 2019-11-29T16:18:49.888964+0000 (oldest deadline 2019-11-29T16:19:35.745511+0000) 2019-11-29T16:19:37.756 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:19:37.716+0000 1694c700 -1 osd.7 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:48.489916+0000 front 2019-11-29T16:18:48.728041+0000 (oldest deadline 2019-11-29T16:19:33.740647+0000) 2019-11-29T16:19:37.871 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:19:37.857+0000 1694c700 -1 osd.1 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:53.016610+0000 front 2019-11-29T16:18:52.206957+0000 (oldest deadline 2019-11-29T16:19:37.411304+0000) 2019-11-29T16:19:37.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:19:37.934+0000 1694c700 -1 osd.5 132 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:18:54.315853+0000 front 2019-11-29T16:18:54.318864+0000 (oldest deadline 2019-11-29T16:19:33.794213+0000) 2019-11-29T16:19:38.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:38.027+0000 1694c700 -1 osd.6 133 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:39.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:19:39.118+0000 1694c700 -1 osd.6 134 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4528.0:80571 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e132) 2019-11-29T16:19:48.721 INFO:teuthology.orchestra.run.smithi182.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:20:30.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:30.141+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:31.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:31.184+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:31.411 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:31.405+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:32.163 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:32.159+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:32.437 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:32.434+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:33.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:33.135+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:33.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:33.391+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:34.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:34.094+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:34.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:34.372+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:35.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:35.134+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:35.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:35.391+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:35.882 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:35.877+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:36.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:20:36.075+0000 1694c700 -1 osd.2 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:53.665770+0000 front 2019-11-29T16:19:53.648043+0000 (oldest deadline 2019-11-29T16:20:35.687999+0000) 2019-11-29T16:20:36.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:36.113+0000 1694c700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.926503+0000 front 2019-11-29T16:19:54.927634+0000 (oldest deadline 2019-11-29T16:20:35.608105+0000) 2019-11-29T16:20:36.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:36.116+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:36.313 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:20:36.310+0000 1694c700 -1 osd.1 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:52.172338+0000 front 2019-11-29T16:19:52.180342+0000 (oldest deadline 2019-11-29T16:20:36.257602+0000) 2019-11-29T16:20:36.386 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:20:36.382+0000 1694c700 -1 osd.6 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.029414+0000 front 2019-11-29T16:19:54.026307+0000 (oldest deadline 2019-11-29T16:20:36.277616+0000) 2019-11-29T16:20:36.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:36.434+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:36.916 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:36.910+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:37.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:20:37.089+0000 1694c700 -1 osd.2 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:53.665770+0000 front 2019-11-29T16:19:53.648043+0000 (oldest deadline 2019-11-29T16:20:35.687999+0000) 2019-11-29T16:20:37.160 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:37.155+0000 1694c700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.926503+0000 front 2019-11-29T16:19:54.927634+0000 (oldest deadline 2019-11-29T16:20:35.608105+0000) 2019-11-29T16:20:37.161 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:37.157+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:37.297 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:20:37.294+0000 1694c700 -1 osd.1 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:52.172338+0000 front 2019-11-29T16:19:52.180342+0000 (oldest deadline 2019-11-29T16:20:36.257602+0000) 2019-11-29T16:20:37.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:20:37.336+0000 1694c700 -1 osd.6 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.029414+0000 front 2019-11-29T16:19:54.026307+0000 (oldest deadline 2019-11-29T16:20:36.277616+0000) 2019-11-29T16:20:37.424 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:37.422+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:37.947 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:37.942+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:38.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:20:38.092+0000 1694c700 -1 osd.2 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:53.665770+0000 front 2019-11-29T16:19:53.648043+0000 (oldest deadline 2019-11-29T16:20:35.687999+0000) 2019-11-29T16:20:38.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:38.115+0000 1694c700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.926503+0000 front 2019-11-29T16:19:54.927634+0000 (oldest deadline 2019-11-29T16:20:35.608105+0000) 2019-11-29T16:20:38.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:38.116+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:38.255 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:20:38.250+0000 1694c700 -1 osd.1 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:52.172338+0000 front 2019-11-29T16:19:52.180342+0000 (oldest deadline 2019-11-29T16:20:36.257602+0000) 2019-11-29T16:20:38.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:20:38.380+0000 1694c700 -1 osd.6 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.029414+0000 front 2019-11-29T16:19:54.026307+0000 (oldest deadline 2019-11-29T16:20:36.277616+0000) 2019-11-29T16:20:38.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:38.457+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:38.990 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:38.985+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:39.056 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:20:39.045+0000 1694c700 -1 osd.4 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.436689+0000 front 2019-11-29T16:19:53.305565+0000 (oldest deadline 2019-11-29T16:20:38.590796+0000) 2019-11-29T16:20:39.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:20:39.087+0000 1694c700 -1 osd.2 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:53.665770+0000 front 2019-11-29T16:19:53.648043+0000 (oldest deadline 2019-11-29T16:20:35.687999+0000) 2019-11-29T16:20:39.138 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:39.132+0000 1694c700 -1 osd.5 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.926503+0000 front 2019-11-29T16:19:54.927634+0000 (oldest deadline 2019-11-29T16:20:35.608105+0000) 2019-11-29T16:20:39.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:39.135+0000 1694c700 -1 osd.5 139 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:39.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:20:39.254+0000 1694c700 -1 osd.1 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:52.172338+0000 front 2019-11-29T16:19:52.180342+0000 (oldest deadline 2019-11-29T16:20:36.257602+0000) 2019-11-29T16:20:39.370 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:20:39.366+0000 1694c700 -1 osd.6 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.029414+0000 front 2019-11-29T16:19:54.026307+0000 (oldest deadline 2019-11-29T16:20:36.277616+0000) 2019-11-29T16:20:39.474 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:39.469+0000 1694c700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:19:58.457365+0000 (oldest deadline 2019-11-29T16:20:38.457365+0000) 2019-11-29T16:20:39.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:39.474+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:39.991 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:39.987+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:40.048 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:20:40.043+0000 1694c700 -1 osd.4 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.436689+0000 front 2019-11-29T16:19:53.305565+0000 (oldest deadline 2019-11-29T16:20:38.590796+0000) 2019-11-29T16:20:40.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:40.138+0000 1694c700 -1 osd.5 140 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:40.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:40.452+0000 1694c700 -1 osd.0 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:19:58.457365+0000 (oldest deadline 2019-11-29T16:20:38.457365+0000) 2019-11-29T16:20:40.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:40.455+0000 1694c700 -1 osd.0 139 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:20:41.006 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:20:41.002+0000 1694c700 -1 osd.7 139 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:19:54.928046+0000 front 2019-11-29T16:19:54.926910+0000 (oldest deadline 2019-11-29T16:20:35.631936+0000) 2019-11-29T16:20:41.156 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:20:41.127+0000 1694c700 -1 osd.5 141 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101042 6.7 6:e92b3549:root::.bucket.meta.%eb%8c%8e%e1%a0%84%ef%84%92%eb%8c%8c%e1%a0%84%e3%9c%86%ef%84%8f%e1%a0%82%e9%90%89%ed%88%90%e0%a4%81%e2%98%83%ce%a9%e3%9c%85%ed%88%8e%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646:head [create,call version.set in=58b,writefull 0~318 in=318b,setxattr user.rgw.acl (193) in=205b] snapc 0=[] ondisk+write+known_if_redirected e135) 2019-11-29T16:20:41.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:20:41.434+0000 1694c700 -1 osd.0 141 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e136) 2019-11-29T16:21:52.130 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:06:00.267 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.136 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:06:00.273 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.146 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:06:00.329 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.153 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:06:00.336 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.154 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:06:00.338 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.160 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:06:00.344 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.350 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:06:00.487 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.364 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:06:00.547 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:52.377 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:06:00.561 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:21:53.291 INFO:teuthology.orchestra.run.smithi182.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:21:53.324 INFO:teuthology.orchestra.run.smithi182.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:22:48.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:22:48.796+0000 1694c700 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.332888+0000 front 2019-11-29T16:22:03.747837+0000 (oldest deadline 2019-11-29T16:22:48.387661+0000) 2019-11-29T16:22:49.749 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:22:49.743+0000 1694c700 -1 osd.7 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.496101+0000 front 2019-11-29T16:22:05.342527+0000 (oldest deadline 2019-11-29T16:22:49.184728+0000) 2019-11-29T16:22:49.847 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:22:49.845+0000 1694c700 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.332888+0000 front 2019-11-29T16:22:03.747837+0000 (oldest deadline 2019-11-29T16:22:48.387661+0000) 2019-11-29T16:22:50.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:22:50.058+0000 1694c700 -1 osd.6 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.770489+0000 front 2019-11-29T16:22:06.769856+0000 (oldest deadline 2019-11-29T16:22:50.048955+0000) 2019-11-29T16:22:50.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:22:50.134+0000 1694c700 -1 osd.5 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.318733+0000 front 2019-11-29T16:22:04.422704+0000 (oldest deadline 2019-11-29T16:22:49.693729+0000) 2019-11-29T16:22:50.679 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:22:50.659+0000 1694c700 -1 osd.3 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.342782+0000 front 2019-11-29T16:22:05.330071+0000 (oldest deadline 2019-11-29T16:22:49.768052+0000) 2019-11-29T16:22:50.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:22:50.701+0000 1694c700 -1 osd.7 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.496101+0000 front 2019-11-29T16:22:05.342527+0000 (oldest deadline 2019-11-29T16:22:49.184728+0000) 2019-11-29T16:22:50.895 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:22:50.892+0000 1694c700 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.332888+0000 front 2019-11-29T16:22:03.747837+0000 (oldest deadline 2019-11-29T16:22:48.387661+0000) 2019-11-29T16:22:51.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:22:51.052+0000 1694c700 -1 osd.6 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.770489+0000 front 2019-11-29T16:22:06.769856+0000 (oldest deadline 2019-11-29T16:22:50.048955+0000) 2019-11-29T16:22:51.113 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:22:51.108+0000 1694c700 -1 osd.5 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.318733+0000 front 2019-11-29T16:22:04.422704+0000 (oldest deadline 2019-11-29T16:22:49.693729+0000) 2019-11-29T16:22:51.687 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:22:51.684+0000 1694c700 -1 osd.3 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.342782+0000 front 2019-11-29T16:22:05.330071+0000 (oldest deadline 2019-11-29T16:22:49.768052+0000) 2019-11-29T16:22:51.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:22:51.702+0000 1694c700 -1 osd.7 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.496101+0000 front 2019-11-29T16:22:05.342527+0000 (oldest deadline 2019-11-29T16:22:49.184728+0000) 2019-11-29T16:22:51.855 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:22:51.847+0000 1694c700 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.332888+0000 front 2019-11-29T16:22:03.747837+0000 (oldest deadline 2019-11-29T16:22:48.387661+0000) 2019-11-29T16:22:52.051 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:22:52.037+0000 1694c700 -1 osd.6 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.770489+0000 front 2019-11-29T16:22:06.769856+0000 (oldest deadline 2019-11-29T16:22:50.048955+0000) 2019-11-29T16:22:52.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:22:52.074+0000 1694c700 -1 osd.5 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.318733+0000 front 2019-11-29T16:22:04.422704+0000 (oldest deadline 2019-11-29T16:22:49.693729+0000) 2019-11-29T16:22:52.312 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:22:52.306+0000 1694c700 -1 osd.4 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.873649+0000 front 2019-11-29T16:22:07.277458+0000 (oldest deadline 2019-11-29T16:22:52.137032+0000) 2019-11-29T16:22:52.689 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:22:52.686+0000 1694c700 -1 osd.3 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.342782+0000 front 2019-11-29T16:22:05.330071+0000 (oldest deadline 2019-11-29T16:22:49.768052+0000) 2019-11-29T16:22:52.713 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:22:52.709+0000 1694c700 -1 osd.7 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.496101+0000 front 2019-11-29T16:22:05.342527+0000 (oldest deadline 2019-11-29T16:22:49.184728+0000) 2019-11-29T16:22:52.830 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:22:52.821+0000 1694c700 -1 osd.2 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.332888+0000 front 2019-11-29T16:22:03.747837+0000 (oldest deadline 2019-11-29T16:22:48.387661+0000) 2019-11-29T16:22:53.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:22:53.031+0000 1694c700 -1 osd.6 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.770489+0000 front 2019-11-29T16:22:06.769856+0000 (oldest deadline 2019-11-29T16:22:50.048955+0000) 2019-11-29T16:22:53.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:22:53.093+0000 1694c700 -1 osd.5 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:05.318733+0000 front 2019-11-29T16:22:04.422704+0000 (oldest deadline 2019-11-29T16:22:49.693729+0000) 2019-11-29T16:22:53.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:22:53.264+0000 1694c700 -1 osd.4 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:06.873649+0000 front 2019-11-29T16:22:07.277458+0000 (oldest deadline 2019-11-29T16:22:52.137032+0000) 2019-11-29T16:22:53.739 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:22:53.734+0000 1694c700 -1 osd.7 146 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:22:04.496101+0000 front 2019-11-29T16:22:05.342527+0000 (oldest deadline 2019-11-29T16:22:49.184728+0000) 2019-11-29T16:23:50.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:50.522+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:51.502 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:51.493+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:51.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:51.572+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:51.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:51.891+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:52.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:52.537+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:52.549 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:52.544+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:52.576 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:52.570+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:52.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:52.854+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:53.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:53.514+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:53.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:53.546+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:53.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:53.552+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:53.881 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:53.874+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:54.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:54.548+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:54.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:54.554+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:54.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:54.589+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:54.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:54.688+0000 1694c700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:54.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:54.762+0000 1694c700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:54.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:54.887+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:55.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:55.522+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:55.602 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:55.596+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:55.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:55.623+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:55.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:55.654+0000 1694c700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:55.775 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:55.771+0000 1694c700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:55.879 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:55.875+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:56.577 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:56.571+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:56.621 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:56.618+0000 1694c700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:56.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:56.629+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:56.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:56.656+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:56.817 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:56.813+0000 1694c700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:56.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:56.854+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:57.598 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:57.594+0000 1694c700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:57.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:57.602+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:57.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:57.615+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:57.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:57.644+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:57.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:57.807+0000 1694c700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:57.908 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:57.905+0000 1694c700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:58.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:58.567+0000 1694c700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:58.598 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:58.591+0000 1694c700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:58.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:58.623+0000 1694c700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:58.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:58.626+0000 1694c700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:58.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:58.777+0000 1694c700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:58.968 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:58.924+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:23:59.670 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:23:59.663+0000 1694c700 -1 osd.5 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.674488+0000 front 2019-11-29T16:23:06.482407+0000 (oldest deadline 2019-11-29T16:23:51.682246+0000) 2019-11-29T16:23:59.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:23:59.674+0000 1694c700 -1 osd.7 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.576063+0000 front 2019-11-29T16:23:09.578601+0000 (oldest deadline 2019-11-29T16:23:50.452228+0000) 2019-11-29T16:23:59.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:23:59.803+0000 1694c700 -1 osd.6 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.475403+0000 front 2019-11-29T16:23:09.593384+0000 (oldest deadline 2019-11-29T16:23:54.747971+0000) 2019-11-29T16:23:59.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:23:59.880+0000 1694c700 -1 osd.4 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:06.642393+0000 front 2019-11-29T16:23:06.390503+0000 (oldest deadline 2019-11-29T16:23:51.521963+0000) 2019-11-29T16:23:59.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:23:59.878+0000 1694c700 -1 osd.1 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.620683+0000 front 2019-11-29T16:23:09.638747+0000 (oldest deadline 2019-11-29T16:23:54.298914+0000) 2019-11-29T16:23:59.984 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:23:59.971+0000 1694c700 -1 osd.2 150 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:23:09.578800+0000 front 2019-11-29T16:23:09.414559+0000 (oldest deadline 2019-11-29T16:23:51.645228+0000) 2019-11-29T16:24:17.422 INFO:teuthology.orchestra.run.smithi182.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-29T16:24:30.159 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:24:30.155+0000 1694c700 -1 osd.0 154 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:101807 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 61] snapc 0=[] ondisk+write+known_if_redirected e150) 2019-11-29T16:24:31.198 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:24:31.195+0000 1694c700 -1 osd.0 154 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:101807 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 61] snapc 0=[] ondisk+write+known_if_redirected e150) 2019-11-29T16:26:04.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:04.652+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:04.672 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:04.663+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:04.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:04.742+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:04.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:04.823+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:05.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:05.173+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:05.618 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:05.613+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:05.654 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:05.651+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:05.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:05.782+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:05.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:05.783+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:05.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:05.976+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:06.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:06.135+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:06.455 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:06.449+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:06.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:06.591+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:06.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:06.611+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:06.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:06.740+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:06.817 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:14.953 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:06.813+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:06.821 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:14.958 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.830 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:15.012 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.833 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:15.016 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.931 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:15.113 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.935 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:15.118 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:06.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:06.955+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:07.094 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:15.277 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:07.131 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:07.125+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:07.177 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:15.313 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:07.194 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:15.377 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:07.414 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:07.409+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:07.613 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:07.610+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:07.644 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:07.639+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:07.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:07.721+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:07.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:07.830+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:08.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:08.007+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:08.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:08.094+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:08.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:08.393+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:08.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:08.581+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:08.610 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:08.605+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:08.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:08.691+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:08.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:08.798+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:09.020 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:09.017+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:09.118 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:09.112+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:09.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:09.432+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:09.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:09.583+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:09.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:09.592+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:09.707 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:09.701+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:09.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:09.793+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:10.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:10.051+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:10.148 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:10.138+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:10.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:10.435+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:10.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:10.547+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:10.583 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:10.580+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:10.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:10.722+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:10.830 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:10.824+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:11.015 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:11.012+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:11.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:11.153+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:11.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:11.434+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:11.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:11.539+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:11.604 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:11.600+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:11.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:11.710+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:11.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:11.830+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:12.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:12.056+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:12.189 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:12.179+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:12.417 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:12.412+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:12.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:12.516+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:12.574 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:12.570+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:12.722 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:12.719+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:12.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:12.853+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:13.079 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:13.075+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:13.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:13.226+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:13.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:13.376+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:13.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:13.484+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:13.555 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:13.550+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:13.702 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:13.698+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:13.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:13.847+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:14.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:14.038+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:14.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:14.193+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:14.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:14.397+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:14.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:14.463+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:14.551 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:14.548+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:14.676 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:14.672+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:14.879 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:14.874+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:15.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:15.013+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:15.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:15.154+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:15.371 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:15.365+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:15.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:15.473+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:15.583 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:15.579+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:15.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:15.654+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:15.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:15.907+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:16.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:16.036+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:16.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:16.109+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:16.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:16.396+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:16.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:16.470+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:16.543 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:16.539+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:16.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:16.655+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:16.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:16.922+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:17.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:17.018+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:17.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:17.095+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:17.375 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:17.370+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:17.519 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:17.514+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:17.568 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:17.564+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:17.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:17.633+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:17.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:17.938+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:17.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:17.989+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:18.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:18.136+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:18.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:18.381+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:18.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:18.500+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:18.582 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:18.578+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:18.620 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:18.616+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:18.981 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:18.975+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:19.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:18.995+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:19.128 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:19.121+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:19.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:19.367+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:19.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:19.470+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:19.612 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:19.608+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:19.635 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:19.631+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:19.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:19.931+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:19.968 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:26:19.964+0000 1694c700 -1 osd.1 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.243417+0000 front 2019-11-29T16:25:19.279746+0000 (oldest deadline 2019-11-29T16:26:05.079213+0000) 2019-11-29T16:26:20.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:26:20.150+0000 1694c700 -1 osd.6 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:19.401607+0000 front 2019-11-29T16:25:19.880813+0000 (oldest deadline 2019-11-29T16:26:04.640955+0000) 2019-11-29T16:26:20.339 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:20.334+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:20.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:26:20.531+0000 1694c700 -1 osd.7 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.381562+0000 front 2019-11-29T16:25:20.431204+0000 (oldest deadline 2019-11-29T16:26:04.462106+0000) 2019-11-29T16:26:20.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:26:20.599+0000 1694c700 -1 osd.2 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:20.533360+0000 front 2019-11-29T16:25:20.504520+0000 (oldest deadline 2019-11-29T16:26:03.992548+0000) 2019-11-29T16:26:20.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:26:20.612+0000 1694c700 -1 osd.3 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.307605+0000 front 2019-11-29T16:25:22.306628+0000 (oldest deadline 2019-11-29T16:26:04.280016+0000) 2019-11-29T16:26:20.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:26:20.909+0000 1694c700 -1 osd.5 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:22.425034+0000 front 2019-11-29T16:25:22.343838+0000 (oldest deadline 2019-11-29T16:26:04.614039+0000) 2019-11-29T16:26:21.370 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:26:21.364+0000 1694c700 -1 osd.4 157 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:25:21.522192+0000 front 2019-11-29T16:25:21.659527+0000 (oldest deadline 2019-11-29T16:26:06.054172+0000) 2019-11-29T16:26:25.828 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:33.964 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.836 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:33.970 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.842 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:34.025 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.842 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:34.024 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.860 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:34.043 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.883 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:34.066 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.897 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:10:34.033 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.918 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:10:34.100 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:26:25.920 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:10:34.103 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:27:19.041 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:19.037+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:19.754 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:19.749+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:20.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:20.013+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:20.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:20.481+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:20.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:20.575+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:20.793 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:20.789+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:21.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:21.023+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:21.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:21.499+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:21.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:21.524+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:21.570 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:21.565+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:21.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:21.811+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:21.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:21.857+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:22.006 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:21.999+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:22.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:22.534+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:22.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:22.547+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:22.562 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:22.557+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:22.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:22.782+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:22.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:22.898+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:23.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:23.032+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:23.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:23.544+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:23.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:23.581+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:23.592 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:23.586+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:23.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:23.745+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:23.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:23.904+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:24.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:24.048+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:24.542 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:24.539+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:24.570 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:24.566+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:24.594 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:24.589+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:24.776 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:24.771+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:24.934 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:24.929+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:25.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:25.037+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:25.550 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:25.545+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:25.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:25.557+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:25.587 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:25.583+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:25.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:25.792+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:25.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:25.887+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:26.100 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:26.091+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:26.532 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:26.527+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:26.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:26.576+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:26.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:26.590+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:26.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:26.766+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:26.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:26.843+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:27.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:27.090+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:27.494 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:27.489+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:27.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:27.561+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:27.603 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:27.592+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:27.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:27.747+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:27.824 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:27.819+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:28.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:28.134+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:28.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:28.494+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:28.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:28.545+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:28.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:28.554+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:28.731 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:28.725+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:28.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:28.838+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:29.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:29.176+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:29.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:29.511+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:29.555 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:29.549+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:29.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:29.595+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:29.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:29.690+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:29.836 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:29.831+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:30.232 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:30.226+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:30.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:30.531+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:30.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:30.556+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:30.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:30.564+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:30.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:30.684+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:30.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:30.855+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:31.235 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:31.230+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:31.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:31.525+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:31.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:31.529+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:31.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:31.603+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:31.676 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:31.672+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:31.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:31.897+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:32.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:32.212+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:32.499 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:32.493+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:32.522 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:32.517+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:32.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:32.558+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:32.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:32.719+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:32.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:32.946+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:33.242 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:33.237+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:33.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:33.498+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:33.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:33.498+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:33.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:33.561+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:33.702 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:33.699+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:33.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:33.954+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:34.287 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:34.282+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:34.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:34.518+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:34.560 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:34.550+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:34.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:34.577+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:34.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:34.682+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:34.965 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:34.960+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:35.309 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:27:35.291+0000 1694c700 -1 osd.5 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.367588+0000 front 2019-11-29T16:26:35.353658+0000 (oldest deadline 2019-11-29T16:27:18.833228+0000) 2019-11-29T16:27:35.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:27:35.487+0000 1694c700 -1 osd.7 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:35.975463+0000 front 2019-11-29T16:26:36.157992+0000 (oldest deadline 2019-11-29T16:27:19.962593+0000) 2019-11-29T16:27:35.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:27:35.529+0000 1694c700 -1 osd.6 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.205128+0000 front 2019-11-29T16:26:35.944187+0000 (oldest deadline 2019-11-29T16:27:19.981100+0000) 2019-11-29T16:27:35.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:27:35.539+0000 1694c700 -1 osd.1 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:37.672280+0000 front 2019-11-29T16:26:37.762883+0000 (oldest deadline 2019-11-29T16:27:20.532074+0000) 2019-11-29T16:27:35.722 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:27:35.718+0000 1694c700 -1 osd.2 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:33.417304+0000 front 2019-11-29T16:26:33.418554+0000 (oldest deadline 2019-11-29T16:27:19.277671+0000) 2019-11-29T16:27:35.980 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:27:35.974+0000 1694c700 -1 osd.4 164 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:26:36.258938+0000 front 2019-11-29T16:26:36.165298+0000 (oldest deadline 2019-11-29T16:27:21.445870+0000) 2019-11-29T16:27:41.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:27:41.459+0000 1694c700 -1 osd.0 166 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4358.0:102427 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 63] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-29T16:27:42.473 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:27:42.466+0000 1694c700 -1 osd.0 166 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:102427 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 63] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-29T16:28:30.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:30.509+0000 114ab700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T16:28:30.697 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:30.674+0000 35f8c700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T16:28:31.133 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:31.080+0000 31f84700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T16:28:31.212 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:31.137+0000 31f84700 -1 osd.3 169 build_incremental_map_msg missing incremental map 169 2019-11-29T16:28:31.977 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:31.948+0000 114ab700 -1 osd.3 170 build_incremental_map_msg missing incremental map 170 2019-11-29T16:28:32.223 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:32.153+0000 34f8a700 -1 osd.3 170 build_incremental_map_msg missing incremental map 170 2019-11-29T16:28:32.348 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:32.333+0000 34789700 -1 osd.3 170 build_incremental_map_msg missing incremental map 170 2019-11-29T16:28:32.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:32.906+0000 30f82700 -1 osd.3 170 build_incremental_map_msg missing incremental map 169 2019-11-29T16:28:32.979 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:28:32.952+0000 30f82700 -1 osd.3 170 build_incremental_map_msg missing incremental map 170 2019-11-29T16:29:30.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:29.996+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:30.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:30.255+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:30.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:30.266+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:30.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:30.686+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:31.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:31.050+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:31.236 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:31.230+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:31.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:31.290+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:31.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:31.705+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:32.078 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:32.073+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:32.287 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:32.282+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:32.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:32.286+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:32.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:32.595+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:32.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:32.729+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:33.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:33.010+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:33.059 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:33.046+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:33.292 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:33.286+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:33.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:33.329+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:33.639 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:33.634+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:33.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:33.767+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:33.887 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:33.878+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:34.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:34.034+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:34.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:34.078+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:34.315 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:34.310+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:34.380 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:34.373+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:34.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:34.600+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:34.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:34.815+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:34.894 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:34.890+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:35.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:35.031+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:35.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:35.121+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:35.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:35.323+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:35.346 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:35.340+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:35.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:35.609+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:35.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:35.826+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:35.869 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:35.865+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:36.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:36.007+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:36.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:36.089+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:36.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:36.317+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:36.349 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:36.340+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:36.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:36.644+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:36.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:36.865+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:36.887 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:36.877+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:36.994 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:36.988+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:37.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:37.055+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:37.311 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:37.305+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:37.329 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:37.322+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:37.698 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:37.694+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:37.892 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:37.888+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:37.896 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:37.893+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:38.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:38.023+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:38.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:38.040+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:38.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:38.303+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:38.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:38.371+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:38.757 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:38.745+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:38.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:38.848+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:38.881 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:38.877+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:39.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:39.001+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:39.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:39.025+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:39.298 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:39.291+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:39.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:39.355+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:39.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:39.796+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:39.846 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:39.841+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:39.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:39.893+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:39.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:39.980+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:39.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:39.981+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:40.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:40.332+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:40.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:40.358+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:40.816 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:40.810+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:40.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:40.815+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:40.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:40.912+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:40.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:40.974+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:41.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:41.027+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:41.308 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:41.302+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:41.333 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:41.326+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:41.784 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:41.779+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:41.817 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:41.813+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:41.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:41.941+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:41.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:41.955+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:42.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:42.048+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:42.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:42.334+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:42.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:42.362+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:42.806 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:42.800+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:42.844 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:42.841+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:42.972 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:42.967+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:42.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:42.981+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:43.041 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:43.036+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:43.332 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:43.325+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:43.397 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:43.392+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:43.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:43.805+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:43.861 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:43.854+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:43.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:43.939+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:44.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:44.000+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:44.020 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:44.014+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:44.344 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:44.338+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:44.431 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:44.425+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:44.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:44.839+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:44.848 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:44.845+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:44.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:44.959+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:45.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:45.003+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:45.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:45.038+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:45.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:45.381+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:45.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:45.406+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:45.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:45.797+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:45.835 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:45.830+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:46.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:46.013+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:46.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:46.016+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:46.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:46.017+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:46.349 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:46.343+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:46.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:46.410+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:46.763 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:46.759+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:46.862 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:46.859+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:46.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:46.983+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:47.002 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:46.992+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:47.067 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:47.061+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:47.371 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:47.365+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:47.450 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:47.444+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:47.769 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:47.757+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:47.871 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:47.868+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:47.968 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:47.962+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:48.038 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:48.034+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:48.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:48.040+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:48.395 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:48.389+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:48.471 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:48.465+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:48.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:48.728+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:48.830 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:48.826+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:49.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:49.008+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:49.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:49.014+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:49.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:49.060+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:49.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:49.350+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:49.497 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:49.491+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:49.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:49.710+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:49.844 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:49.840+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:50.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:50.052+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:50.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:50.058+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:50.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:50.058+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:50.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:50.375+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:50.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:50.533+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:50.747 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:50.744+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:50.825 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:50.821+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:51.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:51.105+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:51.112 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:51.107+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:51.114 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:51.109+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:51.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:51.422+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:51.585 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:51.553+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:51.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:51.748+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:51.839 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:51.830+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:52.132 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:52.126+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:52.137 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:52.134+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:52.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:52.153+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:52.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:52.473+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:52.615 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:52.603+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:52.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:52.742+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:52.876 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:52.873+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:53.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:53.086+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:53.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:53.165+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:53.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:53.178+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:53.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:53.472+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:53.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:53.650+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:53.729 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:53.723+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:53.895 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:53.892+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:54.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:54.096+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:54.173 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:54.170+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:54.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:54.175+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:54.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:54.455+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:54.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:54.656+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:54.729 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:54.726+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:54.900 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:54.896+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:55.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:55.064+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:55.167 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:55.162+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:55.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:55.207+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:55.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:55.439+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:55.651 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:55.646+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:55.769 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:29:55.764+0000 1694c700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.232383+0000 front 2019-11-29T16:28:48.222648+0000 (oldest deadline 2019-11-29T16:29:31.695003+0000) 2019-11-29T16:29:55.946 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:55.942+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:29:56.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:29:56.049+0000 1694c700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:44.019173+0000 front 2019-11-29T16:28:43.499964+0000 (oldest deadline 2019-11-29T16:29:29.368792+0000) 2019-11-29T16:29:56.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:29:56.151+0000 1694c700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:47.798118+0000 front 2019-11-29T16:28:47.792965+0000 (oldest deadline 2019-11-29T16:29:30.676747+0000) 2019-11-29T16:29:56.258 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:29:56.252+0000 1694c700 -1 osd.5 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.169669+0000 front 2019-11-29T16:28:48.166495+0000 (oldest deadline 2019-11-29T16:29:32.684284+0000) 2019-11-29T16:29:56.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:29:56.450+0000 1694c700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.199471+0000 front 2019-11-29T16:28:48.183664+0000 (oldest deadline 2019-11-29T16:29:29.862572+0000) 2019-11-29T16:29:56.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:29:56.681+0000 1694c700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.554264+0000 front 2019-11-29T16:28:48.723822+0000 (oldest deadline 2019-11-29T16:29:30.124117+0000) 2019-11-29T16:29:56.918 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:29:56.907+0000 1694c700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:28:48.500018+0000 front 2019-11-29T16:28:48.429490+0000 (oldest deadline 2019-11-29T16:29:33.672169+0000) 2019-11-29T16:30:01.850 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:14:09.987 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:01.859 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:14:09.995 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:01.871 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:14:10.053 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:01.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:14:10.057 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:01.878 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:14:10.061 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:01.884 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:14:10.068 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:02.139 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:14:10.274 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:02.145 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:14:10.326 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:02.175 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:14:10.358 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:30:41.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:41.667+0000 114ab700 -1 osd.7 180 build_incremental_map_msg missing incremental map 178 2019-11-29T16:30:41.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:41.666+0000 11cac700 -1 osd.5 180 build_incremental_map_msg missing incremental map 178 2019-11-29T16:30:54.344 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:54.337+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:54.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:54.806+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:30:55.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:55.300+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:55.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:30:55.389+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:30:55.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:30:55.463+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:30:55.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:55.471+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:30:55.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:55.811+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:30:56.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:56.264+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:56.403 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:30:56.396+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:30:56.435 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:30:56.431+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:30:56.486 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:56.480+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:30:56.804 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:56.796+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:30:57.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:57.317+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:57.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:57.360+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:30:57.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:57.373+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:30:57.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:30:57.416+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:30:57.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:30:57.482+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:30:57.529 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:57.523+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:30:57.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:57.767+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:30:58.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:58.312+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:58.352 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:58.347+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:30:58.355 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:58.349+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:30:58.413 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:30:58.407+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:30:58.509 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:58.504+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:30:58.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:30:58.520+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:30:58.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:58.754+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:30:59.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:30:59.291+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:30:59.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:59.357+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:30:59.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:30:59.360+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:30:59.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:30:59.407+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:30:59.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:30:59.461+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:30:59.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:30:59.494+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:30:59.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:30:59.766+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:00.266 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:00.258+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:00.315 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:00.311+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:00.316 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:00.313+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:00.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:00.420+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:00.431 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:00.424+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:00.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:00.532+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:00.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:00.794+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:01.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:01.225+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:01.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:01.353+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:01.357 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:01.355+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:01.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:01.403+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:01.420 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:01.415+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:01.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:01.502+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:01.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:01.786+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:02.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:02.250+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:02.367 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:02.362+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:02.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:02.364+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:02.396 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:02.391+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:02.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:02.400+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:02.550 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:02.547+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:02.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:02.772+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:03.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:03.241+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:03.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:03.376+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:03.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:03.416+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:03.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:03.415+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:03.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:03.418+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:03.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:03.551+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:03.780 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:03.774+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:04.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:04.262+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:04.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:04.364+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:04.380 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:04.375+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:04.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:04.459+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:04.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:04.461+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:04.513 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:04.509+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:04.740 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:04.735+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:05.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:05.283+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:05.352 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:05.346+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:05.360 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:05.354+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:05.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:05.463+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:05.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:05.463+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:05.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:05.465+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:05.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:05.719+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:06.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:06.291+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:06.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:06.341+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:06.402 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:06.394+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:06.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:06.456+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:06.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:06.459+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:06.470 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:06.461+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:06.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:06.683+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:07.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:07.281+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:07.325 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:07.314+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:07.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:07.393+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:07.482 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:07.476+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:07.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:07.478+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:07.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:07.484+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:07.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:07.709+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:08.271 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:08.264+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:08.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:08.312+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:08.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:08.363+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:08.453 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:08.447+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:08.455 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:08.449+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:08.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:08.523+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:08.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:08.758+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:09.282 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:31:09.277+0000 1694c700 -1 osd.7 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:11.035487+0000 front 2019-11-29T16:30:14.016597+0000 (oldest deadline 2019-11-29T16:30:53.904608+0000) 2019-11-29T16:31:09.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:09.291+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:09.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:09.363+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:09.415 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:09.411+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:09.416 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:09.413+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:09.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:09.479+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:09.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:09.718+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:10.074 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:10.071+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:10.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:10.259+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:10.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:10.381+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:10.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:10.398+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:10.406 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:10.403+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:10.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:10.445+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:10.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:10.736+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:11.055 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:11.052+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:11.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:11.231+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:11.347 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:11.342+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:11.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:11.372+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:11.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:11.379+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:11.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:11.401+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:11.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:11.747+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:12.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:12.066+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:12.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:12.067+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:12.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:12.209+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:12.311 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:12.304+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:12.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:12.362+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:12.366 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:12.364+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:12.377 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:12.373+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:12.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:12.737+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:13.046 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:13.042+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:13.046 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:13.043+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:13.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:13.187+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:13.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:13.296+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:13.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:13.300+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:13.343 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:13.339+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:13.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:13.343+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:13.363 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:13.359+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:13.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:13.787+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:14.099 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:14.092+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:14.103 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:14.097+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:14.245 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:14.241+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:14.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:14.289+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:14.295 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:14.291+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:14.328 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:14.323+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:14.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:14.341+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:14.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:14.343+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:14.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:14.794+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:15.087 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:15.082+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:15.088 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:15.084+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:15.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:15.262+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:15.303 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:15.300+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:15.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:15.338+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:15.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:15.339+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:15.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:15.366+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:15.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:15.367+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:15.832 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:15.827+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:16.114 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:16.109+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:16.115 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:16.110+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:16.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:16.262+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:16.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:16.350+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:16.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:16.391+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:16.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:16.393+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:16.409 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:16.405+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:16.410 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:16.407+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:16.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:16.874+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:17.067 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:17.064+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:17.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:17.067+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:17.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:17.219+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:17.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:17.391+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:17.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:17.394+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:17.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:17.398+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:17.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:17.400+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:17.408 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:17.403+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:17.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:17.862+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:18.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:18.080+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:18.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:18.083+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:18.259 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:18.253+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:18.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:18.368+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:18.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:18.379+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:18.386 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:18.383+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:18.411 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:18.404+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:18.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:18.406+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:18.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:18.883+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:19.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:19.093+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:19.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:19.097+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:19.299 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:19.293+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:19.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:19.361+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:19.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:19.365+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:19.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:19.375+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:19.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:19.381+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:19.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:19.413+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:19.898 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:19.893+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:20.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:20.132+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:20.138 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:20.135+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:20.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:20.309+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:20.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:20.392+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:20.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:20.393+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:20.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:20.400+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:20.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:20.402+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:20.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:20.408+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:20.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:20.877+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:21.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:21.163+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:21.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:21.165+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:21.360 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:21.356+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:21.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:21.372+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:21.378 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:21.373+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:21.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:21.406+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:21.418 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:21.415+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:21.421 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:21.419+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:21.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:21.913+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:22.156 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:22.150+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:22.156 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:22.153+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:22.318 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:22.312+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:22.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:22.374+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:22.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:22.376+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:22.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:22.424+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:22.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:22.446+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:22.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:22.447+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:22.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:22.911+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:23.157 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:23.154+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:23.158 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:23.155+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:23.302 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:23.297+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:23.422 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:23.414+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:23.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:23.417+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:23.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:23.430+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:23.447 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:23.443+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:23.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:23.445+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:23.913 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:23.907+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:24.199 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:24.194+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:24.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:24.197+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:24.329 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:24.324+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:24.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:24.436+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:24.444 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:24.440+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:24.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:24.446+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:24.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:24.467+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:24.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:24.469+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:24.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:24.888+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:25.202 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:25.197+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:25.203 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:25.199+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:25.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:25.333+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:25.424 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:25.419+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:25.426 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:25.423+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:25.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:25.482+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:25.505 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:25.501+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:25.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:25.504+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:25.887 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:25.882+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:26.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:26.181+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:26.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:26.184+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:26.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:26.318+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:26.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:26.454+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:26.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:26.456+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:26.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:26.501+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:26.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:26.503+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:26.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:26.504+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:26.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:26.836+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:26.988 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:31:26.964+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e181 v181) 2019-11-29T16:31:27.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:27.146+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:27.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:27.147+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:27.297 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:27.291+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:27.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:27.494+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:27.502 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:27.498+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:27.505 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:27.502+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:27.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:27.506+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:27.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:27.508+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:27.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:27.864+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:28.139 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:28.135+0000 1694c700 -1 osd.0 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:30:31.498232+0000 (oldest deadline 2019-11-29T16:31:11.498232+0000) 2019-11-29T16:31:28.140 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:28.136+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:28.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:28.337+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:28.527 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:28.519+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:28.528 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:28.521+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:28.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:28.534+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:28.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:28.548+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:28.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:28.551+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:28.855 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:28.850+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:29.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:29.135+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:29.392 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:29.384+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:29.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:29.498+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:29.562 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:29.559+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:29.563 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:29.560+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:29.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:29.566+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:29.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:29.568+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:29.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:29.815+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:30.181 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:30.177+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:30.353 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:30.347+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:30.514 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:30.511+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:30.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:30.552+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:30.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:30.554+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:30.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:30.580+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:30.587 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:30.583+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:30.850 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:30.843+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:31.223 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:31.218+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:31.355 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:31.350+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:31.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:31.494+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:31.533 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:31.529+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:31.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:31.530+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:31.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:31.546+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:31.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:31.548+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:31.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:31.829+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:31.994 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:31:31.986+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e181 v181) 2019-11-29T16:31:32.251 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:32.248+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:32.378 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:32.369+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:32.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:32.499+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:32.506 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:32.503+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:32.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:32.503+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:32.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:32.547+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:32.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:32.548+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:32.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:32.824+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:33.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:33.262+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:33.376 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:33.371+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:33.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:33.461+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:33.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:33.463+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:33.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:33.471+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:33.533 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:33.529+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:33.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:33.532+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:33.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:33.842+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:34.239 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:34.237+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:34.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:34.395+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:34.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:34.418+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:34.425 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:34.422+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:34.456 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:34.451+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:34.515 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:34.510+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:34.517 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:34.514+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:34.806 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:34.800+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:35.273 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:35.264+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:35.416 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:35.407+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:35.416 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:35.410+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:35.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:35.447+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:35.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:35.447+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:35.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:35.563+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:35.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:35.565+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:35.856 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:35.850+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:36.241 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:36.236+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:36.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:36.419+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:36.444 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:36.438+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:36.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:36.444+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:36.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:36.446+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:36.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:36.537+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:36.546 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:36.541+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:36.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:36.822+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:37.009 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:31:37.004+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e181 v181) 2019-11-29T16:31:37.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:37.244+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:37.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:37.408+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:37.415 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:37.412+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:37.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:37.446+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:37.467 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:37.463+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:37.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:37.578+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:37.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:37.580+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:37.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:37.860+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:38.210 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:38.207+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:38.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:38.392+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:38.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:38.394+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:38.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:38.450+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:38.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:38.512+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:38.628 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:38.621+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:38.629 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:38.624+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:38.886 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:38.880+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:39.236 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:39.233+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:39.429 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:39.423+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:39.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:39.444+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:39.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:39.446+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:39.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:39.528+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:39.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:39.666+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:39.676 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:39.670+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:39.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:39.891+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:40.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:40.208+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:40.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:40.399+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:40.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:40.401+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:40.457 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:40.451+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:40.550 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:40.544+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:40.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:40.695+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:40.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:40.698+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:40.942 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:40.936+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:41.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:41.205+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:41.399 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:41.395+0000 1694c700 -1 osd.2 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:14.074564+0000 front 2019-11-29T16:30:14.082175+0000 (oldest deadline 2019-11-29T16:30:56.718100+0000) 2019-11-29T16:31:41.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:41.399+0000 1694c700 -1 osd.2 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:41.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:31:41.465+0000 1694c700 -1 osd.6 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.290225+0000 front 2019-11-29T16:30:10.324172+0000 (oldest deadline 2019-11-29T16:30:54.891381+0000) 2019-11-29T16:31:41.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:31:41.569+0000 1694c700 -1 osd.1 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:13.045148+0000 front 2019-11-29T16:30:12.927599+0000 (oldest deadline 2019-11-29T16:30:54.556841+0000) 2019-11-29T16:31:41.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:41.680+0000 1694c700 -1 osd.5 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:10.719861+0000 front 2019-11-29T16:30:10.572981+0000 (oldest deadline 2019-11-29T16:30:54.656157+0000) 2019-11-29T16:31:41.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:41.686+0000 1694c700 -1 osd.5 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:41.911 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:31:41.904+0000 1694c700 -1 osd.4 181 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:30:12.668653+0000 front 2019-11-29T16:30:12.565110+0000 (oldest deadline 2019-11-29T16:30:54.703661+0000) 2019-11-29T16:31:42.098 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:31:42.088+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e181 v181) 2019-11-29T16:31:42.197 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:31:42.170+0000 1694c700 -1 osd.0 181 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-29T16:31:42.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:42.409+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:42.735 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:42.730+0000 1694c700 -1 osd.5 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:31:43.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:31:43.389+0000 1694c700 -1 osd.2 182 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103042 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e177) 2019-11-29T16:31:43.814 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:31:43.805+0000 1694c700 -1 osd.5 183 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103071 6.7 6:e87a39a1:root::.bucket.meta.%e2%98%83%eb%8c%8b%e0%a4%83%e9%90%8a%ef%84%90%eb%8c%8e%ef%84%8f%e9%90%8a%e1%a0%82%e0%a4%83%e8%94%8b%e5%98%85%ef%84%90%eb%8c%8e%e8%94%8b%3a9baad822-b080-4db2-b995-bf7cc78f9da0.4528.643:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e180) 2019-11-29T16:32:49.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:49.254+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:50.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:50.269+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:51.319 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:51.315+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:52.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:52.320+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:53.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:53.336+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:54.375 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:54.371+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:55.330 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:55.326+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:56.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:56.334+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:57.366 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:57.360+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:58.385 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:58.381+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:32:59.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:32:59.355+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:00.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:00.351+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:01.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:01.392+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:02.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:02.417+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:03.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:03.417+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:04.378 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:04.374+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:05.382 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:05.379+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:06.395 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:06.388+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:07.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:07.387+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:07.675 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:15.811 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.718 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:15.854 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.793 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:15.973 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.801 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:15.983 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.804 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:15.987 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.821 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:16.003 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:07.997 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:16.131 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:08.024 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:16.206 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:08.040 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:16.223 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:08.360 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:08.356+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:09.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:09.344+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:09.351 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:09.346+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:09.430 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:09.424+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:10.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:10.346+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:10.355 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:10.349+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:10.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:10.425+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:10.985 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:10.971+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:11.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:11.130+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:11.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:11.349+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:11.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:11.350+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:11.389 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:11.382+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:11.424 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:11.416+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:11.974 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:11.970+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:12.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:12.116+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:12.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:12.174+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:12.349 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:12.343+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:12.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:12.349+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:12.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:12.370+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:12.454 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:12.436+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:13.027 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:13.023+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:13.098 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:13.094+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:13.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:13.174+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:13.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:13.335+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:13.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:13.350+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:13.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:13.353+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:13.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:13.494+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:13.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:13.710+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:14.007 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:14.003+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:14.085 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:14.081+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:14.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:14.200+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:14.311 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:14.304+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:14.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:14.346+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:14.356 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:14.351+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:14.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:14.497+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:14.726 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:14.720+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:15.021 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:15.016+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:15.046 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:15.041+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:15.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:15.232+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:15.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:15.334+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:15.378 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:15.372+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:15.385 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:15.377+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:15.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:15.477+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:15.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:15.684+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:16.012 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:16.008+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:16.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:16.028+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:16.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:16.268+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:16.342 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:16.336+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:16.343 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:16.338+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:16.392 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:16.385+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:16.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:16.527+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:16.748 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:16.742+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:17.011 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:17.006+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:17.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:17.029+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:17.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:17.308+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:17.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:17.339+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:17.348 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:17.344+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:17.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:17.421+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:17.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:17.548+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:17.765 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:17.760+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:18.016 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:18.010+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:18.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:18.024+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:18.358 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:18.352+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:18.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:18.381+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:18.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:18.385+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:18.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:18.398+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:18.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:18.571+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:18.794 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:18.790+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:19.006 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:19.001+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:19.066 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:19.062+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:19.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:19.360+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:19.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:19.382+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:19.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:19.430+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:19.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:19.435+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:19.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:19.530+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:19.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:19.762+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:20.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:20.049+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:20.076 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:20.071+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:20.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:20.361+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:20.380 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:20.375+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:20.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:20.451+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:20.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:20.452+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:20.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:20.552+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:20.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:20.772+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:21.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:21.056+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:21.068 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:21.063+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:21.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:21.334+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:21.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:21.359+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:21.445 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:21.438+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:21.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:21.441+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:21.594 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:21.588+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:21.817 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:21.813+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:22.092 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:22.089+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:22.101 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:22.096+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:22.298 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:22.292+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:22.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:22.349+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:22.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:22.470+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:22.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:22.473+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:22.581 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:22.574+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:22.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:22.824+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:23.068 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:23.064+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:23.125 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:23.117+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:23.276 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:23.270+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:23.373 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:23.368+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:23.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:23.466+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:23.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:23.471+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:23.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:23.557+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:23.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:23.787+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:24.038 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:24.034+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:24.100 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:24.096+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:24.256 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:24.249+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:24.410 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:24.403+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:24.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:24.429+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:24.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:24.432+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:24.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:24.548+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:24.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:24.741+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:25.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:25.021+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:25.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:25.110+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:25.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:25.266+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:25.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:25.366+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:25.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:25.396+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:25.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:25.398+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:25.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:25.536+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:25.800 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:25.793+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:26.004 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:25.999+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:26.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:26.137+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:26.265 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:26.259+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:26.355 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:26.348+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:26.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:26.396+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:26.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:26.399+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:26.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:26.528+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:26.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:26.779+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:27.011 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:27.003+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:27.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:27.123+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:27.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:27.272+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:27.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:27.352+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:27.367 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:27.361+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:27.368 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:27.364+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:27.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:27.500+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:27.741 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:27.737+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:27.974 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:27.970+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:28.160 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:28.155+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:28.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:28.307+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:28.379 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:28.374+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:28.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:28.398+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:28.408 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:28.403+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:28.488 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:28.483+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:28.728 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:28.723+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:28.963 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:28.959+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:29.182 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:29.178+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:29.322 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:29.316+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:29.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:29.332+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:29.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:29.444+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:29.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:29.449+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:29.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:29.536+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:29.689 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:29.685+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:29.973 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:29.966+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:30.207 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:30.203+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:30.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:30.295+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:30.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:30.298+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:30.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:30.456+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:30.464 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:30.459+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:30.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:30.584+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:30.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:30.718+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:30.926 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:30.919+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:31.177 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:31.165+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:31.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:31.290+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:31.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:31.302+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:31.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:31.479+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:31.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:31.483+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:31.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:31.616+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:31.728 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:31.722+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:31.897 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:31.892+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:32.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:32.219+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:32.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:32.339+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:32.352 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:32.346+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:32.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:32.470+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:32.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:32.473+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:32.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:32.621+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:32.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:32.751+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:32.924 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:32.918+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:33.199 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:33:33.196+0000 1694c700 -1 osd.1 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.542925+0000 front 2019-11-29T16:32:27.442758+0000 (oldest deadline 2019-11-29T16:33:11.387637+0000) 2019-11-29T16:33:33.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:33.325+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:33.396 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:33.390+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:33.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:33.454+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:33.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:33.459+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:33.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:33.629+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:33.719 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:33.714+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:33.969 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:33.954+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:34.340 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:34.335+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:34.420 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:34.413+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:34.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:34.416+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:34.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:34.421+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:34.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:34.611+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:34.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:34.677+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:34.927 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:34.924+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:35.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:35.386+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:35.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:35.442+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:35.452 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:35.446+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:35.455 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:35.451+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:35.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:35.622+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:35.724 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:35.719+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:35.899 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:35.895+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:36.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:36.385+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:36.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:36.418+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:36.431 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:36.423+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:36.467 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:36.460+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:36.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:36.662+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:36.742 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:36.738+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:36.933 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:36.928+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:37.362 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:37.355+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:37.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:37.459+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:37.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:37.465+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:37.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:37.468+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:37.667 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:37.659+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:37.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:37.789+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:37.939 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:37.934+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:38.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:38.394+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:38.460 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:38.454+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:38.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:38.472+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:38.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:38.476+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:38.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:38.709+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:38.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:38.840+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:38.925 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:38.915+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:39.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:39.373+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:39.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:39.416+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:39.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:39.455+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:39.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:39.457+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:39.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:39.694+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:39.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:39.835+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:39.936 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:39.932+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:40.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:40.385+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:40.422 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:40.416+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:40.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:40.421+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:40.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:40.436+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:40.761 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:40.747+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:40.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:40.802+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:40.907 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:40.903+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:41.379 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:41.373+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:41.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:41.406+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:41.468 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:41.462+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:41.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:41.468+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:41.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:41.758+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:41.798 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:41.794+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:41.881 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:41.878+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:42.411 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:33:42.405+0000 1694c700 -1 osd.5 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:25.714212+0000 front 2019-11-29T16:32:25.453351+0000 (oldest deadline 2019-11-29T16:33:10.121556+0000) 2019-11-29T16:33:42.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:33:42.431+0000 1694c700 -1 osd.6 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.702885+0000 front 2019-11-29T16:32:27.705216+0000 (oldest deadline 2019-11-29T16:33:09.276815+0000) 2019-11-29T16:33:42.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:42.436+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:42.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:42.442+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:42.776 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:33:42.772+0000 1694c700 -1 osd.2 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:27.803601+0000 front 2019-11-29T16:32:27.695937+0000 (oldest deadline 2019-11-29T16:33:13.431778+0000) 2019-11-29T16:33:42.784 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:42.779+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:42.802 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:33:42.790+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e186 v186) 2019-11-29T16:33:42.893 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:33:42.888+0000 1694c700 -1 osd.3 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.652076+0000 front 2019-11-29T16:32:26.651194+0000 (oldest deadline 2019-11-29T16:33:10.605507+0000) 2019-11-29T16:33:43.409 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:43.404+0000 1694c700 -1 osd.4 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.896223+0000 front 2019-11-29T16:32:26.898941+0000 (oldest deadline 2019-11-29T16:33:08.866444+0000) 2019-11-29T16:33:43.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:43.407+0000 1694c700 -1 osd.4 186 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:43.756 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:33:43.752+0000 1694c700 -1 osd.7 186 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:32:26.432907+0000 front 2019-11-29T16:32:25.984574+0000 (oldest deadline 2019-11-29T16:33:11.208560+0000) 2019-11-29T16:33:44.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:33:44.613+0000 1694c700 -1 osd.4 188 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103311 2.f 2:f0b74e53:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.646_beta%2f%ce%a9%eb%8c%8e%e9%90%8c%e3%9c%84%e3%9c%84%e8%94%88%e0%a4%83%ed%88%90%ce%a9%ed%88%8d%e5%98%85%e9%90%8a%e9%90%8b%e1%a0%81%ef%84%91:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e186) 2019-11-29T16:33:47.507 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:55.643 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.513 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:55.650 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.521 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:55.703 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.523 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:55.706 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.528 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:55.708 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.530 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:55.713 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.588 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:17:55.724 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.606 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:17:55.788 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:33:47.609 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:17:55.791 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:16.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:16.598+0000 124ad700 -1 osd.6 191 build_incremental_map_msg missing incremental map 191 2019-11-29T16:34:40.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:40.477+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:40.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:40.532+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:40.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:40.825+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:41.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:41.050+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:41.074 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:41.067+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:41.454 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:41.446+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:41.517 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:41.510+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:41.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:41.835+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:42.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:42.030+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:42.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:42.095+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:42.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:42.447+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:42.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:42.534+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:42.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:42.814+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:43.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:43.042+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:43.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:43.081+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:43.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:43.473+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:43.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:43.512+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:43.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:43.825+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:44.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:44.058+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:44.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:44.085+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:44.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:44.452+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:44.500 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:44.494+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:44.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:44.852+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:44.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:44.860+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:45.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:45.021+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:45.124 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:45.119+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:45.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:45.417+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:45.474 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:45.469+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:45.884 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:45.879+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:45.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:45.890+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:45.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:45.991+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:46.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:46.112+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:46.418 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:46.414+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:46.470 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:46.465+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:46.882 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:46.876+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:46.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:46.915+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:46.960 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:46.956+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:47.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:47.163+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:47.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:47.418+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:47.512 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:47.507+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:47.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:47.872+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:47.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:47.879+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:48.001 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:47.996+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:48.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:48.219+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:48.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:48.387+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:48.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:48.391+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:48.512 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:48.505+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:48.573 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:18:56.709 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.584 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:18:56.720 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.633 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:18:56.816 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.637 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:18:56.819 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.648 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:18:56.831 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.650 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:18:56.834 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.719 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:18:56.902 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.732 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:18:56.914 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.755 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:18:56.891 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:34:48.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:48.843+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:48.922 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:48.918+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:49.006 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:49.003+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:49.223 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:49.217+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:49.387 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:49.383+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:49.440 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:49.438+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:49.479 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:49.473+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:49.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:49.879+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:49.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:49.900+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:50.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:50.033+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:50.230 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:50.225+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:50.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:50.434+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:50.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:50.456+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:50.465 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:50.459+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:50.904 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:50.899+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:50.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:50.911+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:51.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:51.047+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:51.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:51.196+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:51.398 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:51.394+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:51.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:51.486+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:51.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:51.496+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:51.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:51.911+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:51.949 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:51.944+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:52.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:52.048+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:52.163 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:52.158+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:52.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:52.360+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:52.510 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:52.505+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:52.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:52.522+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:52.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:52.938+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:52.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:52.940+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:53.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:53.026+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:53.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:53.162+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:53.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:53.398+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:53.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:53.503+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:53.560 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:53.555+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:53.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:53.923+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:53.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:53.953+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:54.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:54.057+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:54.128 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:54.118+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:54.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:54.441+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:54.501 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:54.496+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:54.502 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:54.499+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:54.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:54.562+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:54.975 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:54.968+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:54.987 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:54.980+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:55.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:55.074+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:55.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:55.098+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:55.482 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:55.479+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:55.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:55.490+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:55.498 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:55.494+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:55.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:55.583+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:55.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:55.941+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:55.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:55.988+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:56.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:56.065+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:56.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:56.138+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:56.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:56.505+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:56.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:56.528+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:56.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:56.529+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:56.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:56.630+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:56.948 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:56.942+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:56.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:56.982+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:57.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:57.069+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:57.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:57.123+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:57.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:57.466+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:57.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:57.552+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:57.557 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:57.553+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:57.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:57.630+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:57.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:57.937+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:57.978 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:57.965+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:58.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:58.072+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:58.095 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:58.089+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:58.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:58.464+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:58.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:58.530+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:58.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:58.532+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:58.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:58.676+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:58.927 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:58.921+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:34:59.001 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:34:58.995+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:34:59.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:34:59.057+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:34:59.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:34:59.107+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:34:59.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:34:59.470+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:34:59.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:59.509+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:34:59.515 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:34:59.511+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:34:59.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:34:59.680+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:34:59.889 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:34:59.882+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:00.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:00.042+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:00.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:00.065+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:00.154 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:00.149+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:00.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:00.446+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:00.474 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:00.471+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:00.478 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:00.474+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:00.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:00.699+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:00.913 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:00.908+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:01.088 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:01.083+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:01.090 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:01.083+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:01.206 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:01.199+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:01.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:01.418+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:01.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:01.475+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:01.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:01.478+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:01.724 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:01.718+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:01.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:01.936+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:02.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:02.093+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:02.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:02.132+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:02.226 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:02.220+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:02.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:02.389+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:02.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:02.488+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:02.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:02.493+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:02.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:02.677+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:02.907 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:02.901+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:03.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:03.114+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:03.120 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:03.114+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:03.216 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:03.211+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:03.431 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:03.426+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:03.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:03.479+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:03.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:03.481+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:03.662 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:03.657+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:03.926 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:03.921+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:04.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:04.074+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:04.109 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:04.099+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:04.206 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:04.200+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:04.440 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:04.436+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:04.444 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:04.440+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:04.462 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:04.457+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:04.699 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:04.694+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:04.923 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:04.919+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:05.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:05.042+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:05.155 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:05.149+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:05.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:05.172+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:05.430 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:05.425+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:05.467 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:05.463+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:05.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:05.465+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:05.746 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:05.739+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:05.916 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:05.910+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:06.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:06.054+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:06.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:06.120+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:06.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:06.188+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:06.460 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:06.456+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:06.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:06.502+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:06.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:06.504+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:06.784 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:06.776+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:06.939 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:06.935+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:07.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:07.053+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:07.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:07.087+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:07.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:07.234+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:07.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:07.418+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:07.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:07.517+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:07.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:07.518+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:07.832 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:07.827+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:07.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:07.937+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:08.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:08.099+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:08.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:08.128+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:08.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:08.264+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:08.466 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:08.462+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:08.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:08.526+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:08.531 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:08.527+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:08.839 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:08.833+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:08.959 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:08.953+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:09.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:09.060+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:09.185 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:09.179+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:09.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:09.271+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:09.464 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:09.461+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:09.554 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:09.550+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:09.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:09.553+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:09.891 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:09.886+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:09.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:09.982+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:10.047 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:10.043+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:10.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:10.143+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:10.261 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:10.256+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:10.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:10.484+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:10.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:10.535+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:10.542 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:10.539+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:10.885 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:10.880+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:11.018 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:11.013+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:11.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:11.064+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:11.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:11.066+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:11.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:11.135+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:11.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:11.270+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:11.450 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:11.444+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:11.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:11.568+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:11.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:11.570+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:11.890 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:11.878+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:12.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:12.043+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:12.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:12.106+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:12.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:12.110+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:12.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:12.171+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:12.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:12.257+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:12.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:12.491+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:12.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:12.525+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:12.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:12.526+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:12.868 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:12.863+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:13.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:13.057+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:13.075 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:13.069+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:13.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:13.071+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:13.153 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:13.147+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:13.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:13.270+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:13.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:13.529+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:13.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:13.578+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:13.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:13.581+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:13.610 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:35:13.601+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e193 v193) 2019-11-29T16:35:13.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:13.857+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:14.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:14.058+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:14.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:14.061+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:14.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:14.102+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:14.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:14.147+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:14.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:14.233+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:14.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:14.548+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:14.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:14.552+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:14.567 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:14.562+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:14.842 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:14.834+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:15.080 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:15.074+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:15.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:15.110+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:15.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:15.114+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:15.127 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:15.122+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:15.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:15.276+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:15.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:15.528+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:15.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:15.531+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:15.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:15.585+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:15.834 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:15.828+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:16.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:16.051+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:16.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:16.114+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:16.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:16.118+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:16.133 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:16.128+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:16.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:16.254+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:16.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:16.504+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:16.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:16.505+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:16.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:16.628+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:16.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:16.857+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:17.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:17.054+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:17.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:17.140+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:17.146 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:17.143+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:17.155 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:17.149+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:17.237 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:17.231+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:17.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:17.535+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:17.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:17.537+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:17.643 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:17.638+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:17.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:17.817+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:18.110 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:18.104+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:18.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:18.146+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:18.153 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:18.148+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:18.153 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:18.150+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:18.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:18.278+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:18.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:18.568+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:18.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:18.572+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:18.659 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:35:18.621+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e193 v193) 2019-11-29T16:35:18.682 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:18.678+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:18.797 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:18.792+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:19.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:19.110+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:19.131 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:19.126+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:19.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:19.128+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:19.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:19.160+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:19.308 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:19.302+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:19.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:19.554+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:19.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:19.555+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:19.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:19.732+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:19.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:19.781+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:20.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:20.073+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:20.122 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:20.118+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:20.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:20.120+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:20.163 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:20.153+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:20.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:20.288+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:20.582 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:20.578+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:20.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:20.580+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:20.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:20.726+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:20.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:20.762+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:21.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:21.115+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:21.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:21.139+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:21.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:21.142+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:21.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:21.169+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:21.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:21.319+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:21.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:21.540+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:21.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:21.543+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:21.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:21.692+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:21.785 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:21.778+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:22.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:22.129+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:22.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:22.131+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:22.162 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:22.155+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:22.175 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:22.169+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:22.378 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:22.372+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:22.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:22.548+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:22.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:22.550+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:22.708 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:22.702+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:22.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:22.741+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:23.178 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:35:23.168+0000 1694c700 -1 osd.4 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.621183+0000 front 2019-11-29T16:33:54.619939+0000 (oldest deadline 2019-11-29T16:34:40.497652+0000) 2019-11-29T16:35:23.178 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:23.162+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:23.178 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:23.163+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:23.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:23.180+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:23.355 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:35:23.349+0000 1694c700 -1 osd.5 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:54.997033+0000 front 2019-11-29T16:33:55.023138+0000 (oldest deadline 2019-11-29T16:34:40.271203+0000) 2019-11-29T16:35:23.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:23.575+0000 1694c700 -1 osd.0 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:34:14.355761+0000 (oldest deadline 2019-11-29T16:34:54.355761+0000) 2019-11-29T16:35:23.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:35:23.576+0000 1694c700 -1 osd.0 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e191) 2019-11-29T16:35:23.712 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:35:23.705+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e193 v193) 2019-11-29T16:35:23.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:35:23.715+0000 1694c700 -1 osd.1 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.750087+0000 front 2019-11-29T16:33:58.806310+0000 (oldest deadline 2019-11-29T16:34:40.363669+0000) 2019-11-29T16:35:23.796 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:35:23.790+0000 1694c700 -1 osd.7 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:57.974268+0000 front 2019-11-29T16:33:57.879661+0000 (oldest deadline 2019-11-29T16:34:40.053811+0000) 2019-11-29T16:35:24.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:24.147+0000 1694c700 -1 osd.2 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:55.366446+0000 front 2019-11-29T16:34:00.056854+0000 (oldest deadline 2019-11-29T16:34:40.030822+0000) 2019-11-29T16:35:24.152 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:24.148+0000 1694c700 -1 osd.2 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:24.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:35:24.175+0000 1694c700 -1 osd.6 193 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:33:58.830511+0000 front 2019-11-29T16:33:58.763109+0000 (oldest deadline 2019-11-29T16:34:44.623182+0000) 2019-11-29T16:35:25.255 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:25.217+0000 1694c700 -1 osd.2 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:35:26.252 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:35:26.235+0000 1694c700 -1 osd.2 195 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:103660 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e193) 2019-11-29T16:36:47.292 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-11-29T16:36:47.895 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-11-29T16:36:52.746 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:52.740+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:52.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:52.805+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:53.626 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:53.619+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:53.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:53.735+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:53.847 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:53.839+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:53.897 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-11-29T16:36:54.502 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:54.495+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:54.651 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:54.643+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:54.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:54.692+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:54.887 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:54.880+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:54.943 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:54.936+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:36:54.971 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-11-29T16:36:55.089 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:36:55.082+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:36:55.099 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:36:55.092+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:36:55.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:55.495+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:55.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:55.603+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:55.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:55.744+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:55.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:55.901+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:55.949 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:55.944+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:36:56.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:36:56.057+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:36:56.087 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:36:56.083+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:36:56.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:56.460+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:56.590 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:56.575+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:56.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:56.774+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:56.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:56.945+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:56.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:56.987+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:36:57.072 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:36:57.064+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:36:57.126 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:36:57.121+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:36:57.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:57.449+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:57.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:57.577+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:57.808 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:57.801+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:57.912 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:57.909+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:57.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:57.975+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:36:58.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:36:58.037+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:36:58.150 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:36:58.146+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:36:58.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:58.420+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:58.567 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:58.561+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:58.867 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:58.856+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:58.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:58.937+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:36:58.954 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:36:58.950+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:36:59.056 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:36:59.049+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:36:59.171 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:36:59.167+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:36:59.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:36:59.431+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:36:59.547 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:36:59.541+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:36:59.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:36:59.847+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:36:59.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:36:59.981+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:00.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:00.002+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:00.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:00.071+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:00.216 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:00.211+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:00.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:00.414+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:00.549 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:00.536+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:00.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:00.832+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:00.944 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:00.937+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:01.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:01.032+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:01.040 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:01.036+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:01.213 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:01.207+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:01.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:01.371+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:01.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:01.587+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:01.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:01.839+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:01.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:01.927+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:01.999 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:01.993+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:02.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:02.012+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:02.266 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:02.261+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:02.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:02.399+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:02.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:02.569+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:02.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:02.839+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:02.974 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:02.971+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:03.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:03.025+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:03.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:03.049+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:03.223 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:03.219+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:03.447 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:03.440+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:03.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:03.597+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:03.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:03.807+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:03.929 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:03.924+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:04.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:04.014+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:04.062 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:04.055+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:04.253 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:04.248+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:04.427 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:04.420+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:04.575 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:04.568+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:04.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:04.854+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:04.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:04.893+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:05.049 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:05.040+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:05.081 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:05.075+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:05.279 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:05.275+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:05.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:05.449+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:05.591 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:05.585+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:05.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:05.856+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:05.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:05.888+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:06.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:06.035+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:06.084 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:06.079+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:06.289 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:06.283+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:06.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:06.406+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:06.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:06.602+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:06.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:06.852+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:06.948 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:06.942+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:07.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:07.037+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:07.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:07.050+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:07.292 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:07.288+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:07.378 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:07.372+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:07.627 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:07.621+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:07.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:07.897+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:07.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:07.935+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:08.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:08.023+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:08.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:08.038+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:08.271 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:08.264+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:08.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:08.353+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:08.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:08.657+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:08.888 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:08.883+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:08.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:08.982+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:09.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:09.028+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:09.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:09.034+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:09.255 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:09.250+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:09.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:09.363+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:09.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:09.683+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:09.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:09.898+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:09.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:09.996+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:10.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:10.008+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:10.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:10.026+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:10.285 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:10.272+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:10.455 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:10.417+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:10.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:10.690+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:10.876 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:10.872+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:10.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:10.984+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:11.020 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:11.013+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:11.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:11.049+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:11.325 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:11.321+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:11.471 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:11.464+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:11.699 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:11.694+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:11.873 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:11.867+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:11.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:11.981+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:12.043 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:12.028+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:12.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:12.031+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:12.302 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:12.298+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:12.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:12.496+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:12.722 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:12.716+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:12.856 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:12.851+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:12.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:12.941+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:13.083 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:13.078+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:13.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:13.054+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:13.320 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:13.315+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:13.551 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:13.545+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:13.738 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:13.732+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:13.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:13.856+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:13.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:13.953+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:14.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:14.064+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:14.074 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:14.063+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:14.297 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:14.293+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:14.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:14.546+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:14.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:14.713+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:14.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:14.854+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:14.920 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:14.914+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:15.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:15.018+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:15.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:15.060+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:15.299 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:15.294+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:15.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:15.591+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:15.677 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:15.668+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:15.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:15.899+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:15.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:15.942+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:16.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:16.007+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:16.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:16.081+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:16.266 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:16.262+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:16.564 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:16.557+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:16.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:16.685+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:16.890 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:16.884+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:16.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:16.966+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:17.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:17.046+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:17.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:17.056+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:17.269 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:17.252+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:17.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:17.584+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:17.708 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:17.701+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:17.902 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:17.897+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:18.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:18.014+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:18.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:18.044+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:18.097 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:18.091+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:18.269 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:18.264+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:18.645 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:18.638+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:18.688 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:18.681+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:18.910 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:18.905+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:19.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:19.007+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:19.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:19.046+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:19.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:19.097+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:19.310 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:19.305+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:19.611 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:19.601+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:19.703 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:19.693+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:19.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:19.908+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:20.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:20.043+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:20.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:20.062+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:20.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:20.096+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:20.290 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:20.281+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:20.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:20.560+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:20.735 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:20.729+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:20.944 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:20.939+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:21.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:20.998+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:21.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:21.096+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:21.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:21.135+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:21.333 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:21.327+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:21.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:21.570+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:21.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:21.687+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:21.914 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:21.909+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:22.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:22.019+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:22.118 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:22.111+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:22.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:22.175+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:22.314 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:22.309+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:22.608 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:22.602+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:22.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:22.717+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:22.965 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:22.961+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:23.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:23.062+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:23.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:23.095+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:23.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:23.200+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:23.305 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:23.301+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:23.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:37:23.632+0000 1694c700 -1 osd.7 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:10.247100+0000 front 2019-11-29T16:36:10.754401+0000 (oldest deadline 2019-11-29T16:36:54.245383+0000) 2019-11-29T16:37:23.701 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:37:23.695+0000 1694c700 -1 osd.4 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.843225+0000 front 2019-11-29T16:36:07.841890+0000 (oldest deadline 2019-11-29T16:36:52.973999+0000) 2019-11-29T16:37:23.921 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:37:23.916+0000 1694c700 -1 osd.2 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.458974+0000 front 2019-11-29T16:36:09.457799+0000 (oldest deadline 2019-11-29T16:36:54.715352+0000) 2019-11-29T16:37:24.062 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:37:24.056+0000 1694c700 -1 osd.5 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:08.883715+0000 front 2019-11-29T16:36:08.802553+0000 (oldest deadline 2019-11-29T16:36:54.657790+0000) 2019-11-29T16:37:24.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:37:24.062+0000 1694c700 -1 osd.1 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.949949+0000 front 2019-11-29T16:36:09.712128+0000 (oldest deadline 2019-11-29T16:36:52.592172+0000) 2019-11-29T16:37:24.205 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:37:24.201+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e200 v200) 2019-11-29T16:37:24.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:37:24.205+0000 1694c700 -1 osd.6 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:07.498861+0000 front 2019-11-29T16:36:07.388014+0000 (oldest deadline 2019-11-29T16:36:52.511654+0000) 2019-11-29T16:37:24.283 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:37:24.277+0000 1694c700 -1 osd.3 200 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:36:09.430735+0000 front 2019-11-29T16:36:09.171520+0000 (oldest deadline 2019-11-29T16:36:54.461915+0000) 2019-11-29T16:37:27.930 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:21:36.066 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.941 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:21:36.123 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.941 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:21:36.078 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.947 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:21:36.127 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.949 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:21:36.132 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:27.955 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:21:36.137 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:28.137 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:21:36.312 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:28.151 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:21:36.287 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:37:28.174 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:21:36.356 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:38:19.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:19.109+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:20.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:20.068+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:21.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:21.105+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:22.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:22.101+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:22.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:22.412+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:22.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:22.565+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:22.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:22.735+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:23.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:23.098+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:23.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:23.099+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:23.414 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:23.411+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:23.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:23.524+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:23.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:23.750+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:24.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:24.061+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:24.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:24.063+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:24.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:24.371+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:24.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:24.484+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:24.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:24.708+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:25.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:25.104+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:25.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:25.106+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:25.335 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:25.330+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:25.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:25.466+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:25.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:25.732+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:26.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:26.048+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:26.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:26.115+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:26.122 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:26.119+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:26.293 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:26.288+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:26.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:26.494+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:26.733 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:26.726+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:27.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:27.064+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:27.138 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:27.131+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:27.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:27.151+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:27.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:27.152+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:27.292 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:27.288+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:27.492 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:27.486+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:27.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:27.715+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:28.067 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:28.061+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:28.131 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:28.120+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:28.180 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:28.176+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:28.187 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:28.179+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:28.252 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:28.247+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:28.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:28.529+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:28.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:28.710+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:29.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:29.026+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:29.150 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:29.146+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:29.150 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:29.147+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:29.170 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:29.166+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:29.295 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:29.291+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:29.575 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:29.569+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:29.753 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:29.747+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:30.084 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:30.078+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:30.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:30.120+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:30.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:30.122+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:30.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:30.156+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:30.342 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:30.335+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:30.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:30.608+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:30.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:30.755+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:31.059 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:31.050+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:31.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:31.087+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:31.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:31.088+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:31.135 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:31.130+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:31.351 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:31.347+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:31.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:31.630+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:31.737 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:31.731+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:32.088 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:32.082+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:32.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:32.086+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:32.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:32.091+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:32.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:32.135+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:32.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:32.310+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:32.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:32.654+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:32.773 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:32.768+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:33.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:33.103+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:33.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:33.104+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:33.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:33.136+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:33.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:33.176+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:33.280 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:33.276+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:33.656 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:33.638+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:33.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:33.759+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:34.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:34.095+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:34.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:34.097+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:34.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:34.156+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:34.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:34.162+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:34.236 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:34.231+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:34.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:34.682+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:34.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:34.801+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:35.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:35.094+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:35.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:35.095+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:35.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:35.150+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:35.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:35.191+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:35.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:35.201+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:35.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:35.726+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:35.797 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:35.792+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:36.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:36.092+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:36.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:36.094+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:36.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:36.152+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:36.186 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:36.181+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:36.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:36.219+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:36.403 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:36.399+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:36.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:36.713+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:36.843 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:36.837+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:37.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:37.088+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:37.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:37.090+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:37.175 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:37.169+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:37.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:37.181+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:37.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:37.237+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:37.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:37.375+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:37.382 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:37.378+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:37.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:37.748+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:37.810 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:37.805+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:38.142 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:38.138+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:38.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:38.140+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:38.153 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:38.148+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:38.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:38.172+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:38.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:38.200+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:38.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:38.336+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:38.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:38.339+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:38.721 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:38.715+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:38.863 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:38.858+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:39.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:39.105+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:39.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:39.106+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:39.182 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:39.175+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:39.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:39.202+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:39.220 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:38:39.216+0000 1694c700 -1 osd.1 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.850275+0000 front 2019-11-29T16:37:38.827357+0000 (oldest deadline 2019-11-29T16:38:22.325294+0000) 2019-11-29T16:38:39.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:39.330+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:39.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:39.331+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:39.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:39.711+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:39.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:39.875+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:40.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:40.069+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:40.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:40.070+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:40.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:40.171+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:40.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:40.218+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:40.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:40.313+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:40.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:40.316+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:40.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:40.748+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:40.917 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:40.911+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:41.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:41.058+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:41.063 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:41.061+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:41.195 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:41.189+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:41.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:41.194+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:41.338 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:41.334+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:41.339 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:41.335+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:41.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:41.736+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:41.925 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:41.920+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:42.049 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:42.044+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:42.049 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:42.045+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:42.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:42.224+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:42.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:42.242+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:42.336 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:42.330+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:42.337 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:42.332+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:42.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:42.765+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:42.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:42.933+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:43.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:43.075+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:43.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:43.078+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:43.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:43.245+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:43.251 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:43.246+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:43.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:43.353+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:43.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:43.355+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:43.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:43.736+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:43.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:43.911+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:44.084 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:44.079+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:44.085 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:44.081+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:44.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:44.226+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:44.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:44.250+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:44.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:44.321+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:44.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:44.323+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:44.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:44.735+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:44.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:44.934+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:45.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:45.063+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:45.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:45.065+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:45.228 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:45.222+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:45.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:45.256+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:45.364 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:45.360+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:45.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:45.362+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:45.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:45.722+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:45.953 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:45.947+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:46.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:46.028+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:46.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:46.030+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:46.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:46.225+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:46.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:46.233+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:46.380 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:46.375+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:46.380 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:46.377+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:46.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:46.719+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:46.920 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:46.914+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:47.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:47.006+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:47.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:47.008+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:47.226 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:47.221+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:47.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:47.219+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:47.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:47.340+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:47.348 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:47.345+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:47.744 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:47.739+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:47.933 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:47.928+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:47.986 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:47.982+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:47.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:47.983+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:48.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:48.187+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:48.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:48.265+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:48.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:48.335+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:48.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:48.337+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:48.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:48.758+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:48.921 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:48.915+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:48.996 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:48.990+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:48.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:48.996+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:49.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:49.210+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:49.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:49.247+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:49.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:49.342+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:49.348 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:49.344+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:49.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:49.767+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:49.878 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:49.872+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:49.963 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:49.959+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:49.964 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:49.961+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:50.219 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:50.214+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:50.227 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:50.222+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:50.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:50.337+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:50.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:50.341+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:50.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:50.752+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:50.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:50.831+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:50.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:50.928+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:50.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:50.932+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:51.202 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:51.196+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:51.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:51.259+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:51.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:51.314+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:51.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:51.317+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:51.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:51.711+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:51.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:51.812+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:51.962 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:51.957+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:51.963 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:51.959+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:52.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:52.228+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:52.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:52.244+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:52.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:52.283+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:52.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:52.285+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:52.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:52.733+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:52.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:52.769+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:52.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:52.983+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:52.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:52.984+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:53.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:53.205+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:53.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:53.245+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:53.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:53.323+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:53.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:53.325+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:53.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:53.700+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:53.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:53.752+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:54.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:54.017+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:54.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:54.018+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:54.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:54.249+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:54.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:54.252+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:54.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:54.346+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:54.351 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:54.347+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:54.663 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:54.657+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:54.702 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:38:54.695+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e206 v206) 2019-11-29T16:38:54.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:54.793+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:55.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:55.054+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:55.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:55.056+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:55.269 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:55.263+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:55.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:55.286+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:55.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:55.330+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:55.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:55.333+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:55.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:55.626+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:55.838 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:55.830+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:56.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:56.010+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:56.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:56.014+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:56.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:56.275+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:56.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:56.296+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:56.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:56.299+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:56.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:56.298+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:56.651 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:56.645+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:56.886 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:56.880+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:57.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:57.057+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:57.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:57.059+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:57.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:57.291+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:57.321 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:57.315+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:57.337 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:57.333+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:57.338 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:57.334+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:57.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:57.652+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:57.883 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:57.877+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:58.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:58.062+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:58.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:58.063+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:58.288 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:58.283+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:58.314 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:58.308+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:58.383 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:58.378+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:58.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:58.380+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:58.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:58.630+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:58.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:58.890+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:38:59.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:59.082+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:38:59.087 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:38:59.084+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:38:59.301 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:38:59.296+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:38:59.307 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:38:59.302+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:38:59.362 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:59.358+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:38:59.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:38:59.361+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:38:59.619 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:38:59.614+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:38:59.723 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:38:59.715+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e206 v206) 2019-11-29T16:38:59.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:38:59.852+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:00.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:00.056+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:00.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:00.058+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:00.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:00.303+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:00.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:00.346+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:00.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:00.397+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:00.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:00.401+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:00.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:00.635+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:00.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:00.843+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:01.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:01.086+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:01.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:01.089+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:01.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:01.314+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:01.338 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:01.333+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:01.378 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:01.374+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:01.380 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:01.377+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:01.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:01.655+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:01.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:01.844+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:02.138 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:02.134+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:02.139 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:02.136+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:02.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:02.314+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:02.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:02.353+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:02.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:02.356+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:02.366 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:02.361+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:02.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:02.618+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:02.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:02.828+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:03.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:03.143+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:03.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:03.145+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:03.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:03.273+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:03.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:03.351+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:03.357 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:03.351+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:03.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:03.353+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:03.604 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:03.598+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:03.863 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:03.857+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:04.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:04.119+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:04.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:04.121+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:04.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:04.238+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:04.322 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:04.310+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:04.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:04.341+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:04.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:04.343+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:04.569 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:04.562+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:04.738 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:39:04.732+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e206 v206) 2019-11-29T16:39:04.872 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:04.866+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:05.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:05.114+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:05.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:05.118+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:05.295 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:05.289+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:05.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:05.310+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:05.395 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:05.390+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:05.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:05.391+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:05.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:05.523+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:05.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:05.886+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:06.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:06.101+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:06.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:06.103+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:06.308 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:06.302+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:06.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:06.330+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:06.444 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:06.439+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:06.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:06.441+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:06.540 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:06.534+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:06.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:06.935+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:07.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:07.151+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:07.157 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:07.154+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:07.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:07.285+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:07.359 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:07.352+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:07.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:07.412+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:07.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:07.414+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:07.559 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:07.551+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:07.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:07.936+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:08.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:08.129+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:08.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:08.134+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:08.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:08.244+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:08.369 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:08.362+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:08.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:08.427+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:08.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:08.430+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:08.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:08.542+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:08.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:08.891+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:09.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:09.152+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:09.157 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:09.154+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:09.269 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:09.262+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:09.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:39:09.407+0000 1694c700 -1 osd.6 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:41.483293+0000 front 2019-11-29T16:37:41.498806+0000 (oldest deadline 2019-11-29T16:38:26.711638+0000) 2019-11-29T16:39:09.422 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:09.418+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:09.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:09.422+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:09.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:39:09.564+0000 1694c700 -1 osd.4 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:38.206965+0000 front 2019-11-29T16:37:38.121274+0000 (oldest deadline 2019-11-29T16:38:22.089685+0000) 2019-11-29T16:39:09.817 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:39:09.808+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e206 v206) 2019-11-29T16:39:09.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:39:09.858+0000 1694c700 -1 osd.5 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:37.961748+0000 front 2019-11-29T16:37:38.019762+0000 (oldest deadline 2019-11-29T16:38:22.031674+0000) 2019-11-29T16:39:10.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:10.131+0000 1694c700 -1 osd.2 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:40.632831+0000 front 2019-11-29T16:37:40.719175+0000 (oldest deadline 2019-11-29T16:38:22.928863+0000) 2019-11-29T16:39:10.135 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:10.133+0000 1694c700 -1 osd.2 206 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:10.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:39:10.288+0000 1694c700 -1 osd.7 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:37:39.709694+0000 front 2019-11-29T16:37:40.386355+0000 (oldest deadline 2019-11-29T16:38:25.419211+0000) 2019-11-29T16:39:10.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:10.412+0000 1694c700 -1 osd.0 206 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:37:57.278470+0000 (oldest deadline 2019-11-29T16:38:37.278470+0000) 2019-11-29T16:39:10.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:39:10.416+0000 1694c700 -1 osd.0 206 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e204) 2019-11-29T16:39:11.153 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:11.148+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:39:12.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:39:12.104+0000 1694c700 -1 osd.2 207 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104199 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e202) 2019-11-29T16:40:38.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:38.726+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:38.959 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:38.953+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:39.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:39.265+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:39.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:39.267+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:39.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:39.694+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:39.938 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:39.931+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:40.241 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:40.233+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:40.242 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:40.236+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:40.247 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:40.240+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:40.486 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:40.481+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:40.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:40.667+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:40.879 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:40.874+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:40.966 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:40.962+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:41.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:41.256+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:41.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:41.258+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:41.293 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:41.286+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:41.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:41.337+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:41.507 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:41.503+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:41.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:41.627+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:41.877 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:41.871+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:41.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:41.974+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:42.255 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:42.248+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:42.290 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:42.282+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:42.294 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:42.289+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:42.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:42.380+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:42.468 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:42.464+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:42.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:42.671+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:42.830 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:42.825+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:42.957 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:42.953+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:43.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:43.239+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:43.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:43.291+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:43.299 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:43.295+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:43.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:43.432+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:43.447 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:43.441+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:43.711 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:43.705+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:43.824 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:43.819+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:43.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:43.937+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:44.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:44.210+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:44.312 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:44.305+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:44.313 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:44.308+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:44.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:44.433+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:44.448 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:44.442+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:44.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:44.679+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:44.826 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:44.821+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:44.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:44.982+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:45.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:45.247+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:45.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:45.354+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:45.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:45.359+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:45.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:45.438+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:45.467 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:45.462+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:45.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:45.687+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:45.783 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:45.776+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:45.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:45.989+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:46.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:46.276+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:46.346 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:46.341+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:46.349 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:46.346+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:46.420 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:46.414+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:46.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:46.494+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:46.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:46.744+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:46.782 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:46.777+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:46.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:46.991+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:47.318 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:47.313+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:47.390 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:47.384+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:47.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:47.389+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:47.445 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:47.440+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:47.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:47.507+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:47.739 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:47.735+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:47.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:47.751+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:48.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:48.022+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:48.275 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:48.270+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:48.395 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:48.387+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:48.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:48.390+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:48.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:48.485+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:48.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:48.561+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:48.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:48.726+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:48.760 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:48.757+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:49.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:49.051+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:49.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:49.227+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:49.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:49.409+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:49.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:49.412+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:49.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:49.536+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:49.610 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:49.605+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:49.719 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:49.713+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:49.775 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:49.770+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:50.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:50.100+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:50.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:50.199+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:50.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:50.412+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:50.419 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:50.415+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:50.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:50.578+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:50.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:50.589+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:50.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:50.694+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:50.805 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:50.800+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:51.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:51.092+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:51.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:51.203+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:51.428 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:51.424+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:51.429 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:51.425+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:51.582 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:51.577+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:51.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:51.577+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:51.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:51.726+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:51.835 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:51.830+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:52.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:52.137+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:52.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:52.210+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:52.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:52.445+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:52.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:52.449+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:52.624 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:52.619+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:52.629 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:52.623+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:52.697 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:52.691+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:52.850 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:52.844+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:53.190 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:53.184+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:53.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:53.221+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:53.465 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:53.453+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:53.470 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:53.466+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:53.587 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:53.583+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:53.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:53.640+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:53.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:53.715+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:53.902 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:53.898+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:54.165 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:54.162+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:54.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:54.270+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:54.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:54.470+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:54.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:54.473+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:54.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:54.547+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:54.642 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:54.635+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:54.768 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:54.762+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:54.898 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:54.893+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:55.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:55.212+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:55.329 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:55.324+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:55.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:55.471+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:55.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:55.474+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:55.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:55.540+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:55.666 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:55.660+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:55.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:55.720+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:55.853 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:55.848+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:56.258 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:56.253+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:56.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:56.325+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:56.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:56.510+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:56.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:56.513+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:56.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:56.526+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:56.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:56.633+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:56.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:56.701+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:56.823 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:56.819+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:57.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:57.270+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:57.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:57.361+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:57.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:57.504+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:57.567 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:57.561+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:57.567 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:57.563+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:57.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:57.594+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:57.719 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:57.713+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:57.863 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:57.857+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:58.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:58.280+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:58.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:58.409+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:58.504 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:58.500+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:58.556 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:58.551+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:58.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:58.554+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:58.631 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:58.626+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:58.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:58.735+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:58.911 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:58.906+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:40:59.320 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:40:59.316+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:40:59.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:40:59.399+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:40:59.526 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:59.519+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:40:59.527 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:40:59.522+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:40:59.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:40:59.543+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:40:59.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:40:59.616+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:40:59.772 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:40:59.766+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:40:59.939 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:40:59.935+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:00.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:00.356+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:00.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:00.443+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:00.514 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:00.509+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:00.562 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:00.556+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:00.563 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:00.558+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:00.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:00.659+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:00.787 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:00.782+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:00.936 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:00.932+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:01.343 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:01.338+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:01.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:01.398+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:01.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:01.520+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:01.554 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:01.548+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:01.556 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:01.553+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:01.697 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:01.692+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:01.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:01.778+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:01.963 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:01.958+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:02.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:02.337+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:02.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:02.438+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:02.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:02.531+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:02.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:02.532+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:02.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:02.537+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:02.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:02.677+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:02.827 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:02.822+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:03.016 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:03.011+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:03.301 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:03.296+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:03.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:03.404+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:03.505 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:03.501+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:03.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:03.511+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:03.523 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:03.514+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:03.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:03.646+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:03.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:03.813+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:04.031 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:04.027+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:04.282 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:04.278+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:04.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:04.362+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:04.521 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:04.513+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:04.523 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:04.518+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:04.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:04.522+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:04.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:04.633+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:04.857 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:04.850+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:05.033 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:05.027+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:05.264 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:05.260+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:05.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:05.348+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:05.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:05.545+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:05.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:05.547+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:05.578 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:05.574+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:05.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:05.632+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:05.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:05.860+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:06.048 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:06.043+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:06.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:06.243+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:06.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:06.320+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:06.519 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:06.513+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:06.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:06.518+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:06.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:06.533+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:06.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:06.594+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:06.876 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:06.869+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:07.007 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:07.002+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:07.267 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:07.263+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:07.374 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:07.367+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:07.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:07.550+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:07.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:07.553+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:07.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:07.556+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:07.638 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:07.631+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:07.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:07.839+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:08.051 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:08.046+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:08.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:08.304+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:08.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:08.352+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:08.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:08.511+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:08.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:08.596+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:08.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:08.601+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:08.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:08.603+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:08.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:08.814+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:09.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:09.022+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:09.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:09.266+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:09.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:09.374+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:09.546 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:09.541+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:09.629 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:09.623+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:09.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:09.649+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:09.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:09.653+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:09.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:09.773+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:10.057 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:10.054+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:10.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:10.236+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:10.329 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:41:10.321+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e213 v213) 2019-11-29T16:41:10.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:10.363+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:10.583 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:10.579+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:10.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:10.614+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:10.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:10.617+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:10.684 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:10.676+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:10.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:10.757+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:11.023 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:11.015+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:11.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:11.193+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:11.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:11.321+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:11.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:11.554+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:11.597 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:11.590+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:11.598 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:11.595+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:11.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:11.703+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:11.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:11.737+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:12.011 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:12.006+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:12.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:12.220+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:12.326 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:12.320+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:12.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:12.589+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:12.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:12.615+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:12.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:12.619+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:12.734 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:12.728+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:12.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:12.758+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:13.014 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:13.009+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:13.253 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:13.248+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:13.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:13.364+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:13.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:13.588+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:13.608 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:13.602+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:13.608 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:13.604+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:13.755 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:13.749+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:13.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:13.799+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:14.020 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:14.014+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:14.292 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:14.286+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:14.399 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:14.393+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:14.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:14.564+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:14.573 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:14.569+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:14.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:41:14.596+0000 1694c700 -1 osd.1 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.334427+0000 front 2019-11-29T16:39:58.267148+0000 (oldest deadline 2019-11-29T16:40:40.446003+0000) 2019-11-29T16:41:14.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:41:14.734+0000 1694c700 -1 osd.5 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.386116+0000 front 2019-11-29T16:39:58.388602+0000 (oldest deadline 2019-11-29T16:40:41.085073+0000) 2019-11-29T16:41:14.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:41:14.828+0000 1694c700 -1 osd.6 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:52.961030+0000 front 2019-11-29T16:39:52.823457+0000 (oldest deadline 2019-11-29T16:40:38.669194+0000) 2019-11-29T16:41:15.029 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:41:15.022+0000 1694c700 -1 osd.3 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.769488+0000 front 2019-11-29T16:39:57.642180+0000 (oldest deadline 2019-11-29T16:40:40.419638+0000) 2019-11-29T16:41:15.295 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:41:15.290+0000 1694c700 -1 osd.2 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:58.639756+0000 front 2019-11-29T16:39:53.275521+0000 (oldest deadline 2019-11-29T16:40:38.563259+0000) 2019-11-29T16:41:15.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:41:15.370+0000 1694c700 -1 osd.7 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:56.635878+0000 front 2019-11-29T16:39:56.741227+0000 (oldest deadline 2019-11-29T16:40:39.359512+0000) 2019-11-29T16:41:15.412 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:41:15.399+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e213 v213) 2019-11-29T16:41:15.591 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:15.587+0000 1694c700 -1 osd.4 213 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:39:57.117703+0000 front 2019-11-29T16:39:56.983154+0000 (oldest deadline 2019-11-29T16:40:39.226829+0000) 2019-11-29T16:41:15.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:15.588+0000 1694c700 -1 osd.4 213 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:16.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:16.627+0000 1694c700 -1 osd.4 214 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104479 2.f 2:f23145d7:::9baad822-b080-4db2-b995-bf7cc78f9da0.4528.649_myobj%2fseg_lowerd:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~23 in=23b,setxattr user.rgw.manifest (358) in=375b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e213) 2019-11-29T16:41:18.826 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:25:26.957 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:18.830 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:25:26.966 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:18.841 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:25:27.024 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:18.843 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:25:27.025 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:18.847 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:25:27.029 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:18.847 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:25:27.029 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:19.070 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:25:27.206 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:19.137 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:25:27.319 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:19.167 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:25:27.349 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:41:40.603 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T16:41:40.736 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T16:41:44.572 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T16:41:45.061 INFO:teuthology.orchestra.run.smithi182.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-29T16:41:47.280 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:47.246+0000 32f86700 -1 osd.4 217 build_incremental_map_msg missing incremental map 217 2019-11-29T16:41:48.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:41:48.869+0000 11cac700 -1 osd.4 218 build_incremental_map_msg missing incremental map 217 2019-11-29T16:42:13.286 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:13.281+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:13.725 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:13.719+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:14.284 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:14.279+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:14.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:14.604+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:14.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:14.685+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:14.698 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:14.688+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:15.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:15.291+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:15.308 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:15.303+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:15.594 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:15.585+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:15.673 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:15.669+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:15.736 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:15.729+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:16.293 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:16.288+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:16.330 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:16.323+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:16.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:16.460+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:16.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:16.625+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:16.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:16.632+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:16.695 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:16.689+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:17.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:17.250+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:17.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:17.346+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:17.474 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:17.469+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:17.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:17.621+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:17.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:17.666+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:17.677 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:17.672+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:18.270 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:18.264+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:18.329 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:18.323+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:18.466 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:18.461+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:18.648 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:18.627+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:18.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:18.665+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:18.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:18.716+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:18.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:18.769+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:19.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:19.273+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:19.378 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:19.373+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:19.466 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:19.463+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:19.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:19.624+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:19.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:19.632+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:19.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:19.734+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:19.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:19.777+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:20.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:20.296+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:20.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:20.341+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:20.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:20.488+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:20.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:20.591+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:20.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:20.634+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:20.705 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:20.701+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:20.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:20.746+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:21.282 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:21.276+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:21.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:21.392+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:21.537 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:21.532+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:21.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:21.577+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:21.622 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:21.617+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:21.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:21.752+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:21.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:21.758+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:22.289 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:22.283+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:22.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:22.409+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:22.508 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:22.504+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:22.608 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:22.603+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:22.628 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:22.624+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:22.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:22.739+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:22.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:22.765+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:23.333 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:23.327+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:23.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:23.461+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:23.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:23.513+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:23.585 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:23.580+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:23.636 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:23.632+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:23.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:23.715+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:23.723 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:23.720+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:24.384 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:24.378+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:24.509 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:24.505+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:24.513 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:24.509+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:24.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:24.600+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:24.651 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:24.646+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:24.719 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:24.715+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:24.728 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:24.722+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:25.428 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:25.423+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:25.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:25.511+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:25.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:25.516+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:25.575 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:25.569+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:25.630 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:25.626+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:25.689 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:25.683+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:25.714 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:25.710+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:25.715 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:25.711+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:26.390 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:26.383+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:26.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:26.476+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:26.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:26.528+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:26.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:26.561+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:26.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:26.671+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:26.742 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:26.737+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:26.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:26.751+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:26.758 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:26.755+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:27.438 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:27.431+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:27.478 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:27.474+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:27.538 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:27.532+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:27.581 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:27.575+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:27.654 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:27.649+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:27.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:27.698+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:27.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:27.768+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:27.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:27.772+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:28.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:28.470+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:28.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:28.489+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:28.560 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:28.554+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:28.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:28.577+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:28.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:28.690+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:28.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:28.721+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:28.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:28.765+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:28.779 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:28.767+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:29.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:29.452+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:29.510 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:29.504+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:29.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:29.548+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:29.556 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:29.551+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:29.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:29.703+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:29.772 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:29.765+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:29.785 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:29.781+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:29.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:29.785+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:30.476 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:30.471+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:30.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:30.512+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:30.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:30.526+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:30.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:30.530+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:30.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:30.734+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:30.771 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:30.766+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:30.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:30.783+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:30.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:30.785+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:31.451 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:31.447+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:31.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:31.488+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:31.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:31.538+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:31.558 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:31.554+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:31.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:31.748+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:31.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:31.756+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:31.762 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:31.760+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:31.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:31.795+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:32.413 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:32.408+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:32.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:32.469+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:32.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:32.498+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:32.581 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:32.576+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:32.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:32.708+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:32.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:32.744+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:32.750 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:32.747+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:32.770 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:32.764+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:33.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:33.386+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:33.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:33.434+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:33.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:33.489+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:33.550 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:33.545+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:33.695 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:33.691+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:33.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:33.725+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:33.782 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:33.777+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:33.782 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:33.779+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:34.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:34.360+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:34.450 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:34.445+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:34.461 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:34.456+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:34.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:34.520+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:34.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:34.672+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:34.696 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:34.690+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:34.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:34.735+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:34.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:34.737+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:35.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:35.396+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:35.434 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:35.427+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:35.441 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:35.436+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:35.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:35.535+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:35.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:35.671+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:35.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:35.673+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:35.716 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:35.711+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:35.716 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:35.713+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:36.376 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:36.372+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:36.398 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:36.392+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:36.485 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:36.479+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:36.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:36.576+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:36.632 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:36.628+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:36.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:36.709+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:36.726 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:36.711+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:36.728 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:36.713+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:37.407 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:37.389+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:37.417 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:37.412+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:37.491 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:37.486+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:37.562 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:37.556+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:37.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:37.644+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:37.751 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:37.745+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:37.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:37.747+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:37.766 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:37.760+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:38.380 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:38.375+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:38.383 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:38.377+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:38.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:38.525+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:38.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:38.530+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:38.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:38.664+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:38.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:38.767+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:38.773 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:38.769+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:38.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:38.781+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:39.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:39.334+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:39.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:39.374+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:39.526 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:39.520+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:39.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:39.562+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:39.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:39.708+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:39.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:39.740+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:39.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:39.803+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:39.810 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:39.807+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:40.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:40.302+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:40.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:40.367+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:40.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:40.515+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:40.623 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:40.618+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:40.745 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:40.739+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:40.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:40.784+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:40.843 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:40.836+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:40.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:40.849+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:41.322 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:41.317+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:41.415 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:41.410+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:41.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:41.561+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:41.676 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:41.670+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:41.774 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:41.768+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:41.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:41.815+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:41.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:41.839+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:41.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:41.841+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:42.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:42.272+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:42.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:42.274+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:42.468 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:42.462+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:42.614 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:42.608+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:42.719 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:42.714+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:42.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:42.730+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:42.820 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:42.814+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:42.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:42.887+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:42.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:42.890+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:43.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:43.326+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:43.333 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:43.328+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:43.454 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:43.449+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:43.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:43.604+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:43.681 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:43.675+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:43.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:43.736+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:43.831 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:43.826+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:43.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:43.921+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:43.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:43.923+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:44.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:44.352+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:44.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:44.354+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:44.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:44.484+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:44.567 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:44.563+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:44.681 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:44.675+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:44.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:44.759+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:44.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:44.810+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:44.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:44.875+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:44.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:44.876+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:45.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:45.363+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:45.370 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:45.366+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:45.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:45.519+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:45.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:45.521+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:45.641 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:45.633+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:45.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:45.805+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:45.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:45.860+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:45.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:45.898+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:45.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:45.899+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:46.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:46.391+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:46.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:46.394+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:46.562 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:46.550+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:46.573 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:46.567+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:46.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:46.619+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:46.821 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:46.816+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:46.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:46.864+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:46.931 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:46.926+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:46.932 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:46.928+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:47.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:47.409+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:47.414 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:47.411+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:47.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:47.549+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:47.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:47.564+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:47.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:47.637+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:47.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:47.784+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:47.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:47.844+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:47.942 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:47.938+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:47.945 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:47.942+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:48.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:48.407+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:48.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:48.409+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:48.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:48.582+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:48.602 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:48.595+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:48.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:48.623+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:48.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:48.764+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:48.813 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:48.806+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:48.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:48.980+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:48.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:48.982+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:49.411 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:49.406+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:49.411 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:49.408+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:49.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:49.560+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:49.606 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:49.599+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:49.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:49.668+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:49.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:49.798+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:49.855 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:49.848+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:50.035 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:50.031+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:50.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:50.032+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:50.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:50.444+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:50.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:50.446+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:50.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:50.541+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:50.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:50.570+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:50.631 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:50.625+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:50.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:50.760+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:50.836 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:42:50.828+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e219 v219) 2019-11-29T16:42:50.873 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:50.867+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:51.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:50.999+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:51.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:51.002+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:51.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:51.489+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:51.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:51.490+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:51.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:51.503+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:51.568 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:51.562+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:51.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:51.677+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:51.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:51.758+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:51.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:51.923+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:51.980 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:51.976+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:51.980 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:51.977+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:52.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:52.492+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:52.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:52.496+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:52.503 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:52.499+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:52.562 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:52.556+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:52.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:52.719+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:52.804 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:52.800+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:52.903 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:52.896+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:52.973 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:52.968+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:52.975 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:52.970+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:53.489 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:53.484+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:53.489 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:53.486+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:53.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:53.499+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:53.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:53.568+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:53.753 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:53.747+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:53.816 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:53.812+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:53.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:53.871+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:54.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:53.998+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:54.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:54.000+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:54.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:54.492+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:54.498 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:54.494+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:54.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:54.502+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:54.604 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:54.598+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:54.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:54.713+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:54.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:54.795+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:54.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:54.884+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:55.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:55.015+0000 1694c700 -1 osd.0 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:41:45.011727+0000 (oldest deadline 2019-11-29T16:42:25.011727+0000) 2019-11-29T16:42:55.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:55.018+0000 1694c700 -1 osd.0 219 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:55.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:55.457+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:55.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:55.462+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:55.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:42:55.461+0000 1694c700 -1 osd.7 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.849511+0000 front 2019-11-29T16:41:30.821705+0000 (oldest deadline 2019-11-29T16:42:14.265612+0000) 2019-11-29T16:42:55.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:42:55.652+0000 1694c700 -1 osd.4 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:30.073981+0000 front 2019-11-29T16:41:29.605600+0000 (oldest deadline 2019-11-29T16:42:14.703556+0000) 2019-11-29T16:42:55.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:42:55.760+0000 1694c700 -1 osd.6 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:29.152490+0000 front 2019-11-29T16:41:29.175509+0000 (oldest deadline 2019-11-29T16:42:13.234239+0000) 2019-11-29T16:42:55.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:42:55.849+0000 1694c700 -1 osd.1 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.250786+0000 front 2019-11-29T16:41:28.224548+0000 (oldest deadline 2019-11-29T16:42:14.056278+0000) 2019-11-29T16:42:55.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:42:55.864+0000 1694c700 -1 osd.5 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:28.391331+0000 front 2019-11-29T16:41:28.389536+0000 (oldest deadline 2019-11-29T16:42:13.056185+0000) 2019-11-29T16:42:55.919 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:42:55.905+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e219 v219) 2019-11-29T16:42:56.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:42:56.056+0000 1694c700 -1 osd.0 220 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e217) 2019-11-29T16:42:56.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:56.457+0000 1694c700 -1 osd.2 219 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:41:31.846566+0000 front 2019-11-29T16:41:31.756149+0000 (oldest deadline 2019-11-29T16:42:15.914355+0000) 2019-11-29T16:42:56.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:56.458+0000 1694c700 -1 osd.2 219 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:42:57.544 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:42:57.481+0000 1694c700 -1 osd.2 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:104858 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e219) 2019-11-29T16:43:11.298 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:27:19.434 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.307 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:27:19.443 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.312 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:27:19.494 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.329 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:27:19.511 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.336 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:27:19.518 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.350 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:27:19.532 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.451 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:27:19.581 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.477 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:27:19.659 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:43:11.491 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:27:19.674 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:26.247 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:26.239+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:26.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:26.320+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:27.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:27.247+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:27.367 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:27.361+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:27.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:27.629+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:28.247 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:28.240+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:28.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:28.352+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:28.660 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:28.647+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:29.168 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:29.163+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:29.272 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:29.267+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:29.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:29.370+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:29.667 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:29.660+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:30.146 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:30.141+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:30.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:30.312+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:30.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:30.356+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:30.652 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:30.645+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:31.150 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:31.143+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:31.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:31.214+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:31.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:31.275+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:31.349 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:31.345+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:31.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:31.504+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:31.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:31.678+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:32.122 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:32.117+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:32.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:32.253+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:32.268 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:32.263+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:32.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:32.386+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:32.483 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:32.477+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:32.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:32.658+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:33.138 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:33.133+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:33.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:33.225+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:33.310 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:33.303+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:33.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:33.419+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:33.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:33.445+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:33.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:33.667+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:34.129 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:34.122+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:34.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:34.183+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:34.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:34.279+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:34.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:34.404+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:34.464 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:34.459+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:34.632 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:34.625+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:35.089 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:35.083+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:35.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:35.140+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:35.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:35.210+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:35.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:35.273+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:35.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:35.408+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:35.442 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:35.437+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:35.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:35.679+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:36.105 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:36.100+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:36.136 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:36.131+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:36.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:36.197+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:36.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:36.291+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:36.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:36.435+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:36.468 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:36.463+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:36.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:36.648+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:36.770 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:28:44.906 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.778 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:28:44.914 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.845 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:28:45.028 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.861 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:28:45.043 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.867 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:28:45.049 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.872 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:28:45.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.907 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:28:45.043 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.988 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:28:45.171 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:36.995 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:28:45.178 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:44:37.084 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:37.079+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:37.169 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:37.165+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:37.181 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:37.177+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:37.286 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:37.281+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:37.463 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:37.459+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:37.474 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:37.469+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:37.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:37.681+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:38.106 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:38.100+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:38.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:38.132+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:38.207 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:38.202+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:38.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:38.296+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:38.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:38.501+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:38.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:38.517+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:38.706 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:38.700+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:39.140 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:39.133+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:39.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:39.173+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:39.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:39.214+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:39.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:39.296+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:39.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:39.504+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:39.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:39.516+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:39.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:39.678+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:40.173 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:40.169+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:40.197 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:40.192+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:40.216 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:40.210+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:40.295 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:40.289+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:40.465 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:40.461+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:40.531 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:40.526+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:40.688 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:40.682+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:41.163 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:41.158+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:41.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:41.201+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:41.208 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:41.204+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:41.290 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:41.284+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:41.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:41.495+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:41.502 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:41.498+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:41.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:41.669+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:42.183 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:42.179+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:42.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:42.242+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:42.248 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:42.242+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:42.322 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:42.316+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:42.460 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:42.454+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:42.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:42.542+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:42.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:42.687+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:43.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:43.195+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:43.209 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:43.205+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:43.269 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:43.265+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:43.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:43.297+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:43.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:43.434+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:43.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:43.520+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:43.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:43.679+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:44.173 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:44.168+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:44.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:44.219+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:44.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:44.276+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:44.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:44.278+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:44.460 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:44.454+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:44.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:44.552+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:44.736 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:44.730+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:45.149 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:45.145+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:45.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:45.246+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:45.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:45.269+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:45.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:45.278+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:45.463 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:45.456+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:45.584 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:45.580+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:45.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:45.723+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:46.185 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:46.180+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:46.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:46.241+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:46.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:46.281+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:46.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:46.317+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:46.463 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:46.457+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:46.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:46.612+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:46.743 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:46.737+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:47.231 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:47.227+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:47.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:47.235+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:47.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:47.298+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:47.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:47.319+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:47.458 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:47.452+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:47.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:47.589+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:47.711 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:47.705+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:48.229 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:48.222+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:48.233 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:48.227+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:48.292 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:48.287+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:48.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:48.352+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:48.455 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:48.449+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:48.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:48.544+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:48.744 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:48.738+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:49.191 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:49.187+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:49.236 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:49.231+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:49.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:49.333+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:49.343 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:49.338+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:49.489 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:49.483+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:49.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:49.528+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:49.743 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:49.734+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:50.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:50.196+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:50.225 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:50.219+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:50.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:50.334+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:50.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:50.359+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:50.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:50.484+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:50.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:50.537+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:50.742 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:50.736+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:51.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:51.185+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:51.241 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:51.235+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:51.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:51.335+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:51.343 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:51.339+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:51.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:51.472+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:51.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:51.545+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:51.792 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:51.786+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:52.215 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:52.211+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:52.236 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:52.230+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:52.313 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:52.307+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:52.376 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:52.370+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:52.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:52.523+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:52.582 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:52.576+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:52.816 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:52.811+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:53.224 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:53.219+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:53.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:53.234+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:53.326 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:53.321+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:53.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:53.323+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:53.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:53.546+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:53.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:53.562+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:53.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:53.855+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:54.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:54.260+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:54.267 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:54.261+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:54.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:54.335+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:54.361 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:54.355+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:54.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:54.557+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:54.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:54.566+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:54.870 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:54.864+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:55.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:55.229+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:55.272 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:55.268+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:55.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:55.359+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:55.383 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:55.377+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:55.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:55.598+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:55.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:55.600+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:55.909 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:55.902+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:56.266 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:56.260+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:56.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:56.271+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:56.341 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:56.337+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:56.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:56.351+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:56.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:56.564+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:56.618 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:56.612+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:56.905 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:56.899+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:57.261 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:57.255+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:57.287 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:57.281+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:57.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:57.383+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:57.408 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:57.402+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:57.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:57.568+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:57.592 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:57.586+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:57.890 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:57.884+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:58.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:58.211+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:58.323 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:58.317+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:58.372 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:58.367+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:58.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:58.397+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:58.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:58.538+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:58.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:58.605+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:58.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:58.901+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:44:59.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:44:59.264+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:44:59.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:44:59.329+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:44:59.350 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:44:59.345+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:44:59.382 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:44:59.376+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:44:59.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:44:59.524+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:44:59.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:44:59.619+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:44:59.910 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:44:59.903+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:45:00.324 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:45:00.313+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:45:00.346 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:45:00.341+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:45:00.380 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:45:00.376+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:45:00.415 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:45:00.408+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:45:00.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:45:00.519+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:45:00.656 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:45:00.649+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:45:00.954 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:45:00.948+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:45:01.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:45:01.287+0000 1694c700 -1 osd.5 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:42.713273+0000 front 2019-11-29T16:43:42.640879+0000 (oldest deadline 2019-11-29T16:44:26.027279+0000) 2019-11-29T16:45:01.349 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:45:01.343+0000 1694c700 -1 osd.2 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:44.170844+0000 front 2019-11-29T16:43:44.238024+0000 (oldest deadline 2019-11-29T16:44:35.005501+0000) 2019-11-29T16:45:01.352 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:45:01.348+0000 1694c700 -1 osd.3 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.060772+0000 front 2019-11-29T16:43:45.058880+0000 (oldest deadline 2019-11-29T16:44:28.606617+0000) 2019-11-29T16:45:01.409 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:45:01.404+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:45:01.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:45:01.514+0000 1694c700 -1 osd.1 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.825352+0000 front 2019-11-29T16:43:41.310265+0000 (oldest deadline 2019-11-29T16:44:25.742102+0000) 2019-11-29T16:45:01.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:45:01.672+0000 1694c700 -1 osd.6 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.611287+0000 front 2019-11-29T16:43:45.362258+0000 (oldest deadline 2019-11-29T16:44:30.616478+0000) 2019-11-29T16:45:01.846 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:45:01.839+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e225 v225) 2019-11-29T16:45:01.943 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:45:01.927+0000 1694c700 -1 osd.7 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.998254+0000 front 2019-11-29T16:43:45.598954+0000 (oldest deadline 2019-11-29T16:44:26.996905+0000) 2019-11-29T16:45:02.390 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:45:02.382+0000 1694c700 -1 osd.4 225 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:43:45.139772+0000 front 2019-11-29T16:43:45.177550+0000 (oldest deadline 2019-11-29T16:44:31.004933+0000) 2019-11-29T16:45:09.308 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:29:17.444 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.314 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:29:17.450 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.324 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:29:17.507 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.331 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:29:17.514 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.370 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:29:17.552 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.378 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:29:17.559 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.383 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:29:17.517 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.390 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:29:17.573 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:09.452 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:29:17.634 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:45:33.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:45:33.188+0000 37f90700 -1 osd.1 229 build_incremental_map_msg missing incremental map 229 2019-11-29T16:46:00.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:00.452+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:00.896 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:00.892+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:01.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:01.004+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:01.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:01.505+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:01.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:01.911+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:02.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:02.013+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:02.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:02.034+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:02.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:02.082+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:02.563 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:02.559+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:02.935 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:02.930+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:03.006 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:03.000+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:03.085 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:03.058+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:03.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:03.061+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:03.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:03.135+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:03.584 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:03.580+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:03.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:03.937+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:04.012 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:04.006+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:04.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:04.075+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:04.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:04.082+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:04.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:04.093+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:04.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:04.600+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:04.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:04.983+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:04.995 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:04.983+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:05.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:05.062+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:05.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:05.083+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:05.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:05.108+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:05.639 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:05.634+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:05.950 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:05.945+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:06.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:06.034+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:06.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:06.062+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:06.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:06.063+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:06.138 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:06.133+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:06.632 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:06.627+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:06.926 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:06.921+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:07.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:07.002+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:07.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:07.057+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:07.080 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:07.075+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:07.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:07.126+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:07.407 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:07.403+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:07.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:07.599+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:07.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:07.951+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:08.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:08.015+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:08.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:08.037+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:08.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:08.037+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:08.148 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:08.143+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:08.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:08.449+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:08.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:08.598+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:08.947 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:08.941+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:08.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:08.993+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:09.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:08.999+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:09.005 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:09.000+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:09.197 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:09.191+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:09.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:09.424+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:09.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:09.592+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:09.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:09.971+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:10.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:09.994+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:10.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:10.029+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:10.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:10.048+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:10.227 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:10.221+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:10.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:10.412+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:10.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:10.644+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:11.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:11.002+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:11.018 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:11.008+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:11.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:11.024+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:11.041 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:11.035+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:11.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:11.254+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:11.387 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:11.384+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:11.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:11.386+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:11.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:11.686+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:11.973 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:11.967+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:11.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:11.969+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:12.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:12.014+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:12.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:12.027+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:12.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:12.218+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:12.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:12.341+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:12.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:12.343+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:12.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:12.668+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:12.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:12.969+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:12.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:12.977+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:13.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:12.994+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:13.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:13.015+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:13.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:13.235+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:13.393 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:13.388+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:13.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:13.389+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:13.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:13.685+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:13.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:13.958+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:13.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:13.976+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:14.008 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:14.000+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:14.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:14.040+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:14.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:14.199+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:14.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:14.391+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:14.397 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:14.394+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:14.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:14.648+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:14.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:14.943+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:14.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:14.994+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:14.999 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:14.993+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:15.035 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:15.026+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:15.197 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:15.193+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:15.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:15.350+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:15.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:15.352+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:15.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:15.647+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:15.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:15.963+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:15.987 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:15.981+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:15.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:15.988+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:16.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:16.042+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:16.175 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:16.169+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:16.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:16.401+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:16.407 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:16.403+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:16.662 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:16.657+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:16.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:16.949+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:16.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:16.955+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:16.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:16.983+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:17.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:17.033+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:17.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:17.127+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:17.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:17.441+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:17.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:17.442+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:17.630 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:17.624+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:17.968 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:17.962+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:17.991 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:17.985+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:17.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:17.987+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:18.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:18.050+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:18.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:18.104+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:18.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:18.415+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:18.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:18.416+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:18.668 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:18.662+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:18.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:18.969+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:18.995 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:18.989+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:19.002 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:18.997+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:19.052 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:19.047+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:19.164 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:19.159+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:19.451 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:19.445+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:19.451 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:19.446+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:19.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:19.661+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:19.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:19.959+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:20.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:19.995+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:20.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:20.007+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:20.051 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:20.045+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:20.131 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:20.123+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:20.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:20.429+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:20.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:20.431+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:20.685 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:20.680+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:20.939 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:20.934+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:20.984 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:20.978+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:21.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:21.030+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:21.053 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:21.047+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:21.089 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:21.083+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:21.440 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:21.435+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:21.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:21.437+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:21.704 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:21.700+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:21.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:21.903+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:21.961 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:21.956+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:22.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:22.028+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:22.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:22.059+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:22.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:22.098+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:22.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:22.401+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:22.407 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:22.404+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:22.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:22.677+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:22.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:22.909+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:22.970 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:22.964+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:23.025 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:23.019+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:23.040 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:23.034+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:23.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:23.081+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:23.423 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:23.418+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:23.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:23.422+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:23.686 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:23.682+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:23.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:23.944+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:23.992 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:23.986+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:24.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:24.010+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:24.048 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:24.044+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:24.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:24.062+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:24.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:24.436+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:24.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:24.438+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:24.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:24.667+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:24.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:24.960+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:24.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:24.978+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:25.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:25.001+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:25.023 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:25.017+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:25.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:25.083+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:25.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:25.464+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:25.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:25.465+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:25.628 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:25.623+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:25.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:25.956+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:25.998 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:25.986+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:26.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:26.000+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:26.044 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:26.036+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:26.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:26.085+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:26.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:26.454+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:26.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:26.456+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:26.682 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:26.677+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:26.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:26.965+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:26.999 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:26.993+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:27.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:27.030+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:27.051 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:27.045+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:27.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:27.095+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:27.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:27.423+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:27.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:27.424+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:27.680 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:27.675+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:27.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:27.935+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:28.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:28.032+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:28.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:28.039+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:28.079 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:28.074+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:28.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:28.151+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:28.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:28.425+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:28.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:28.430+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:28.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:28.654+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:28.972 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:28.966+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:29.028 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:29.022+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:29.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:29.048+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:29.089 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:29.084+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:29.131 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:29.125+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:29.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:29.428+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:29.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:29.430+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:29.616 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:29.610+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:30.012 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:30.006+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:30.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:30.038+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:30.079 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:30.074+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:30.097 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:30.091+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:30.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:30.177+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:30.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:30.433+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:30.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:30.434+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:30.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:30.623+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:31.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:31.055+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:31.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:31.056+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:31.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:31.062+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:31.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:31.106+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:31.212 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:31.206+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:31.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:31.410+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:31.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:31.411+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:31.679 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:31.674+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:32.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:32.033+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:32.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:32.062+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:32.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:32.076+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:32.127 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:32.121+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:32.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:32.173+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:32.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:32.369+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:32.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:32.372+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:32.665 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:32.660+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:33.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:33.018+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:33.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:33.061+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:33.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:33.077+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:33.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:33.135+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:33.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:33.140+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:33.369 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:33.364+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:33.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:33.368+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:33.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:33.634+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:34.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:34.046+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:34.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:34.048+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:34.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:34.058+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:34.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:34.112+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:34.138 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:34.131+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:34.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:34.324+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:34.332 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:34.328+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:34.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:34.631+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:35.014 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:35.007+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:35.022 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:35.015+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:35.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:35.103+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:35.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:35.143+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:35.173 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:35.166+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:35.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:35.359+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:35.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:35.362+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:35.680 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:35.675+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:36.004 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:35.998+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:36.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:36.060+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:36.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:36.140+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:36.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:36.149+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:36.174 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:36.168+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:36.339 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:36.333+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:36.339 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:36.335+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:36.727 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:36.724+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:37.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:37.038+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:37.090 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:37.083+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:37.130 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:37.126+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:37.133 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:37.126+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:37.153 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:37.145+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:37.238 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:46:37.231+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e231 v231) 2019-11-29T16:46:37.352 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:37.347+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:37.352 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:37.349+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:37.718 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:37.714+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:38.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:38.034+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:38.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:38.070+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:38.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:38.153+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:38.160 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:38.154+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:38.162 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:38.158+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:38.385 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:38.381+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:38.386 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:38.384+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:38.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:38.671+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:39.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:39.083+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:39.110 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:39.103+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:39.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:39.130+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:39.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:39.135+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:39.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:39.155+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:39.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:39.348+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:39.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:39.349+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:39.718 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:39.712+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:40.059 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:40.052+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:40.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:40.085+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:40.103 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:40.099+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:40.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:40.158+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:40.171 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:40.165+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:40.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:40.362+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:40.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:40.364+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:40.762 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:40.758+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:41.023 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:41.017+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:41.073 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:41.069+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:41.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:41.101+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:41.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:41.156+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:41.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:41.203+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:41.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:41.391+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:41.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:41.393+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:41.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:41.730+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:46:42.025 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:46:42.019+0000 1694c700 -1 osd.7 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.969138+0000 front 2019-11-29T16:45:19.050249+0000 (oldest deadline 2019-11-29T16:46:01.847210+0000) 2019-11-29T16:46:42.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:46:42.065+0000 1694c700 -1 osd.1 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:17.415185+0000 front 2019-11-29T16:45:17.500003+0000 (oldest deadline 2019-11-29T16:46:00.239721+0000) 2019-11-29T16:46:42.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:46:42.144+0000 1694c700 -1 osd.5 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:14.970054+0000 front 2019-11-29T16:45:15.134035+0000 (oldest deadline 2019-11-29T16:46:00.180675+0000) 2019-11-29T16:46:42.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:46:42.162+0000 1694c700 -1 osd.4 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:18.991527+0000 front 2019-11-29T16:45:18.986928+0000 (oldest deadline 2019-11-29T16:46:01.084938+0000) 2019-11-29T16:46:42.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:46:42.230+0000 1694c700 -1 osd.6 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.995059+0000 front 2019-11-29T16:45:16.709371+0000 (oldest deadline 2019-11-29T16:46:02.560439+0000) 2019-11-29T16:46:42.312 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:46:42.308+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e231 v231) 2019-11-29T16:46:42.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:42.345+0000 1694c700 -1 osd.0 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:45:31.209168+0000 (oldest deadline 2019-11-29T16:46:11.209168+0000) 2019-11-29T16:46:42.351 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:46:42.348+0000 1694c700 -1 osd.0 231 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e229) 2019-11-29T16:46:42.780 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:46:42.776+0000 1694c700 -1 osd.2 231 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:45:16.315856+0000 front 2019-11-29T16:45:16.740148+0000 (oldest deadline 2019-11-29T16:46:00.329714+0000) 2019-11-29T16:47:19.454 INFO:teuthology.orchestra.run.smithi182.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-11-29T16:47:19.487 INFO:teuthology.orchestra.run.smithi182.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-11-29T16:48:14.683 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:14.673+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:14.722 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:14.718+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:15.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:15.374+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:15.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:15.698+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:15.715 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:15.710+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:15.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:15.779+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:16.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:16.424+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:16.704 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:16.699+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:16.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:16.724+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:16.802 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:16.796+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:17.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:17.384+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:17.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:17.717+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:17.736 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:17.729+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:17.749 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:17.742+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:17.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:17.756+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:18.435 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:18.428+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:18.439 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:18.434+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:18.716 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:18.711+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:18.741 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:18.735+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:18.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:18.758+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:18.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:18.779+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:19.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:19.413+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:19.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:19.425+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:19.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:19.542+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:19.720 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:19.714+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:19.758 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:19.752+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:19.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:19.769+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:19.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:19.795+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:20.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:20.385+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:20.446 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:20.441+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:20.562 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:20.557+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:20.720 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:20.714+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:20.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:20.782+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:20.805 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:20.802+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:20.822 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:20.818+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:21.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:21.415+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:21.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:21.445+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:21.608 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:21.600+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:21.730 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:21.723+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:21.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:21.793+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:21.810 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:21.805+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:21.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:21.835+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:22.424 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:22.416+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:22.454 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:22.449+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:22.652 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:22.646+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:22.726 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:22.719+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:22.757 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:22.754+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:22.824 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:22.819+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:22.842 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:22.836+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:23.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:23.410+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:23.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:23.416+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:23.662 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:23.656+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:23.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:23.698+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:23.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:23.742+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:23.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:23.835+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:23.869 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:23.865+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:24.441 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:24.435+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:24.463 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:24.458+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:24.622 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:24.616+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:24.751 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:24.747+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:24.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:24.751+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:24.810 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:24.804+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:24.843 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:24.838+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:25.398 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:25.391+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:25.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:25.437+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:25.602 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:25.596+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:25.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:25.712+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:25.759 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:25.753+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:25.838 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:25.832+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:25.851 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:25.846+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:26.407 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:26.400+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:26.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:26.453+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:26.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:26.637+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:26.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:26.756+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:26.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:26.784+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:26.822 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:26.818+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:26.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:26.857+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:27.398 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:27.391+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:27.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:27.492+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:27.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:27.687+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:27.748 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:27.743+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:27.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:27.759+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:27.825 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:27.816+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:27.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:27.865+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:28.402 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:28.395+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:28.550 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:28.543+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:28.657 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:28.651+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:28.730 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:28.723+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:28.759 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:28.754+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:28.819 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:28.815+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:28.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:28.908+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:29.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:29.402+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:29.596 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:29.590+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:29.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:29.678+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:29.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:29.700+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:29.714 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:29.709+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:29.841 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:29.835+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:29.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:29.901+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:30.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:30.436+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:30.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:30.574+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:30.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:30.680+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:30.718 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:30.712+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:30.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:30.736+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:30.877 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:30.870+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:30.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:30.938+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:31.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:31.399+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:31.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:31.538+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:31.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:31.686+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:31.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:31.705+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:31.740 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:31.734+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:31.862 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:31.855+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:31.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:31.901+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:32.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:32.450+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:32.518 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:32.514+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:32.675 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:32.669+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:32.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:32.690+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:32.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:32.782+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:32.831 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:32.828+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:32.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:32.930+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:33.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:33.484+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:33.495 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:33.489+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:33.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:33.690+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:33.730 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:33.725+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:33.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:33.794+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:33.883 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:33.879+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:33.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:33.977+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:34.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:34.444+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:34.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:34.457+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:34.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:34.667+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:34.701 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:34.695+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:34.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:34.750+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:34.856 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:34.850+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:35.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:35.002+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:35.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:35.457+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:35.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:35.499+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:35.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:35.633+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:35.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:35.717+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:35.734 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:35.728+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:35.832 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:35.827+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:36.002 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:35.996+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:36.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:36.423+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:36.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:36.542+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:36.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:36.677+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:36.711 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:36.705+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:36.754 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:36.746+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:36.755 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:36.750+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:36.881 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:36.876+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:36.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:36.956+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:37.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:37.465+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:37.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:37.522+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:37.700 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:37.695+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:37.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:37.718+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:37.727 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:37.723+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:37.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:37.730+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:37.856 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:37.853+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:37.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:37.922+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:38.445 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:38.440+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:38.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:38.543+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:38.684 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:38.675+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:38.722 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:38.716+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:38.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:38.769+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:38.777 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:38.772+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:38.871 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:38.866+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:38.908 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:38.902+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:39.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:39.426+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:39.534 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:39.529+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:39.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:39.639+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:39.689 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:39.685+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:39.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:39.755+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:39.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:39.758+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:39.855 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:39.851+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:39.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:39.936+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:40.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:40.391+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:40.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:40.513+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:40.647 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:40.641+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:40.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:40.672+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:40.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:40.795+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:40.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:40.798+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:40.847 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:40.841+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:40.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:40.928+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:41.375 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:41.369+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:41.509 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:41.503+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:41.635 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:41.627+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:41.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:41.667+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:41.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:41.842+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:41.851 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:41.847+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:41.889 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:41.884+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:41.980 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:41.974+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:42.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:42.384+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:42.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:42.537+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:42.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:42.594+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:42.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:42.706+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:42.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:42.838+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:42.846 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:42.841+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:42.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:42.925+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:42.999 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:42.993+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:43.367 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:43.362+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:43.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:43.500+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:43.615 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:43.608+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:43.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:43.714+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:43.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:43.861+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:43.867 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:43.863+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:43.970 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:43.951+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:43.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:43.964+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:44.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:44.328+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:44.506 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:44.500+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:44.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:44.628+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:44.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:44.761+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:44.913 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:44.907+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:44.914 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:44.909+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:44.951 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:44.947+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:44.972 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:44.966+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:45.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:45.376+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:45.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:45.465+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:45.596 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:45.589+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:45.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:45.729+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:45.928 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:45.921+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:45.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:45.944+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:45.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:45.946+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:45.967 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:45.961+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:46.375 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:46.369+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:46.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:46.424+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:46.588 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:46.581+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:46.720 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:46.715+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:46.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:46.910+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:46.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:46.923+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:46.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:46.927+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:46.939 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:46.934+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:47.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:47.358+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:47.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:47.456+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:47.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:47.578+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:47.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:47.695+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:47.722 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:48:47.716+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e236 v236) 2019-11-29T16:48:47.899 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:47.880+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:47.948 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:47.944+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:47.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:47.959+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:47.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:47.961+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:48.325 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:48.320+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:48.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:48.497+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:48.569 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:48.562+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:48.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:48.699+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:48.875 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:48.867+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:48.919 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:48.912+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:48.922 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:48.917+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:48.956 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:48.950+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:49.330 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:49.325+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:49.510 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:49.504+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:49.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:49.545+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:49.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:49.702+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:49.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:49.906+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:49.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:49.922+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:49.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:49.926+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:49.977 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:49.973+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:50.284 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:50.280+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:50.539 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:50.532+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:50.546 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:50.539+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:50.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:50.745+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:50.920 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:50.912+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:50.935 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:50.932+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:50.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:50.974+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:50.984 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:50.979+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:51.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:51.322+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:51.546 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:51.540+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:51.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:51.575+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:51.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:48:51.703+0000 1694c700 -1 osd.1 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.572567+0000 front 2019-11-29T16:47:30.561085+0000 (oldest deadline 2019-11-29T16:48:14.022498+0000) 2019-11-29T16:48:51.914 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:51.910+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:51.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:51.907+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:51.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:51.975+0000 1694c700 -1 osd.6 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.886823+0000 front 2019-11-29T16:47:33.905551+0000 (oldest deadline 2019-11-29T16:48:19.480752+0000) 2019-11-29T16:48:51.983 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:51.977+0000 1694c700 -1 osd.6 236 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:52.329 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:48:52.325+0000 1694c700 -1 osd.2 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:30.694889+0000 front 2019-11-29T16:47:30.709559+0000 (oldest deadline 2019-11-29T16:48:14.772022+0000) 2019-11-29T16:48:52.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:48:52.545+0000 1694c700 -1 osd.7 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:32.806788+0000 front 2019-11-29T16:47:32.400628+0000 (oldest deadline 2019-11-29T16:48:17.654691+0000) 2019-11-29T16:48:52.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:48:52.624+0000 1694c700 -1 osd.4 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:33.071336+0000 front 2019-11-29T16:47:33.276232+0000 (oldest deadline 2019-11-29T16:48:15.235228+0000) 2019-11-29T16:48:52.821 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:48:52.798+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e236 v236) 2019-11-29T16:48:52.918 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:48:52.911+0000 1694c700 -1 osd.3 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:28.433351+0000 front 2019-11-29T16:47:28.413599+0000 (oldest deadline 2019-11-29T16:48:14.240367+0000) 2019-11-29T16:48:52.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:48:52.947+0000 1694c700 -1 osd.5 236 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:47:31.202735+0000 front 2019-11-29T16:47:31.259287+0000 (oldest deadline 2019-11-29T16:48:17.104084+0000) 2019-11-29T16:48:53.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:53.028+0000 1694c700 -1 osd.6 237 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:48:54.018 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:48:54.012+0000 1694c700 -1 osd.6 237 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80809 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e236) 2019-11-29T16:49:07.530 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:33:15.666 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.538 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:33:15.674 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.543 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:33:15.726 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.548 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:33:15.730 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.549 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:33:15.732 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.551 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:33:15.733 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.836 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:33:16.018 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.841 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:33:15.977 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:07.857 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:33:16.039 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:49:50.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:50.552+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:50.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:50.585+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:51.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:51.207+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:51.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:51.463+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:51.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:51.602+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:51.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:51.613+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:51.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:51.811+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:52.193 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:52.183+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:52.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:52.459+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:52.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:52.547+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:52.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:52.635+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:52.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:52.654+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:52.853 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:52.845+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:52.976 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:52.969+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:53.165 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:53.162+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:53.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:53.459+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:53.605 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:53.599+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:53.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:53.602+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:53.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:53.698+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:53.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:53.883+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:54.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:54.003+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:54.202 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:54.198+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:54.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:54.439+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:54.563 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:54.557+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:54.599 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:54.594+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:54.747 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:54.743+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:54.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:54.854+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:55.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:55.046+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:55.191 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:55.187+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:55.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:55.443+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:55.587 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:55.582+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:55.614 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:55.609+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:55.772 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:55.768+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:55.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:55.876+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:56.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:56.056+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:56.206 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:56.202+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:56.437 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:56.431+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:56.554 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:56.548+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:56.658 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:56.651+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:56.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:56.727+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:56.869 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:56.864+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:57.019 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:57.013+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:57.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:57.243+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:57.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:57.472+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:57.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:57.575+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:57.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:57.611+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:57.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:57.746+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:57.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:57.828+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:58.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:58.003+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:58.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:58.283+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:49:58.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:58.287+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:58.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:58.435+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:58.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:58.612+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:58.658 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:58.652+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:58.801 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:58.796+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:58.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:58.818+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:49:59.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:59.029+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:49:59.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:59.287+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:49:59.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:49:59.288+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:49:59.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:49:59.396+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:49:59.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:49:59.633+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:49:59.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:49:59.633+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:49:59.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:49:59.817+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:49:59.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:49:59.825+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:00.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:49:59.995+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:00.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:00.324+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:00.330 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:00.326+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:00.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:00.402+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:00.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:00.617+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:00.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:00.644+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:00.802 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:00.797+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:00.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:00.802+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:01.043 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:01.037+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:01.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:01.280+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:01.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:01.282+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:01.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:01.396+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:01.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:01.592+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:01.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:01.641+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:01.764 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:01.759+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:01.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:01.789+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:02.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:02.059+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:02.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:02.294+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:02.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:02.298+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:02.425 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:02.412+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:02.617 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:02.610+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:02.673 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:02.667+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:02.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:02.740+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:02.846 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:02.841+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:03.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:03.074+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:03.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:03.258+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:03.264 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:03.260+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:03.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:03.430+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:03.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:03.612+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:03.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:03.708+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:03.752 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:03.748+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:03.864 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:03.859+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:04.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:04.040+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:04.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:04.311+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:04.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:04.314+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:04.475 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:04.469+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:04.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:04.651+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:04.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:04.686+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:04.734 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:04.729+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:04.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:04.827+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:05.058 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:05.050+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:05.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:05.348+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:05.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:05.351+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:05.433 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:05.427+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:05.643 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:05.638+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:05.703 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:05.692+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:05.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:05.751+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:05.810 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:05.804+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:06.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:06.055+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:06.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:06.327+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:06.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:06.329+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:06.416 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:06.409+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:06.659 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:06.653+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:06.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:06.666+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:06.722 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:06.717+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:06.836 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:06.830+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:07.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:07.025+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:07.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:07.348+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:07.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:07.351+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:07.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:07.445+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:07.669 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:07.663+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:07.710 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:07.704+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:07.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:07.769+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:07.836 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:07.831+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:08.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:08.060+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:08.325 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:08.315+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:08.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:08.317+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:08.429 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:08.424+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:08.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:08.686+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:08.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:08.710+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:08.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:08.810+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:08.856 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:08.852+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:09.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:09.058+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:09.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:09.288+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:09.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:09.289+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:09.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:09.453+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:09.743 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:09.737+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:09.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:09.760+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:09.782 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:09.775+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:09.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:09.902+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:10.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:10.059+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:10.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:10.325+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:10.332 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:10.329+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:10.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:10.466+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:10.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:10.750+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:10.772 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:10.768+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:10.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:10.812+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:10.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:10.943+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:11.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:11.096+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:11.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:11.327+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:11.332 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:11.329+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:11.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:11.451+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:11.719 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:11.712+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:11.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:11.773+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:11.810 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:11.805+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:11.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:11.985+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:12.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:12.104+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:12.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:12.347+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:12.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:12.350+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:12.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:12.484+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:12.733 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:12.730+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:12.736 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:12.731+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:12.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:12.820+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:13.008 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:13.001+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:13.124 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:13.118+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:13.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:13.337+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:13.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:13.339+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:13.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:13.474+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:13.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:13.716+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:13.753 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:13.748+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:13.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:13.863+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:14.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:14.032+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:14.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:14.145+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:14.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:14.324+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:14.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:14.325+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:14.454 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:14.449+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:14.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:14.673+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:14.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:14.787+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:14.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:14.832+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:15.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:15.042+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:15.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:15.189+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:15.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:15.326+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:15.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:15.328+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:15.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:15.472+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:15.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:15.674+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:15.778 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:15.771+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:15.868 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:15.861+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:16.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:16.035+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:16.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:16.151+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:16.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:16.282+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:16.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:16.287+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:16.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:16.512+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:16.716 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:16.711+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:16.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:16.732+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:16.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:16.911+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:17.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:17.006+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:17.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:17.144+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:17.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:17.261+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:17.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:17.264+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:17.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:17.494+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:17.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:17.676+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:17.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:17.755+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:17.898 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:17.891+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:18.006 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:18.001+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:18.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:18.197+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:18.252 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:18.245+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:18.253 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:18.248+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:18.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:18.549+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:18.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:18.654+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:18.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:18.734+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:18.942 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:18.936+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:18.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:18.991+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:19.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:19.171+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:19.248 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:19.242+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:19.249 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:19.244+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:19.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:19.561+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:19.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:19.651+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:19.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:19.749+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:19.967 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:19.959+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:20.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:20.024+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:20.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:20.144+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:20.275 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:20.269+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:20.275 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:20.270+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:20.576 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:20.570+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:20.655 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:20.651+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:20.755 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:20.748+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:21.016 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:21.009+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:21.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:21.035+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:21.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:21.132+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:21.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:21.314+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:21.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:21.316+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:21.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:21.623+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:21.684 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:21.679+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:21.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:21.800+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:22.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:22.036+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:22.081 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:22.073+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:22.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:22.165+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:22.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:22.315+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:22.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:22.317+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:22.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:22.604+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:22.688 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:22.683+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:22.845 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:22.839+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:23.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:23.017+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:23.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:23.095+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:23.194 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:23.187+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:23.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:23.354+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:23.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:23.358+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:23.585 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:50:23.569+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e242 v242) 2019-11-29T16:50:23.641 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:23.635+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:23.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:23.656+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:23.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:23.869+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:24.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:23.998+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:24.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:24.116+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:24.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:24.223+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:24.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:24.358+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:24.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:24.361+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:24.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:24.613+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:24.689 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:24.671+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:24.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:24.845+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:24.971 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:24.964+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:25.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:25.098+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:25.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:25.233+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:25.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:25.329+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:25.336 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:25.331+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:25.606 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:25.601+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:25.689 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:25.684+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:25.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:25.811+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:25.990 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:25.978+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:26.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:26.082+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:26.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:26.222+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:26.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:26.317+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:26.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:26.318+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:26.590 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:26.584+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:26.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:26.689+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:26.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:26.793+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:26.960 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:26.955+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:27.087 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:27.083+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:27.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:27.231+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:27.374 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:27.369+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:27.374 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:27.371+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:27.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:27.601+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:27.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:27.687+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:27.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:50:27.838+0000 1694c700 -1 osd.5 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.779584+0000 front 2019-11-29T16:49:05.891546+0000 (oldest deadline 2019-11-29T16:49:51.655975+0000) 2019-11-29T16:50:28.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:50:27.997+0000 1694c700 -1 osd.4 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:10.049997+0000 front 2019-11-29T16:49:05.296034+0000 (oldest deadline 2019-11-29T16:49:49.923017+0000) 2019-11-29T16:50:28.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:50:28.039+0000 1694c700 -1 osd.1 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:06.417099+0000 front 2019-11-29T16:49:06.518659+0000 (oldest deadline 2019-11-29T16:49:50.488516+0000) 2019-11-29T16:50:28.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:28.195+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:50:28.370 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:28.361+0000 1694c700 -1 osd.0 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:49:17.949291+0000 (oldest deadline 2019-11-29T16:49:57.949291+0000) 2019-11-29T16:50:28.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:50:28.364+0000 1694c700 -1 osd.0 242 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e240) 2019-11-29T16:50:28.585 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:50:28.579+0000 1694c700 -1 osd.6 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:07.276746+0000 front 2019-11-29T16:49:07.238034+0000 (oldest deadline 2019-11-29T16:49:50.634428+0000) 2019-11-29T16:50:28.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:50:28.649+0000 1694c700 -1 osd.2 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:05.294401+0000 front 2019-11-29T16:49:05.238879+0000 (oldest deadline 2019-11-29T16:49:51.120556+0000) 2019-11-29T16:50:28.655 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:50:28.641+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e242 v242) 2019-11-29T16:50:29.242 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:50:29.238+0000 1694c700 -1 osd.7 242 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:49:08.224906+0000 front 2019-11-29T16:49:08.224050+0000 (oldest deadline 2019-11-29T16:49:52.312454+0000) 2019-11-29T16:52:03.248 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:03.241+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:03.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:03.891+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:04.254 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:04.248+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:04.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:04.686+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:04.939 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:04.934+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:05.262 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:05.257+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:05.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:05.261+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:05.708 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:05.704+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:05.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:05.736+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:05.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:05.927+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:06.284 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:06.262+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:06.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:06.265+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:06.598 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:06.594+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:06.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:06.722+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:06.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:06.733+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:06.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:06.938+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:07.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:07.221+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:07.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:07.273+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:07.613 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:07.602+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:07.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:07.700+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:07.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:07.740+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:07.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:07.895+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:08.242 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:08.232+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:08.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:08.252+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:08.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:08.340+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:08.630 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:08.623+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:08.747 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:08.740+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:08.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:08.746+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:08.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:08.906+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:09.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:09.243+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:09.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:09.259+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:09.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:09.360+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:09.606 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:09.600+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:09.721 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:09.714+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:09.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:09.787+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:09.875 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:09.870+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:10.211 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:10.205+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:10.286 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:10.279+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:10.402 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:10.397+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:10.584 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:10.579+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:10.705 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:10.698+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:10.787 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:10.781+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:10.852 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:10.848+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:11.255 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:11.249+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:11.260 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:11.254+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:11.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:11.423+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:11.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:11.586+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:11.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:11.680+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:11.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:11.793+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:11.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:11.894+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:12.245 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:12.238+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:12.300 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:12.293+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:12.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:12.425+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:12.553 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:12.549+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:12.739 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:12.732+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:12.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:12.757+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:12.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:12.868+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:13.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:13.233+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:13.287 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:13.281+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:13.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:13.465+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:13.572 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:13.564+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:13.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:13.761+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:13.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:13.802+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:13.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:13.890+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:14.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:14.257+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:14.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:14.282+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:14.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:14.436+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:14.597 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:14.584+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:14.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:14.760+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:14.777 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:14.771+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:14.884 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:14.878+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:15.261 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:15.255+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:15.304 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:15.298+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:15.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:15.462+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:15.544 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:15.540+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:15.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:15.774+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:15.830 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:15.824+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:15.844 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:15.840+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:16.283 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:16.277+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:16.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:16.283+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:16.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:16.501+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:16.572 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:16.567+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:16.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:16.732+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:16.842 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:16.835+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:16.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:16.860+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:17.300 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:17.294+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:17.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:17.330+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:17.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:17.550+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:17.608 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:17.602+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:17.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:17.756+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:17.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:17.814+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:17.886 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:17.879+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:18.336 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:18.329+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:18.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:18.367+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:18.575 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:18.570+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:18.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:18.620+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:18.797 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:18.791+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:18.842 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:18.836+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:18.887 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:18.881+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:19.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:19.359+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:19.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:19.363+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:19.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:19.591+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:19.639 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:19.633+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:19.850 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:19.844+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:19.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:19.872+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:19.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:19.897+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:20.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:20.326+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:20.340 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:20.333+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:20.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:20.611+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:20.659 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:20.654+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:20.816 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:20.810+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:20.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:20.849+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:20.873 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:20.866+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:21.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:21.296+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:21.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:21.296+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:21.628 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:21.623+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:21.629 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:21.624+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:21.836 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:21.830+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:21.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:21.897+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:21.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:21.902+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:22.328 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:22.323+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:22.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:22.344+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:22.595 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:22.589+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:22.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:22.620+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:22.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:22.864+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:22.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:22.900+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:22.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:22.918+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:23.307 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:23.301+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:23.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:23.319+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:23.570 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:23.566+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:23.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:23.593+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:23.900 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:23.893+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:23.910 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:23.904+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:23.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:23.938+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:24.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:24.281+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:24.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:24.309+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:24.529 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:24.524+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:24.575 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:24.570+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:24.870 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:24.864+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:24.905 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:24.900+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:24.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:24.917+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:25.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:25.247+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:25.322 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:25.317+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:25.538 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:25.534+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:25.599 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:25.594+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:25.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:25.821+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:25.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:25.901+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:25.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:25.910+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:26.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:26.217+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:26.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:26.310+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:26.580 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:26.575+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:26.624 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:26.618+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:26.790 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:26.784+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:26.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:26.890+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:26.951 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:26.945+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:27.246 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:27.240+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:27.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:27.272+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:27.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:27.550+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:27.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:27.647+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:27.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:27.757+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:27.920 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:27.913+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:27.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:27.939+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:28.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:28.208+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:28.327 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:28.320+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:28.522 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:28.508+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:28.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:28.645+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:28.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:28.777+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:28.901 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:28.897+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:28.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:28.942+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:29.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:29.178+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:29.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:29.288+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:29.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:29.491+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:29.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:29.612+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:29.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:29.794+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:29.868 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:29.863+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:29.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:29.958+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:30.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:30.132+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:30.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:30.298+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:30.514 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:30.509+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:30.575 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:30.570+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:30.809 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:30.801+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:30.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:30.908+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:30.987 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:30.979+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:31.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:31.093+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:31.282 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:31.274+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:31.537 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:31.532+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:31.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:31.536+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:31.855 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:31.847+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:31.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:31.922+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:32.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:31.994+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:32.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:32.104+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:32.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:32.325+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:32.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:32.535+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:32.548 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:32.543+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:32.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:32.880+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:32.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:32.902+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:32.993 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:32.986+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:33.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:33.104+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:33.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:33.305+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:33.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:33.534+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:33.573 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:33.568+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:33.852 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:33.844+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:33.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:33.918+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:34.048 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:34.038+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:34.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:34.132+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:34.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:34.270+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:34.581 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:34.577+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:34.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:34.615+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:34.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:34.829+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:34.950 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:34.945+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:35.036 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:35.027+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:35.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:35.091+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:35.299 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:35.292+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:35.584 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:35.580+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:35.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:35.599+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:35.816 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:35.809+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:35.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:35.965+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:36.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:36.028+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:36.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:36.054+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:36.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:36.258+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:36.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:36.553+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:36.638 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:36.630+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:36.863 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:36.855+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:36.933 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:36.929+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:37.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:37.003+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:37.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:37.026+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:37.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:37.298+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:37.522 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:37.517+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:37.618 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:37.614+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:37.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:37.859+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:37.941 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:37.936+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:38.034 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:38.020+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:38.076 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:38.069+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:38.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:38.263+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:38.485 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:38.481+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:52:38.651 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:52:38.647+0000 1694c700 -1 osd.3 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.294902+0000 front 2019-11-29T16:51:22.302276+0000 (oldest deadline 2019-11-29T16:52:06.256280+0000) 2019-11-29T16:52:38.896 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:52:38.887+0000 1694c700 -1 osd.4 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.818560+0000 front 2019-11-29T16:51:18.816834+0000 (oldest deadline 2019-11-29T16:52:03.953766+0000) 2019-11-29T16:52:38.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:52:38.898+0000 1694c700 -1 osd.1 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:18.142051+0000 front 2019-11-29T16:51:18.339228+0000 (oldest deadline 2019-11-29T16:52:03.822338+0000) 2019-11-29T16:52:38.996 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:52:38.988+0000 1694c700 -1 osd.7 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.924182+0000 front 2019-11-29T16:51:21.883096+0000 (oldest deadline 2019-11-29T16:52:05.361163+0000) 2019-11-29T16:52:39.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:52:39.111+0000 1694c700 -1 osd.6 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:17.064390+0000 front 2019-11-29T16:51:17.050325+0000 (oldest deadline 2019-11-29T16:52:02.855502+0000) 2019-11-29T16:52:39.229 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:52:39.221+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e248 v248) 2019-11-29T16:52:39.312 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:52:39.307+0000 1694c700 -1 osd.5 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:21.156066+0000 front 2019-11-29T16:51:21.085570+0000 (oldest deadline 2019-11-29T16:52:04.531945+0000) 2019-11-29T16:52:39.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:52:39.444+0000 1694c700 -1 osd.2 248 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:51:22.145401+0000 front 2019-11-29T16:51:22.146721+0000 (oldest deadline 2019-11-29T16:52:08.022497+0000) 2019-11-29T16:53:03.651 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:37:11.786 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.653 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:37:11.790 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.668 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:37:11.849 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.671 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:37:11.853 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.715 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:37:11.897 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.719 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:37:11.901 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.943 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:37:12.079 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.944 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:37:12.125 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:03.994 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:37:12.177 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:53:13.043 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:13.037+0000 114ab700 -1 osd.7 252 build_incremental_map_msg missing incremental map 252 2019-11-29T16:53:13.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:13.140+0000 35f8c700 -1 osd.7 252 build_incremental_map_msg missing incremental map 252 2019-11-29T16:53:16.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:16.126+0000 34789700 -1 osd.0 254 build_incremental_map_msg missing incremental map 254 2019-11-29T16:53:17.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:17.621+0000 36f8e700 -1 osd.0 254 build_incremental_map_msg missing incremental map 254 2019-11-29T16:53:38.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:38.623+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:39.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:39.151+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:39.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:39.599+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:40.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:40.128+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:40.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:40.581+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:40.612 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:40.605+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:41.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:41.158+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:41.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:41.567+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:41.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:41.628+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:42.178 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:42.172+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:42.184 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:42.180+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:42.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:42.434+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:42.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:42.537+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:42.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:42.628+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:42.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:42.641+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:43.168 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:43.163+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:43.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:43.207+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:43.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:43.482+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:43.523 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:43.516+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:43.624 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:43.618+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:43.685 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:43.680+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:44.173 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:44.167+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:44.202 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:44.198+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:44.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:44.455+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:44.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:44.519+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:44.582 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:44.574+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:44.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:44.622+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:44.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:44.677+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:45.200 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:45.196+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:45.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:45.205+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:45.500 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:45.495+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:45.564 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:45.560+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:45.612 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:45.598+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:45.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:45.620+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:45.699 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:45.695+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:46.182 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:46.178+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:46.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:46.179+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:46.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:46.450+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:46.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:46.560+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:46.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:46.572+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:46.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:46.672+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:46.705 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:46.699+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:47.229 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:47.221+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:47.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:47.227+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:47.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:47.407+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:47.545 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:47.538+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:47.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:47.604+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:47.669 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:47.663+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:47.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:47.739+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:48.237 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:48.232+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:48.283 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:48.278+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:48.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:48.414+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:48.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:53:48.531+0000 1694c700 -1 osd.7 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:56.007482+0000 front 2019-11-29T16:52:56.018030+0000 (oldest deadline 2019-11-29T16:53:41.836580+0000) 2019-11-29T16:53:48.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:48.573+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:48.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:48.626+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:48.711 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:48.706+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:49.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:49.265+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:49.297 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:49.290+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:49.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:49.416+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:49.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:49.619+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:49.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:49.642+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:49.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:49.740+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:50.242 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:50.238+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:50.252 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:50.246+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:50.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:50.445+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:50.642 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:50.637+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:50.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:50.672+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:50.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:50.782+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:51.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:51.210+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:51.280 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:51.275+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:51.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:51.398+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:51.403 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:51.399+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:51.634 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:51.626+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:51.673 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:51.668+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:51.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:51.813+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:52.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:52.209+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:52.260 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:52.255+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:52.401 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:52.398+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:52.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:52.400+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:52.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:52.665+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:52.675 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:52.670+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:52.864 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:52.858+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:53.242 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:53.236+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:53.297 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:53.293+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:53.395 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:53.391+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:53.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:53.392+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:53.675 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:53.670+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:53.698 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:53.690+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:53.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:53.886+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:54.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:54.261+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:54.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:54.311+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:54.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:54.391+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:54.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:54.393+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:54.694 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:54.688+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:54.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:54.730+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:54.888 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:54.882+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:55.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:55.308+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:55.335 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:55.331+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:55.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:55.367+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:55.374 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:55.369+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:55.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:55.726+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:55.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:55.778+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:55.862 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:55.857+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:56.321 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:56.316+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:56.331 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:56.326+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:56.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:56.336+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:56.343 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:56.339+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:56.725 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:56.719+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:56.813 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:56.802+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:56.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:56.819+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:57.282 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:57.273+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:57.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:57.292+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:57.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:57.293+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:57.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:57.299+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:57.719 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:57.712+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:57.811 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:57.804+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:57.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:57.854+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:58.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:58.280+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:58.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:58.282+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:58.312 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:58.307+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:58.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:58.335+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:58.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:58.745+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:58.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:58.801+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:58.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:58.868+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:53:59.279 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:59.274+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:53:59.281 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:53:59.278+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:53:59.293 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:53:59.289+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:53:59.364 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:53:59.357+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:53:59.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:53:59.755+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:53:59.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:53:59.808+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:53:59.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:53:59.875+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:00.300 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:00.293+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:00.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:00.305+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:00.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:00.305+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:00.322 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:00.315+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:00.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:00.741+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:00.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:00.830+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:00.898 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:00.893+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:01.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:01.261+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:01.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:01.263+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:01.302 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:01.298+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:01.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:01.299+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:01.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:01.794+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:01.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:01.814+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:01.931 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:01.927+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:02.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:02.280+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:02.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:02.283+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:02.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:02.285+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:02.344 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:02.340+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:02.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:02.786+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:02.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:02.864+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:02.921 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:02.910+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:03.330 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:03.320+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:03.330 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:03.326+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:03.332 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:03.329+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:03.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:03.377+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:03.766 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:03.759+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:03.865 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:03.858+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:03.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:03.898+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:04.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:04.361+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:04.375 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:04.368+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:04.377 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:04.372+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:04.379 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:04.375+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:04.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:04.753+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:04.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:04.894+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:04.954 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:04.949+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:05.334 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:05.328+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:05.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:05.344+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:05.430 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:05.425+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:05.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:05.427+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:05.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:05.757+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:05.914 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:05.907+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:05.937 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:05.930+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:06.366 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:06.360+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:06.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:06.393+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:06.437 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:06.432+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:06.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:06.433+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:06.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:06.717+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:06.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:06.867+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:06.919 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:06.912+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:07.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:07.351+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:07.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:07.355+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:07.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:07.411+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:07.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:07.413+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:07.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:07.746+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:07.870 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:07.866+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:07.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:07.917+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:08.364 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:08.357+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:08.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:08.360+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:08.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:08.414+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:08.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:08.415+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:08.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:08.702+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:08.873 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:08.868+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:08.935 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:08.927+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:09.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:09.382+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:09.396 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:09.384+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:09.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:09.428+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:09.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:09.429+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:09.719 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:54:09.711+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e254 v254) 2019-11-29T16:54:09.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:09.755+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:09.893 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:09.883+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:09.943 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:09.937+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:10.353 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:10.345+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:10.366 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:10.360+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:10.416 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:10.411+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:10.420 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:10.415+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:10.791 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:10.784+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:10.935 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:10.925+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:10.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:10.931+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:11.332 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:11.326+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:11.378 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:11.374+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:11.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:11.397+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:11.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:11.398+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:11.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:11.796+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:11.915 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:11.911+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:11.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:11.967+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:12.346 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:12.340+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:12.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:12.358+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:12.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:12.359+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:12.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:12.409+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:12.780 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:12.774+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:12.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:12.901+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:12.970 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:12.964+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:13.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:13.299+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:13.386 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:13.382+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:13.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:13.385+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:13.389 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:13.384+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:13.827 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:13.816+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:13.876 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:13.871+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:13.944 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:13.938+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:14.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:14.277+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:14.360 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:14.352+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:14.360 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:14.354+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:14.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:14.388+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:14.736 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:54:14.729+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e254 v254) 2019-11-29T16:54:14.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:14.861+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:14.872 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:14.869+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:14.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:14.914+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:15.254 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:15.249+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:15.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:15.352+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:15.390 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:15.385+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:15.391 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:15.386+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:15.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:15.846+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:15.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:15.900+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:15.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:15.906+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:16.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:16.291+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:16.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:16.363+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:16.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:16.403+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:16.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:16.407+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:16.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:16.835+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:16.868 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:16.861+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:16.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:16.956+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:17.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:17.326+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:17.402 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:17.397+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:17.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:17.440+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:17.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:17.441+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:17.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:17.828+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:17.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:17.852+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:17.956 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:17.951+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:18.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:18.371+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:18.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:18.395+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:18.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:18.397+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:18.428 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:18.421+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:18.879 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:18.867+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:18.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:18.895+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:18.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:18.914+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:19.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:19.339+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:19.413 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:19.408+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:19.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:19.409+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:19.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:19.451+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:19.756 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:54:19.748+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e254 v254) 2019-11-29T16:54:19.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:19.878+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:19.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:19.902+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:19.934 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:19.929+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:20.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:20.345+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:20.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:20.444+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:20.450 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:20.446+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:20.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:20.483+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:20.933 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:20.923+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:20.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:20.930+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:20.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:20.933+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:21.323 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:21.314+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:21.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:21.448+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:21.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:21.449+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:21.456 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:21.452+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:21.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:21.906+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:21.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:21.928+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:21.953 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:21.947+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:22.297 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:22.287+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:22.425 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:22.416+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:22.480 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:22.475+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:22.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:22.476+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:22.911 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:22.904+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:22.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:22.930+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:22.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:22.953+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:23.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:23.275+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:23.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:23.405+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:23.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:23.525+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:23.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:23.528+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:23.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:23.896+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:23.949 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:23.944+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:23.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:23.945+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:24.258 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:24.244+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:24.456 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:54:24.451+0000 1694c700 -1 osd.1 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.985359+0000 front 2019-11-29T16:52:56.010824+0000 (oldest deadline 2019-11-29T16:53:41.243143+0000) 2019-11-29T16:54:24.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:24.501+0000 1694c700 -1 osd.0 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:53:10.603910+0000 (oldest deadline 2019-11-29T16:53:50.603910+0000) 2019-11-29T16:54:24.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:24.504+0000 1694c700 -1 osd.0 254 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e252) 2019-11-29T16:54:24.829 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:54:24.823+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e254 v254) 2019-11-29T16:54:24.878 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:54:24.873+0000 1694c700 -1 osd.4 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.624468+0000 front 2019-11-29T16:52:55.599341+0000 (oldest deadline 2019-11-29T16:53:41.432328+0000) 2019-11-29T16:54:24.910 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:54:24.905+0000 1694c700 -1 osd.5 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:54.688372+0000 front 2019-11-29T16:52:54.780129+0000 (oldest deadline 2019-11-29T16:53:40.490943+0000) 2019-11-29T16:54:24.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:54:24.923+0000 1694c700 -1 osd.2 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:52.480217+0000 front 2019-11-29T16:52:52.479417+0000 (oldest deadline 2019-11-29T16:53:38.347042+0000) 2019-11-29T16:54:25.260 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:54:25.255+0000 1694c700 -1 osd.6 254 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:52:55.485971+0000 front 2019-11-29T16:52:55.426657+0000 (oldest deadline 2019-11-29T16:53:38.908418+0000) 2019-11-29T16:54:25.393 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:54:25.386+0000 34f8a700 -1 osd.0 255 build_incremental_map_msg missing incremental map 254 2019-11-29T16:54:48.981 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:54:48.836+0000 33787700 -1 osd.3 259 build_incremental_map_msg missing incremental map 259 2019-11-29T16:54:49.008 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:54:48.919+0000 31783700 -1 osd.3 259 build_incremental_map_msg missing incremental map 259 2019-11-29T16:54:49.081 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:54:49.043+0000 34f8a700 -1 osd.3 259 build_incremental_map_msg missing incremental map 259 2019-11-29T16:54:49.170 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:54:49.154+0000 34f8a700 -1 osd.3 259 build_incremental_map_msg missing incremental map 259 2019-11-29T16:55:46.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:46.027+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:46.063 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:46.049+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:46.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:46.984+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:47.068 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:47.064+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:47.378 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:47.371+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:48.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:48.008+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:48.095 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:48.089+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:48.387 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:48.380+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:48.676 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:48.670+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:48.738 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:48.729+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:48.861 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:48.855+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:48.973 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:48.965+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:49.141 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:49.136+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:49.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:49.407+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:49.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:49.680+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:49.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:49.714+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:49.889 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:49.884+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:50.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:49.999+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:50.182 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:50.177+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:50.402 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:50.398+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:50.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:50.656+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:50.710 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:50.703+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:50.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:50.898+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:51.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:51.014+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:51.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:51.146+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:51.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:51.415+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:51.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:51.669+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:51.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:51.758+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:51.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:51.918+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:52.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:52.009+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:52.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:52.016+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:52.129 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:52.125+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:52.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:52.461+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:52.675 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:52.667+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:52.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:52.801+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:52.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:52.936+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:53.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:53.021+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:53.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:53.037+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:53.113 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:53.108+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:53.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:53.513+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:53.695 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:53.689+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:53.821 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:53.817+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:53.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:53.930+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:54.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:54.040+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:54.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:54.087+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:54.095 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:54.091+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:54.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:54.537+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:54.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:54.713+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:54.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:54.828+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:54.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:54.937+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:55.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:55.072+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:55.116 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:55.111+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:55.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:55.134+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:55.555 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:55.550+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:55.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:55.760+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:55.826 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:55.819+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:55.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:55.948+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:56.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:56.096+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:56.133 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:56.129+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:56.154 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:56.148+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:56.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:56.548+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:56.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:56.793+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:56.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:56.860+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:56.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:56.944+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:57.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:57.053+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:57.153 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:57.145+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:57.218 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:57.199+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:57.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:57.556+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:57.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:57.822+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:57.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:57.871+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:57.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:57.967+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:58.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:58.104+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:58.184 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:58.165+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:58.215 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:58.207+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:58.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:58.570+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:58.848 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:58.841+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:58.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:58.908+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:55:58.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:55:58.984+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:55:59.128 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:55:59.121+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:55:59.160 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:55:59.153+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:55:59.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:55:59.233+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:55:59.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:55:59.602+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:55:59.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:55:59.827+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:55:59.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:55:59.897+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:00.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:00.018+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:00.137 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:00.132+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:00.161 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:00.156+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:00.233 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:00.226+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:00.614 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:00.607+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:00.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:00.795+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:00.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:00.895+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:01.054 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:01.048+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:01.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:01.109+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:01.186 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:01.181+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:01.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:01.264+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:01.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:01.647+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:01.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:01.752+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:01.889 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:01.872+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:02.021 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:02.011+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:02.131 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:02.126+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:02.173 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:02.168+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:02.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:02.222+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:02.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:02.621+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:02.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:02.806+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:02.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:02.890+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:03.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:03.047+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:03.111 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:03.107+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:03.180 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:03.176+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:03.262 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:03.255+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:03.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:03.627+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:03.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:03.776+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:03.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:03.943+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:04.094 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:04.087+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:04.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:04.102+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:04.172 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:04.166+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:04.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:04.282+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:04.599 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:04.592+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:04.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:04.744+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:05.003 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:04.996+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:05.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:05.064+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:05.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:05.073+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:05.146 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:05.141+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:05.250 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:05.245+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:05.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:05.577+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:05.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:05.764+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:06.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:06.027+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:06.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:06.072+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:06.096 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:06.091+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:06.149 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:06.143+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:06.208 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:06.202+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:06.618 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:06.612+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:06.771 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:06.764+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:07.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:07.006+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:07.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:07.034+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:07.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:07.046+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:07.121 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:07.102+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:07.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:07.194+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:07.619 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:07.613+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:07.741 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:07.731+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:08.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:08.005+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:08.035 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:08.030+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:08.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:08.032+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:08.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:08.151+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:08.215 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:08.208+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:08.660 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:08.654+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:08.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:08.698+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:09.014 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:09.009+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:09.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:09.041+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:09.071 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:09.066+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:09.204 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:09.199+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:09.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:09.253+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:09.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:09.672+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:09.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:09.686+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:10.015 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:10.008+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:10.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:10.018+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:10.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:10.110+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:10.210 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:10.204+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:10.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:10.257+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:10.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:10.650+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:10.698 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:10.692+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:10.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:10.989+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:11.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:11.020+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:11.137 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:11.131+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:11.213 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:11.209+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:11.315 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:11.310+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:11.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:11.648+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:11.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:11.745+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:11.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:11.993+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:12.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:12.058+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:12.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:12.102+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:12.204 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:12.200+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:12.311 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:12.306+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:12.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:12.630+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:12.757 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:12.750+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:12.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:12.991+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:13.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:13.061+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:13.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:13.086+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:13.202 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:13.197+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:13.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:13.309+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:13.606 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:13.599+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:13.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:13.709+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:14.015 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:14.005+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:14.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:14.041+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:14.117 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:14.113+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:14.237 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:14.231+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:14.299 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:14.292+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:14.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:14.602+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:14.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:14.725+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:15.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:15.025+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:15.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:15.052+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:15.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:15.111+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:15.213 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:15.208+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:15.279 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:15.273+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:15.601 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:15.594+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:15.762 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:15.755+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:16.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:16.009+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:16.073 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:16.067+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:16.095 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:16.090+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:16.210 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:16.199+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:16.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:16.263+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:16.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:16.614+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:16.737 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:16.730+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:16.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:16.971+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:17.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:17.088+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:17.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:17.136+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:17.186 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:17.181+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:17.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:17.265+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:17.663 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:17.656+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:17.780 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:17.772+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:18.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:18.024+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:18.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:18.077+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:18.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:18.126+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:18.170 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:18.165+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:18.320 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:18.311+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:18.720 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:18.711+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:18.766 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:18.758+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:18.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:18.992+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:19.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:19.040+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:19.160 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:19.154+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:19.198 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:19.192+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:19.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:19.269+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:19.688 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:56:19.680+0000 1694c700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.789950+0000 front 2019-11-29T16:55:05.784173+0000 (oldest deadline 2019-11-29T16:55:48.049417+0000) 2019-11-29T16:56:19.782 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:19.775+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:20.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:56:20.006+0000 1694c700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.101219+0000 front 2019-11-29T16:55:05.106369+0000 (oldest deadline 2019-11-29T16:55:48.578694+0000) 2019-11-29T16:56:20.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:56:20.060+0000 1694c700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:02.315094+0000 front 2019-11-29T16:55:02.376401+0000 (oldest deadline 2019-11-29T16:55:48.194168+0000) 2019-11-29T16:56:20.208 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:56:20.204+0000 1694c700 -1 osd.2 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:05.969313+0000 front 2019-11-29T16:55:00.008198+0000 (oldest deadline 2019-11-29T16:55:45.897616+0000) 2019-11-29T16:56:20.253 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:56:20.240+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 48sec e260 v260) 2019-11-29T16:56:20.253 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:56:20.243+0000 1694c700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:01.261853+0000 front 2019-11-29T16:55:01.247352+0000 (oldest deadline 2019-11-29T16:55:45.920343+0000) 2019-11-29T16:56:20.327 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:56:20.319+0000 1694c700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:06.136186+0000 front 2019-11-29T16:55:05.822382+0000 (oldest deadline 2019-11-29T16:55:51.409971+0000) 2019-11-29T16:56:20.759 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:56:20.752+0000 1694c700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:55:00.781477+0000 front 2019-11-29T16:55:00.870654+0000 (oldest deadline 2019-11-29T16:55:46.518537+0000) 2019-11-29T16:56:55.476 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:03.608 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.476 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:03.612 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.484 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:03.665 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.488 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:03.667 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.490 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:03.672 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.496 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:03.678 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.734 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:03.869 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.750 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:03.932 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:56:55.809 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:03.992 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:19.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:19.089+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:19.795 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:19.788+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:20.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:20.102+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:20.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:20.242+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:20.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:20.754+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:20.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:20.768+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:21.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:21.118+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:21.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:21.150+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:21.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:21.280+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:21.777 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:21.771+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:21.815 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:21.809+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:22.097 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:22.092+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:22.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:22.170+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:22.341 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:22.330+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:22.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:22.753+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:22.815 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:22.809+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:23.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:23.090+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:23.168 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:23.161+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:23.370 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:23.365+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:23.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:23.767+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:23.780 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:23.776+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:24.051 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:24.045+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:24.182 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:24.175+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:24.406 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:24.401+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:24.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:24.724+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:24.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:24.752+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:24.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:24.816+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:25.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:25.065+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:25.133 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:25.129+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:25.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:25.148+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:25.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:25.432+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:25.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:25.722+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:25.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:25.735+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:25.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:25.839+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:26.103 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:26.099+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:26.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:26.097+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:26.130 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:26.124+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:26.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:26.464+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:26.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:26.759+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:26.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:26.780+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:26.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:26.865+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:27.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:27.084+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:27.115 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:27.111+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:27.122 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:27.117+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:27.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:27.463+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:27.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:27.725+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:27.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:27.739+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:27.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:27.901+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:28.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:28.093+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:28.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:28.144+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:28.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:28.149+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:28.503 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:28.499+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:28.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:28.726+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:28.734 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:28.728+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:28.867 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:28.861+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:29.105 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:29.101+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:29.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:29.104+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:29.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:29.186+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:29.475 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:29.471+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:29.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:29.696+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:29.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:29.764+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:29.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:29.872+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:30.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:30.093+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:30.121 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:30.115+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:30.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:30.176+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:30.477 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:30.472+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:30.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:30.720+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:30.797 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:30.792+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:30.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:30.900+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:31.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:31.088+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:31.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:31.089+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:31.103 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:31.097+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:31.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:31.184+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:31.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:31.522+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:31.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:31.698+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:31.791 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:31.786+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:31.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:31.861+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:32.080 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:32.075+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:32.082 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:32.074+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:32.082 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:32.076+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:32.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:32.222+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:32.568 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:32.564+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:32.702 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:32.696+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:32.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:32.780+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:32.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:32.830+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:33.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:33.057+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:33.065 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:33.060+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:33.113 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:33.107+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:33.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:33.223+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:33.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:33.609+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:33.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:33.717+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:33.803 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:33.798+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:33.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:33.804+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:34.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:34.015+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:34.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:34.017+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:34.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:34.096+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:34.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:34.229+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:34.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:34.605+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:34.688 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:34.681+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:34.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:34.751+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:34.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:34.777+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:35.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:35.065+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:35.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:35.067+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:35.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:35.079+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:35.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:35.249+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:35.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:35.634+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:35.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:35.695+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:35.777 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:35.768+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:35.777 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:35.767+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:36.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:36.027+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:36.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:36.029+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:36.045 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:36.040+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:36.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:36.294+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:36.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:36.645+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:36.675 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:36.670+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:36.735 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:36.729+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:36.824 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:36.819+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:36.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:36.983+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:36.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:36.987+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:37.000 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:36.994+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:37.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:37.255+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:37.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:37.686+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:37.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:37.708+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:37.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:37.716+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:37.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:37.871+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:37.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:37.964+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:37.973 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:37.966+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:38.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:38.044+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:38.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:38.257+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:38.699 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:38.694+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:38.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:38.712+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:38.724 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:38.718+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:38.906 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:38.902+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:39.015+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:39.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:39.016+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:39.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:39.116+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:39.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:39.239+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:39.719 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:39.713+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:39.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:39.733+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:39.744 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:39.740+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:39.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:39.942+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:39.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:39.983+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:39.991 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:39.987+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:40.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:40.110+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:40.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:40.264+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:40.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:40.684+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:40.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:40.770+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:40.785 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:40.779+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:40.820 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:48.956 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.845 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:48.980 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.852 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:49.034 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.891 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:49.074 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.900 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:49.081 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.915 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:49.096 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.918 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:41:49.054 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:40.942+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:40.960 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:41:49.142 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:40.973 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:41:49.154 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:57:41.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:41.023+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:41.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:41.026+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:41.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:41.095+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:41.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:41.259+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:41.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:41.726+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:41.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:41.809+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:41.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:41.809+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:41.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:41.967+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:41.997 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:41.992+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:41.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:41.993+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:42.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:42.087+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:42.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:42.265+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:42.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:42.739+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:42.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:42.822+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:42.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:42.827+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:42.958 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:42.952+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:42.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:42.954+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:42.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:42.987+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:43.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:43.042+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:43.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:43.231+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:43.699 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:43.693+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:43.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:43.811+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:43.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:43.865+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:44.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:43.995+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:44.002 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:43.997+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:44.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:43.996+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:44.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:44.069+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:44.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:44.191+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:44.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:44.656+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:44.803 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:44.796+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:44.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:44.839+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:44.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:44.960+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:45.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:45.026+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:45.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:45.030+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:45.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:45.099+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:45.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:45.224+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:45.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:45.679+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:45.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:45.824+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:45.849 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:45.842+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:45.932 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:45.928+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:46.079 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:46.074+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:46.080 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:46.076+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:46.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:46.109+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:46.255 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:46.249+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:46.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:46.719+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:46.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:46.789+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:46.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:46.813+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:46.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:46.964+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:47.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:47.097+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:47.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:47.106+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:47.111 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:47.107+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:47.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:47.273+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:47.733 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:47.727+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:47.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:47.745+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:47.842 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:47.836+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:47.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:47.972+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:48.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:48.102+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:48.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:48.158+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:48.163 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:48.159+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:48.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:48.273+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:48.735 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:48.729+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:48.795 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:48.790+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:48.826 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:48.820+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:48.944 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:48.939+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:49.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:49.147+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:49.195 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:49.189+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:49.197 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:49.192+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:49.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:49.285+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:49.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:49.715+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:49.759 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:49.754+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:49.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:49.872+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:49.906 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:49.898+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:50.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:50.116+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:50.229 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:50.224+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:50.230 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:50.227+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:50.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:50.282+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:50.735 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:50.727+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:50.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:50.756+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:50.861 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:57:50.853+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e266 v266) 2019-11-29T16:57:50.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:50.877+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:50.922 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:50.916+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:51.113 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:51.106+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:51.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:51.254+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:51.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:51.257+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:51.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:51.293+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:51.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:51.716+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:51.778 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:51.774+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:51.921 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:51.916+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:51.936 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:51.929+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:52.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:52.119+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:52.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:52.232+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:52.240 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:52.237+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:52.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:52.314+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:52.764 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:52.759+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:52.776 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:52.771+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:52.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:52.889+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:52.955 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:52.949+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:53.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:53.150+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:53.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:53.247+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:53.255 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:53.250+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:53.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:53.274+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:53.776 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:53.759+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:53.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:53.782+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:53.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:53.906+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:53.984 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:53.978+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:54.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:54.159+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:54.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:54.234+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:54.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:54.235+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:54.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:54.300+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:54.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:54.730+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:54.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:54.807+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:54.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:54.901+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:54.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:54.968+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:55.202 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:55.195+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:55.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:55.211+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:55.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:55.212+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:55.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:55.267+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:55.733 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:55.728+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:55.811 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:55.806+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:55.895 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:57:55.886+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e266 v266) 2019-11-29T16:57:55.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:55.905+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:55.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:55.981+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:56.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:56.163+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:56.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:56.202+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:56.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:56.208+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:56.251 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:56.246+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:56.757 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:56.752+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:56.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:56.859+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:56.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:56.947+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:57.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:57.018+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:57.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:57.156+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:57.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:57.214+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:57.220 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:57.216+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:57.284 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:57.278+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:57.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:57.765+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:57.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:57.831+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:57.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:57.912+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:58.003 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:57.997+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:58.182 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:58.176+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:58.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:58.182+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:58.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:58.183+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:58.282 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:58.276+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:58.752 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:58.748+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:58.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:58.803+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:58.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:58.948+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:57:59.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:57:59.048+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:57:59.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:57:59.181+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:57:59.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:59.218+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:57:59.226 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:57:59.221+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:57:59.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:57:59.234+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:57:59.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:57:59.745+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:57:59.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:57:59.769+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:57:59.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:57:59.942+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:00.052 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:00.046+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:00.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:00.140+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:00.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:00.182+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:00.188 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:00.184+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:00.195 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:00.189+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:00.747 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:00.743+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:00.769 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:00.763+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:00.915 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:58:00.905+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e266 v266) 2019-11-29T16:58:00.986 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:00.982+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:01.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:01.092+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:01.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:01.145+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:01.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:01.146+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:01.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:01.151+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:01.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:01.203+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:01.740 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:01.734+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:01.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:01.739+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:02.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:02.015+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:02.133 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:02.128+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:02.163 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:02.158+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:02.164 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:02.161+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:02.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:02.171+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:02.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:02.174+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:02.767 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:02.761+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:02.770 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:02.760+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:03.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:03.050+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:03.100 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:03.095+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:03.130 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:03.124+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:03.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:03.127+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:03.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:03.177+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:03.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:03.207+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:03.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:03.731+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:03.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:03.798+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:04.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:04.090+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:04.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:04.100+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:04.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:04.144+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:04.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:04.146+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:04.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:04.181+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:04.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:04.225+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:04.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:04.754+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:04.822 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:04.816+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:05.084 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:05.079+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:05.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:05.122+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:05.130 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:05.125+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:58:05.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:05.133+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:05.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:58:05.135+0000 1694c700 -1 osd.7 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.477484+0000 front 2019-11-29T16:56:37.341004+0000 (oldest deadline 2019-11-29T16:57:20.191759+0000) 2019-11-29T16:58:05.197 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:58:05.191+0000 1694c700 -1 osd.6 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:37.905750+0000 front 2019-11-29T16:56:37.929913+0000 (oldest deadline 2019-11-29T16:57:18.962316+0000) 2019-11-29T16:58:05.727 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:58:05.723+0000 1694c700 -1 osd.2 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.685418+0000 front 2019-11-29T16:56:36.737711+0000 (oldest deadline 2019-11-29T16:57:20.043222+0000) 2019-11-29T16:58:05.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:58:05.861+0000 1694c700 -1 osd.5 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:36.783757+0000 front 2019-11-29T16:56:36.587277+0000 (oldest deadline 2019-11-29T16:57:19.385570+0000) 2019-11-29T16:58:06.007 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T16:58:05.992+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e266 v266) 2019-11-29T16:58:06.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:58:06.120+0000 1694c700 -1 osd.1 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:35.894328+0000 front 2019-11-29T16:56:36.561304+0000 (oldest deadline 2019-11-29T16:57:19.968482+0000) 2019-11-29T16:58:06.129 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:58:06.120+0000 1694c700 -1 osd.4 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T16:56:38.043658+0000 front 2019-11-29T16:56:38.036571+0000 (oldest deadline 2019-11-29T16:57:23.907037+0000) 2019-11-29T16:58:06.158 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:06.121+0000 1694c700 -1 osd.0 266 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T16:56:50.385548+0000 (oldest deadline 2019-11-29T16:57:30.385548+0000) 2019-11-29T16:58:06.159 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T16:58:06.123+0000 1694c700 -1 osd.0 266 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:106116 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-11-29T16:59:32.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:32.843+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:33.819 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:33.812+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:33.983 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:33.979+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:34.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:34.136+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:34.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:34.159+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:34.837 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:34.831+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:34.971 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:34.967+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:35.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:35.105+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:35.143 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:35.131+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:35.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:35.467+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:35.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:35.884+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:36.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:36.014+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:36.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:36.091+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:36.141 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:36.134+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:36.227 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:36.221+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:36.520 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:36.513+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:36.940 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:36.934+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:36.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:36.992+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:37.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:37.055+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:37.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:37.083+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:37.166 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:37.160+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:37.271 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:37.266+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:37.481 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:37.474+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:37.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:37.935+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:38.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:38.018+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:38.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:38.024+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:38.135 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:38.129+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:38.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:38.157+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:38.321 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:38.315+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:38.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:38.485+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:38.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:38.926+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:39.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:39.011+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:39.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:39.027+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:39.141 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:39.133+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:39.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:39.153+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:39.329 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:39.325+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:39.495 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:39.488+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:39.939 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:39.933+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:39.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:39.984+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:39.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:39.985+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:40.154 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:40.148+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:40.163 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:40.158+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:40.379 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:40.374+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:40.502 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:40.496+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:40.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:40.968+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:41.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:41.027+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:41.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:41.039+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:41.131 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:41.124+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:41.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:41.158+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:41.333 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:41.329+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:41.508 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:41.502+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:41.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:41.984+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:42.010 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:42.005+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:42.015 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:42.009+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:42.096 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:42.090+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:42.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:42.209+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:42.338 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:42.334+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:42.494 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:42.487+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:42.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:42.982+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:43.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:43.017+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:43.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:43.063+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:43.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:43.069+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:43.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:43.219+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:43.362 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:43.357+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:43.481 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:43.475+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:43.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:43.941+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:44.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:44.023+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:44.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:44.043+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:44.135 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:44.128+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:44.277 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:44.271+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:44.353 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:44.348+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:44.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:44.440+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:44.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:44.966+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:45.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:45.014+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:45.049 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:45.043+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:45.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:45.124+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:45.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:45.258+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:45.380 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:45.374+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:45.420 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:45.414+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:46.017 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:46.011+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:46.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:46.014+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:46.053 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:46.048+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:46.111 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:46.105+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:46.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:46.232+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:46.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:46.373+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:46.431 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:46.426+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:47.029 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:47.022+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:47.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:47.030+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:47.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:47.095+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:47.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:47.142+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:47.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:47.279+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:47.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:47.387+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:47.422 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:47.415+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:48.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:48.004+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:48.027 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:48.021+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:48.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:48.076+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:48.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:48.114+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:48.280 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:48.274+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:48.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:48.387+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:48.428 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:48.424+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:49.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:48.998+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:49.015 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:49.010+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:49.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T16:59:49.085+0000 1694c700 -1 osd.5 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:49.434253+0000 front 2019-11-29T16:58:49.435832+0000 (oldest deadline 2019-11-29T16:59:34.109989+0000) 2019-11-29T16:59:49.095 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:49.090+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:49.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:49.255+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:49.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:49.396+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:49.455 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:49.451+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:49.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:49.970+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:50.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:50.001+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:50.075 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:50.070+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:50.237 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:50.231+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:50.417 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:50.411+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:50.442 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:50.429+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:50.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:50.950+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:51.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:51.021+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:51.030 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:51.026+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:51.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:51.238+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:51.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:51.415+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:51.422 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:51.418+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:51.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:51.969+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:52.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:52.029+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:52.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:52.066+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:52.268 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:52.261+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:52.387 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:52.383+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:52.430 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:52.424+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:52.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:52.950+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:53.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:53.010+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:53.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:53.022+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:53.225 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:53.219+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:53.399 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:53.395+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:53.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:53.397+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:53.987 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:53.981+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:54.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:54.018+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:54.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:54.047+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:54.193 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:54.184+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:54.368 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:54.361+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:54.425 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:54.420+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:55.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:55.013+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:55.025 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:55.018+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:55.037 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:55.032+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:55.163 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:55.157+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:55.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:55.401+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:55.408 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:55.404+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:55.990 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:55.985+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:56.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:56.047+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:56.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:56.055+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:56.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:56.115+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:56.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:56.445+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:56.457 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:56.450+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:56.672 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:04.808 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.679 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:04.815 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.728 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:04.909 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.729 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:04.911 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.743 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:04.925 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.745 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:04.927 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.820 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:04.956 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.872 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:05.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:56.903 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:05.085 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T16:59:57.012 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:57.004+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:57.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:57.020+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:57.029 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:57.024+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:57.076 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:57.069+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:57.483 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:57.479+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:57.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:57.484+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:57.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:57.978+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:57.984 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:57.977+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:58.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:58.037+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:58.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:58.081+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:58.453 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:58.446+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:58.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:58.494+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:58.978 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:58.973+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T16:59:59.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T16:59:59.003+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T16:59:59.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T16:59:59.074+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T16:59:59.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T16:59:59.084+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T16:59:59.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T16:59:59.467+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T16:59:59.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T16:59:59.511+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T16:59:59.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T16:59:59.944+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:00.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:00.032+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:00.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:00.088+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:00.115 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:00.107+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:00.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:00.465+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:00.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:00.503+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:00.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:00.942+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:01.030 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:01.022+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:01.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:01.055+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:01.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:01.151+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:01.479 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:01.473+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:01.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:01.526+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:01.993 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:01.987+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:02.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:02.031+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:02.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:02.050+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:02.164 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:02.156+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:02.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:02.439+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:02.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:02.542+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:03.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:03.018+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:03.029 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:03.021+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:03.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:03.047+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:03.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:03.118+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:03.483 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:03.477+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:03.569 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:03.562+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:03.995 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:03.988+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:04.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:03.995+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:04.038 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:04.032+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:04.093 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:04.085+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:04.456 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:04.449+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:04.601 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:04.594+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:04.999 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:04.991+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:05.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:05.017+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:05.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:05.041+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:05.087 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:05.080+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:05.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:05.439+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:05.634 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:05.628+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:06.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:06.013+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:06.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:00:06.028+0000 1694c700 -1 osd.2 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:48.734493+0000 front 2019-11-29T16:58:48.416284+0000 (oldest deadline 2019-11-29T16:59:33.432793+0000) 2019-11-29T17:00:06.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:00:06.054+0000 1694c700 -1 osd.1 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.359669+0000 front 2019-11-29T16:58:51.357453+0000 (oldest deadline 2019-11-29T16:59:36.043766+0000) 2019-11-29T17:00:06.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:06.093+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:06.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:06.488+0000 1694c700 -1 osd.3 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:50.092722+0000 front 2019-11-29T16:58:50.105711+0000 (oldest deadline 2019-11-29T16:59:35.946083+0000) 2019-11-29T17:00:06.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:00:06.662+0000 1694c700 -1 osd.6 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:51.033799+0000 front 2019-11-29T16:58:51.082027+0000 (oldest deadline 2019-11-29T16:59:35.052640+0000) 2019-11-29T17:00:06.678 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:00:06.671+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e272 v272) 2019-11-29T17:00:07.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:00:07.027+0000 1694c700 -1 osd.7 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:52.805029+0000 front 2019-11-29T16:58:50.166149+0000 (oldest deadline 2019-11-29T16:59:32.434773+0000) 2019-11-29T17:00:07.150 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:00:07.145+0000 1694c700 -1 osd.4 272 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T16:58:47.933013+0000 front 2019-11-29T16:58:48.414610+0000 (oldest deadline 2019-11-29T16:59:33.819536+0000) 2019-11-29T17:00:41.374 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.298+0000 124ad700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.395 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.347+0000 31783700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.426+0000 31783700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.458+0000 3578b700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.569 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.520+0000 34f8a700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.635 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.632+0000 124ad700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.939 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.840+0000 37f90700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:41.963 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:41.890+0000 3678d700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:42.113 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:00:42.085+0000 34f8a700 -1 osd.3 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:42.699 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:00:42.695+0000 38f92700 -1 osd.0 278 build_incremental_map_msg missing incremental map 278 2019-11-29T17:00:51.390 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:59.526 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.398 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:59.534 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.402 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:59.584 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.408 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:59.590 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.410 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:59.591 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.414 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:59.597 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.489 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:44:59.671 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.535 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:44:59.717 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:00:51.557 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:44:59.693 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:01:04.306 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:04.301+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:04.825 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:04.819+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:05.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:05.035+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:05.309 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:05.303+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:05.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:05.344+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:05.838 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:05.833+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:05.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:01:05.909+0000 1694c700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.180101+0000 front 2019-11-29T17:00:20.077353+0000 (oldest deadline 2019-11-29T17:01:05.849065+0000) 2019-11-29T17:01:06.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:06.072+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:06.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:06.091+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:06.291 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:06.286+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:06.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:06.315+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:06.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:06.859+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:06.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:01:06.933+0000 1694c700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.180101+0000 front 2019-11-29T17:00:20.077353+0000 (oldest deadline 2019-11-29T17:01:05.849065+0000) 2019-11-29T17:01:07.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:07.073+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:07.136 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:07.132+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:07.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:07.337+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:07.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:07.346+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:07.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:07.818+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:08.122 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:08.117+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:08.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:08.153+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:08.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:08.318+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:08.387 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:08.383+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:08.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:08.859+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:09.116 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:09.111+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:09.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:09.154+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:09.362 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:09.356+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:09.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:09.382+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:09.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:09.827+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:10.172 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:10.166+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:10.173 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:10.167+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:10.351 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:10.344+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:10.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:10.357+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:10.374 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:10.366+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:10.848 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:10.842+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:11.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:11.151+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:11.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:11.212+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:11.314 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:11.310+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:11.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:11.327+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:11.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:11.339+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:11.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:11.814+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:12.172 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:12.167+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:12.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:12.206+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:12.302 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:12.297+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:12.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:12.326+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:12.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:12.386+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:12.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:12.796+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:13.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:13.156+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:13.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:13.226+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:13.324 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:13.319+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:13.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:13.357+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:13.366 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:13.361+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:13.830 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:13.824+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:14.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:14.161+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:14.220 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:14.215+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:14.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:14.329+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:14.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:14.332+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:14.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:14.357+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:14.863 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:14.857+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:15.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:15.202+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:15.239 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:15.233+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:15.324 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:15.319+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:15.325 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:15.321+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:15.394 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:15.388+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:15.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:15.910+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:16.227 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:16.221+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:16.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:16.252+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:16.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:16.280+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:16.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:16.353+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:16.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:16.386+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:16.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:16.919+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:17.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:17.238+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:17.246 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:17.241+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:17.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:17.242+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:17.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:17.244+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:17.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:17.348+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:17.365 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:17.359+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:17.945 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:17.939+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:18.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:18.219+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:18.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:18.243+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:18.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:18.293+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:18.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:18.294+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:18.322 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:18.315+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:18.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:18.320+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:19.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:18.995+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:19.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:19.244+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:19.267 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:19.262+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:19.268 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:19.264+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:19.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:19.277+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:19.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:19.356+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:19.367 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:19.361+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:19.981 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:19.975+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:20.266 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:20.261+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:20.284 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:20.278+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:20.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:20.281+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:20.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:20.285+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:20.344 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:20.338+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:20.379 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:20.366+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:20.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:20.941+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:21.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:21.233+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:21.284 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:21.280+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:21.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:21.283+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:21.293 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:21.288+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:21.323 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:21.318+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:21.390 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:21.384+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:21.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:21.936+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:22.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:22.205+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:22.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:22.257+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:22.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:22.321+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:22.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:22.323+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:22.347 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:22.341+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:22.362 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:22.357+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:22.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:22.947+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:23.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:01:23.253+0000 1694c700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:23.602768+0000 front 2019-11-29T17:00:23.618118+0000 (oldest deadline 2019-11-29T17:01:04.058111+0000) 2019-11-29T17:01:23.291 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:23.286+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:23.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:23.337+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:23.349 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:23.345+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:23.351 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:23.347+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:23.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:23.351+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:23.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:23.939+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:24.319 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:24.314+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:24.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:24.362+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:24.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:24.363+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:24.370 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:24.367+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:24.418 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:24.411+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:24.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:24.908+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:25.354 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:25.349+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:25.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:25.407+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:25.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:25.410+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:25.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:25.411+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:25.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:25.453+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:25.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:25.929+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:26.354 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:26.349+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:26.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:26.393+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:26.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:26.453+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:26.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:26.454+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:26.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:26.455+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:26.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:26.944+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:27.367 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:27.362+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:27.376 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:27.372+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:27.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:27.491+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:27.504 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:27.500+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:27.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:27.502+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:27.926 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:27.920+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:28.323 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:28.319+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:28.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:28.330+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:28.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:28.475+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:28.480 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:28.477+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:28.541 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:28.534+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:28.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:28.933+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:29.293 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:29.285+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:29.352 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:29.347+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:29.470 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:29.465+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:29.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:29.466+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:29.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:29.490+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:29.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:29.916+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:30.317 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:30.310+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:30.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:30.331+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:30.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:30.477+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:30.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:30.514+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:30.522 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:30.516+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:30.882 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:30.875+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:31.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:31.358+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:31.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:31.366+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:31.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:31.522+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:31.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:31.527+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:31.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:31.531+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:31.867 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:31.860+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:32.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:32.384+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:32.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:32.417+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:32.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:32.511+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:32.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:32.577+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:32.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:32.579+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:32.893 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:32.886+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:33.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:33.378+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:33.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:33.393+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:33.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:33.477+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:33.632 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:33.625+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:33.632 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:33.628+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:33.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:33.848+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:34.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:34.389+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:34.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:34.398+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:34.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:34.472+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:34.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:34.615+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:34.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:34.617+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:34.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:34.864+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:35.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:35.352+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:35.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:35.385+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:35.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:35.521+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:35.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:35.574+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:35.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:35.579+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:35.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:35.858+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:36.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:36.383+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:36.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:36.391+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:36.547 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:36.540+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:36.549 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:36.546+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:36.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:36.568+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:36.867 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:36.860+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:37.227 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:01:37.212+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e278 v278) 2019-11-29T17:01:37.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:37.397+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:37.425 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:37.417+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:37.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:37.547+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:37.597 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:37.589+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:37.597 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:37.591+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:37.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:37.892+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:38.364 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:38.359+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:38.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:38.381+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:38.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:38.559+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:38.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:38.560+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:38.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:38.556+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:38.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:38.895+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:39.343 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:39.339+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:39.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:39.428+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:39.564 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:39.558+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:39.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:39.603+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:39.612 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:39.607+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:39.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:39.910+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:40.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:40.375+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:40.394 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:40.389+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:40.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:40.561+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:40.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:40.564+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:40.587 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:40.579+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:40.928 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:40.921+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:41.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:41.359+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:41.367 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:41.363+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:41.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:41.590+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:41.597 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:41.592+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:41.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:41.614+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:41.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:41.927+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:42.239 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:01:42.231+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e278 v278) 2019-11-29T17:01:42.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:42.317+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:42.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:42.360+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:42.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:42.622+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:42.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:42.626+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:42.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:42.625+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:42.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:42.979+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:43.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:43.271+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:43.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:43.406+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:43.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:43.618+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:43.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:43.650+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:43.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:43.653+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:43.987 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:43.980+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:44.325 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:44.319+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:44.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:44.440+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:44.606 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:44.600+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:44.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:44.652+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:44.658 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:44.654+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:44.999 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:44.992+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:45.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:45.365+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:45.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:45.396+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:45.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:45.643+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:45.700 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:45.696+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:45.701 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:45.697+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:46.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:46.016+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:46.392 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:46.388+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:46.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:46.391+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:46.635 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:01:46.629+0000 1694c700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.823223+0000 front 2019-11-29T17:00:21.039402+0000 (oldest deadline 2019-11-29T17:01:05.287205+0000) 2019-11-29T17:01:46.712 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:46.703+0000 1694c700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:00:36.467360+0000 (oldest deadline 2019-11-29T17:01:16.467360+0000) 2019-11-29T17:01:46.712 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:46.704+0000 1694c700 -1 osd.0 278 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:47.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:01:46.997+0000 1694c700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:21.580033+0000 front 2019-11-29T17:00:21.598723+0000 (oldest deadline 2019-11-29T17:01:04.385638+0000) 2019-11-29T17:01:47.334 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:01:47.317+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e278 v278) 2019-11-29T17:01:47.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:01:47.374+0000 1694c700 -1 osd.2 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:22.874268+0000 front 2019-11-29T17:00:22.953279+0000 (oldest deadline 2019-11-29T17:01:05.690320+0000) 2019-11-29T17:01:47.439 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:01:47.434+0000 1694c700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:00:20.184812+0000 front 2019-11-29T17:00:20.195648+0000 (oldest deadline 2019-11-29T17:01:04.267224+0000) 2019-11-29T17:01:47.930 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:47.900+0000 1694c700 -1 osd.0 279 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e276) 2019-11-29T17:01:47.944 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:01:47.931+0000 38f92700 -1 osd.0 279 build_incremental_map_msg missing incremental map 278 2019-11-29T17:02:19.880 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:02:19.875+0000 34f8a700 -1 osd.3 283 build_incremental_map_msg missing incremental map 283 2019-11-29T17:03:19.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:19.101+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:19.219 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:19.212+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:19.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:19.535+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:20.073 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:20.064+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:20.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:20.218+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:20.511 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:20.503+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:21.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:21.089+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:21.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:21.152+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:21.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:21.181+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:21.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:21.506+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:21.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:21.808+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:22.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:22.060+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:22.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:22.094+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:22.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:22.153+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:22.171 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:22.167+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:22.531 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:22.525+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:22.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:22.800+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:23.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:23.044+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:23.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:23.054+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:23.180 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:23.174+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:23.200 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:23.194+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:23.575 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:23.568+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:23.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:23.777+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:24.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:24.030+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:24.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:24.064+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:24.161 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:24.155+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:24.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:24.154+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:24.562 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:24.557+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:24.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:24.571+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:24.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:24.780+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:25.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:25.005+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:25.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:25.085+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:25.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:25.126+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:25.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:25.151+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:25.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:25.513+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:25.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:25.590+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:25.826 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:25.818+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:26.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:26.055+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:26.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:26.063+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:26.122 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:26.117+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:26.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:26.208+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:26.497 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:26.488+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:26.573 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:26.563+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:26.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:26.808+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:27.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:27.033+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:27.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:27.049+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:27.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:27.079+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:27.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:27.203+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:27.481 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:27.476+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:27.578 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:27.571+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:27.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:27.823+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:28.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:28.027+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:28.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:28.076+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:28.106 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:28.097+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:28.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:28.201+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:28.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:28.526+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:28.588 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:28.582+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:28.789 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:28.784+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:28.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:28.986+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:29.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:29.057+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:29.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:29.058+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:29.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:29.231+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:29.495 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:29.488+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:29.599 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:29.593+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:29.755 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:29.747+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:29.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:29.979+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:30.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:30.038+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:30.053 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:30.046+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:30.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:30.206+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:30.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:30.532+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:30.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:30.570+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:30.754 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:30.748+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:31.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:31.020+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:31.028 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:31.022+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:31.042 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:31.036+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:31.174 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:31.167+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:31.524 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:31.519+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:31.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:31.606+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:31.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:31.746+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:32.024 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:32.018+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:32.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:32.027+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:32.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:32.059+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:32.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:32.152+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:32.523 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:32.518+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:32.603 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:32.597+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:32.776 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:32.771+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:33.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:33.026+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:33.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:33.045+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:33.114 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:33.107+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:33.149 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:33.142+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:33.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:33.525+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:33.619 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:33.613+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:33.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:33.816+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:34.018 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:34.012+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:34.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:34.030+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:34.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:34.131+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:34.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:34.153+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:34.582 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:34.576+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:34.606 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:34.601+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:34.817 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:34.811+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:35.028 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:35.013+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:35.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:35.082+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:35.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:35.152+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:35.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:35.199+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:35.612 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:35.606+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:35.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:35.645+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:35.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:35.817+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:36.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:36.056+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:36.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:36.129+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:36.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:36.170+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:36.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:36.241+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:36.640 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:36.635+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:36.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:36.656+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:36.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:36.828+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:37.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:37.096+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:37.119 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:37.114+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:37.174 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:37.168+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:37.203 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:37.197+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:37.623 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:37.617+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:37.664 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:37.657+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:37.878 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:37.873+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:38.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:38.133+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:38.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:38.139+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:38.163 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:38.157+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:38.199 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:38.192+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:38.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:38.656+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:38.667 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:38.661+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:38.893 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:38.883+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:39.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:39.147+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:39.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:39.154+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:39.170 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:39.163+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:39.204 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:39.199+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:39.648 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:39.642+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:39.660 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:39.653+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:39.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:39.899+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:40.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:40.152+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:40.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:40.164+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:40.184 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:40.177+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:40.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:40.202+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:40.613 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:40.608+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:40.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:40.684+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:40.950 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:40.944+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:41.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:41.152+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:41.183 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:41.176+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:41.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:41.180+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:41.220 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:41.212+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:41.600 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:41.593+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:41.675 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:41.667+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:41.965 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:41.959+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:42.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:42.132+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:42.147 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:42.140+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:42.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:42.187+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:42.257 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:42.249+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:42.580 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:42.575+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:42.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:42.665+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:42.937 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:42.933+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:43.148 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:43.141+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:43.159 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:43.153+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:43.196 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:43.188+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:43.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:43.268+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:43.534 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:43.528+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:43.696 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:43.688+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:43.938 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:43.932+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:44.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:44.131+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:44.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:44.137+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:44.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:44.195+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:44.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:44.289+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:44.526 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:44.521+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:44.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:44.706+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:44.895 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:44.890+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:45.151 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:45.144+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:45.152 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:45.148+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:45.221 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:45.210+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:45.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:45.270+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:45.501 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:45.494+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:45.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:45.700+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:45.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:45.889+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:46.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:46.118+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:46.191 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:46.186+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:46.211 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:46.204+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:46.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:46.260+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:46.558 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:46.548+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:46.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:46.670+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:46.908 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:46.902+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:47.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:47.125+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:47.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:47.237+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:47.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:47.238+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:47.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:47.254+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:47.563 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:47.557+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:47.662 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:47.654+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:47.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:47.875+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:48.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:48.090+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:48.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:48.236+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:48.264 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:48.256+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:48.272 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:48.265+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:48.581 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:48.575+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:48.640 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:48.633+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:48.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:48.845+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:49.139 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:49.130+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:49.229 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:49.222+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:49.268 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:49.263+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:49.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:49.291+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:49.553 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:49.547+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:49.608 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:49.600+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:49.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:49.807+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:50.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:50.173+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:50.260 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:50.252+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:50.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:50.258+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:50.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:50.265+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:50.511 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:50.507+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:50.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:50.618+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:50.840 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:50.836+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:51.192 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:51.186+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:51.288 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:51.282+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:51.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:51.285+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:51.301 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:51.297+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:51.530 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:51.525+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:51.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:51.664+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:51.815 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:51.811+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:52.150 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:52.143+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:03:52.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:03:52.302+0000 1694c700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:33.144166+0000 front 2019-11-29T17:02:33.528590+0000 (oldest deadline 2019-11-29T17:03:19.015098+0000) 2019-11-29T17:03:52.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:03:52.310+0000 1694c700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:36.972192+0000 front 2019-11-29T17:02:36.971006+0000 (oldest deadline 2019-11-29T17:03:21.628188+0000) 2019-11-29T17:03:52.338 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:03:52.334+0000 1694c700 -1 osd.1 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.548467+0000 front 2019-11-29T17:02:35.092155+0000 (oldest deadline 2019-11-29T17:03:18.393852+0000) 2019-11-29T17:03:52.486 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:03:52.481+0000 1694c700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.958052+0000 front 2019-11-29T17:02:37.955216+0000 (oldest deadline 2019-11-29T17:03:23.742466+0000) 2019-11-29T17:03:52.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:03:52.665+0000 1694c700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:32.778787+0000 front 2019-11-29T17:02:32.714983+0000 (oldest deadline 2019-11-29T17:03:18.594424+0000) 2019-11-29T17:03:52.801 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:03:52.786+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e284 v284) 2019-11-29T17:03:52.804 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:03:52.800+0000 1694c700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:37.077587+0000 front 2019-11-29T17:02:37.061091+0000 (oldest deadline 2019-11-29T17:03:21.720289+0000) 2019-11-29T17:03:53.107 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:03:53.102+0000 1694c700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:02:35.058041+0000 front 2019-11-29T17:02:35.046193+0000 (oldest deadline 2019-11-29T17:03:20.536572+0000) 2019-11-29T17:04:26.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:26.451+0000 124ad700 -1 osd.4 289 build_incremental_map_msg missing incremental map 289 2019-11-29T17:04:26.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:26.465+0000 114ab700 -1 osd.4 289 build_incremental_map_msg missing incremental map 289 2019-11-29T17:04:44.290 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:48:52.425 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.302 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:48:52.437 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.307 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:48:52.488 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.310 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:48:52.492 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.312 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:48:52.493 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.313 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:48:52.495 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.530 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:48:52.711 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.627 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:48:52.762 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:44.665 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:48:52.847 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:04:51.734 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:51.728+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:52.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:52.000+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:52.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:52.686+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:53.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:53.050+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:53.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:53.059+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:53.726 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:53.721+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:53.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:53.777+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:54.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:54.037+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:54.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:54.048+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:54.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:54.116+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:54.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:54.418+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:54.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:54.769+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:54.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:54.831+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:55.013 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:55.007+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:55.084 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:55.079+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:55.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:55.093+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:55.412 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:55.405+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:55.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:55.777+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:55.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:55.812+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:56.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:56.035+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:56.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:56.108+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:56.131 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:56.126+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:56.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:56.387+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:56.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:56.792+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:56.832 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:56.826+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:57.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:57.053+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:57.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:57.088+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:57.162 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:57.155+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:57.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:57.417+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:57.830 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:57.825+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:57.831 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:57.826+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:58.015 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:58.010+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:58.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:58.136+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:58.193 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:58.188+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:58.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:58.382+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:58.856 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:58.849+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:58.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:58.870+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:04:59.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:04:59.055+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:04:59.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:04:59.113+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:04:59.164 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:04:59.160+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:04:59.383 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:04:59.378+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:04:59.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:04:59.865+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:04:59.894 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:04:59.888+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:00.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:00.024+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:00.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:00.120+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:00.157 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:00.153+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:00.356 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:00.346+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:00.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:00.774+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:00.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:00.869+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:00.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:00.911+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:01.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:01.071+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:01.138 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:01.134+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:01.150 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:01.145+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:01.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:01.325+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:01.779 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:01.775+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:01.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:01.920+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:01.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:01.923+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:02.054 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:02.050+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:02.140 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:02.134+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:02.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:02.161+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:02.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:02.361+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:02.805 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:02.801+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:02.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:02.891+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:02.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:02.914+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:03.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:03.014+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:03.123 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:03.118+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:03.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:03.160+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:03.351 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:03.346+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:03.802 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:03.797+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:03.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:03.848+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:03.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:03.933+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:04.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:03.999+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:04.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:04.145+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:04.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:04.150+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:04.329 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:04.324+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:04.763 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:04.757+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:04.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:04.759+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:04.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:04.821+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:04.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:04.970+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:05.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:05.019+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:05.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:05.119+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:05.172 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:05.167+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:05.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:05.365+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:05.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:05.754+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:05.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:05.756+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:05.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:05.813+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:06.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:06.000+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:06.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:06.014+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:06.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:06.147+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:06.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:06.214+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:06.370 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:06.364+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:06.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:06.748+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:06.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:06.750+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:06.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:06.833+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:07.014 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:07.007+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:07.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:07.048+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:07.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:07.149+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:07.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:07.226+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:07.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:07.326+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:07.722 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:07.716+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:07.725 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:07.720+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:07.806 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:07.799+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:08.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:08.035+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:08.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:08.054+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:08.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:08.164+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:08.256 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:08.251+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:08.363 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:08.356+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:08.768 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:08.763+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:08.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:08.766+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:08.856 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:08.850+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:09.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:09.074+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:09.096 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:09.090+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:09.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:09.179+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:09.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:09.260+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:09.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:09.365+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:09.813 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:09.806+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:09.814 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:09.809+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:09.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:09.875+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:10.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:10.064+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:10.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:10.113+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:10.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:10.152+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:10.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:10.216+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:10.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:10.420+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:10.821 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:10.814+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:10.822 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:10.817+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:10.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:10.834+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:11.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:11.071+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:11.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:11.081+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:11.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:11.137+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:11.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:11.257+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:11.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:11.386+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:11.802 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:11.796+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:11.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:11.798+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:11.875 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:11.868+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:12.091 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:12.086+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:12.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:12.086+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:12.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:12.143+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:12.296 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:12.291+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:12.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:12.443+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:12.815 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:12.810+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:12.816 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:12.812+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:12.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:12.890+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:13.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:13.063+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:13.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:13.091+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:13.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:13.156+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:13.316 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:13.312+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:13.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:13.480+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:13.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:13.850+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:13.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:13.851+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:13.931 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:13.924+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:14.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:14.068+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:14.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:14.097+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:14.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:14.130+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:14.338 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:14.333+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:14.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:14.506+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:14.828 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:14.824+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:14.832 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:14.827+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:14.917 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:14.910+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:15.065 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:15.058+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:15.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:15.093+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:15.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:15.104+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:15.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:15.337+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:15.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:15.533+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:15.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:15.875+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:15.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:15.876+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:15.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:15.887+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:16.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:16.077+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:16.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:16.108+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:16.139 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:16.133+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:16.347 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:16.341+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:16.567 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:16.560+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:16.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:16.872+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:16.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:16.874+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:16.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:16.876+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:17.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:17.120+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:17.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:17.144+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:17.155 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:17.148+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:17.340 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:17.335+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:17.548 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:17.542+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:17.842 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:17.838+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:17.843 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:17.840+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:17.915 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:17.908+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:18.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:18.137+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:18.149 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:18.145+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:18.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:18.162+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:18.353 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:18.349+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:18.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:18.595+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:18.861 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:18.856+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:18.863 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:18.859+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:18.923 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:18.914+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:19.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:19.119+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:19.133 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:19.128+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:19.145 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:19.139+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:19.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:19.373+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:19.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:19.623+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:19.883 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:19.878+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:19.883 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:19.879+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:19.960 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:19.954+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:20.084 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:20.078+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:20.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:20.137+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:20.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:20.153+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:20.341 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:20.336+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:20.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:20.613+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:20.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:20.886+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:20.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:20.889+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:20.998 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:20.992+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:21.078 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:21.073+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:21.152 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:21.146+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:21.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:21.177+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:21.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:21.360+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:21.643 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:21.637+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:21.859 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:21.854+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:21.859 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:21.855+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:21.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:21.952+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:22.036 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:22.031+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:22.182 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:22.172+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:22.199 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:22.195+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:22.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:22.336+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:22.652 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:22.645+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:22.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:22.897+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:22.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:22.900+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:23.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:22.999+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:23.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:23.072+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:23.216 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:23.210+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:23.221 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:05:23.207+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e291 v291) 2019-11-29T17:05:23.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:23.224+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:23.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:23.334+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:23.652 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:23.647+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:23.859 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:23.853+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:23.860 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:23.856+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:23.997 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:23.991+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:24.069 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:24.063+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:24.182 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:24.176+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:24.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:24.253+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:24.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:24.356+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:24.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:24.681+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:24.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:24.888+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:24.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:24.889+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:25.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:25.035+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:25.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:25.071+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:25.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:25.136+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:25.298 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:25.293+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:25.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:25.374+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:25.682 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:25.677+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:25.859 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:25.855+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:25.861 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:25.858+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:26.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:26.058+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:26.086 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:26.081+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:26.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:26.175+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:26.263 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:26.259+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:26.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:26.327+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:26.676 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:26.668+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:26.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:26.891+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:26.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:26.893+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:27.045 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:27.039+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:27.076 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:27.070+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:27.167 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:27.162+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:27.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:27.244+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:27.293 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:27.288+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:27.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:27.715+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:27.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:27.914+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:27.920 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:27.916+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:28.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:28.066+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:28.099 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:28.093+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:28.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:28.173+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:28.232 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:05:28.228+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e291 v291) 2019-11-29T17:05:28.292 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:28.287+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:28.344 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:28.339+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:28.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:28.735+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:28.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:28.934+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:28.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:28.936+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:29.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:29.076+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:29.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:29.075+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:29.134 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:29.129+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:29.290 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:29.285+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:29.338 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:29.333+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:29.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:29.741+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:29.943 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:29.938+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:29.944 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:29.940+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:30.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:30.103+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:30.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:30.113+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:30.124 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:30.118+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:30.302 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:30.298+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:30.315 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:30.310+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:30.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:30.755+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:30.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:30.897+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:30.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:30.899+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:31.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:31.080+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:31.109 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:31.103+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:31.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:31.152+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:31.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:31.323+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:31.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:31.330+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:31.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:31.747+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:31.929 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:31.924+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:31.930 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:31.925+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:32.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:32.076+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:32.099 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:32.092+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:32.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:32.184+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:32.306 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:32.301+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:32.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:32.351+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:32.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:32.709+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:32.953 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:32.947+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:32.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:32.955+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:33.064 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:33.058+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:33.127 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:33.121+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:33.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:33.150+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:33.258 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:05:33.248+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e291 v291) 2019-11-29T17:05:33.344 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:33.339+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:33.389 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:33.383+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:33.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:33.709+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:33.932 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:33.928+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:33.933 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:33.929+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:34.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:34.086+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:34.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:34.110+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:34.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:34.183+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:34.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:34.356+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:34.398 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:34.392+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:34.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:34.748+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:34.973 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:34.968+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:34.973 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:34.969+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:35.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:35.064+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:35.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:35.152+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:35.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:35.192+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:35.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:35.373+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:35.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:35.434+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:35.720 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:35.713+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:36.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:36.011+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:36.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:36.014+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:36.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:36.116+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:36.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:36.194+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:36.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:36.199+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:36.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:36.361+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:36.467 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:36.462+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:36.742 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:36.735+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:36.995 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:36.988+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:36.996 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:36.989+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:37.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:37.133+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:37.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:37.181+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:37.247 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:37.238+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:37.329 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:37.323+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:37.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:37.455+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:05:37.769 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:05:37.763+0000 1694c700 -1 osd.5 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.416190+0000 front 2019-11-29T17:04:08.436461+0000 (oldest deadline 2019-11-29T17:04:54.260223+0000) 2019-11-29T17:05:38.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:38.013+0000 1694c700 -1 osd.0 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:04:24.076383+0000 (oldest deadline 2019-11-29T17:05:04.076383+0000) 2019-11-29T17:05:38.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:05:38.015+0000 1694c700 -1 osd.0 291 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e290) 2019-11-29T17:05:38.151 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:05:38.145+0000 1694c700 -1 osd.4 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:07.710427+0000 front 2019-11-29T17:04:07.680032+0000 (oldest deadline 2019-11-29T17:04:51.141053+0000) 2019-11-29T17:05:38.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:05:38.161+0000 1694c700 -1 osd.7 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.772523+0000 front 2019-11-29T17:04:09.842047+0000 (oldest deadline 2019-11-29T17:04:52.644543+0000) 2019-11-29T17:05:38.245 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:05:38.239+0000 1694c700 -1 osd.6 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.464478+0000 front 2019-11-29T17:04:08.465952+0000 (oldest deadline 2019-11-29T17:04:53.693502+0000) 2019-11-29T17:05:38.334 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:05:38.329+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e291 v291) 2019-11-29T17:05:38.351 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:05:38.344+0000 1694c700 -1 osd.2 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:08.379880+0000 front 2019-11-29T17:04:08.421788+0000 (oldest deadline 2019-11-29T17:04:53.673204+0000) 2019-11-29T17:05:38.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:05:38.429+0000 1694c700 -1 osd.1 291 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:04:09.546483+0000 front 2019-11-29T17:04:09.588722+0000 (oldest deadline 2019-11-29T17:04:51.675903+0000) 2019-11-29T17:07:05.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:05.014+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:05.983 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:07:05.973+0000 1694c700 -1 osd.4 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.397791+0000 front 2019-11-29T17:06:22.616604+0000 (oldest deadline 2019-11-29T17:07:05.863533+0000) 2019-11-29T17:07:06.005 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:05.999+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:06.059 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:06.052+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:06.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:06.756+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:06.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:06.871+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:06.952 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:07:06.945+0000 1694c700 -1 osd.4 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.397791+0000 front 2019-11-29T17:06:22.616604+0000 (oldest deadline 2019-11-29T17:07:05.863533+0000) 2019-11-29T17:07:06.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:06.969+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:07.068 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:07.062+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:07.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:07.389+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:07.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:07.719+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:07.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:07.918+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:07.923 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:07:07.916+0000 1694c700 -1 osd.4 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.397791+0000 front 2019-11-29T17:06:22.616604+0000 (oldest deadline 2019-11-29T17:07:05.863533+0000) 2019-11-29T17:07:07.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:07.950+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:08.114 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:08.110+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:08.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:08.430+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:08.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:08.708+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:08.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:08.915+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:08.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:07:08.954+0000 1694c700 -1 osd.4 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.397791+0000 front 2019-11-29T17:06:22.616604+0000 (oldest deadline 2019-11-29T17:07:05.863533+0000) 2019-11-29T17:07:09.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:08.999+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:09.158 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:09.151+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:09.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:09.388+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:09.699 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:09.692+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:09.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:09.914+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:09.980 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:09.973+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:10.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:07:10.000+0000 1694c700 -1 osd.4 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.397791+0000 front 2019-11-29T17:06:22.616604+0000 (oldest deadline 2019-11-29T17:07:05.863533+0000) 2019-11-29T17:07:10.177 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:10.172+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:10.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:10.378+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:10.749 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:10.744+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:10.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:10.876+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:10.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:10.981+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:11.215 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:11.210+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:11.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:11.402+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:11.749 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:11.742+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:11.870 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:11.865+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:12.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:12.034+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:12.213 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:12.208+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:12.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:12.436+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:12.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:12.767+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:12.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:12.916+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:13.002 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:12.995+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:13.260 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:13.253+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:13.424 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:13.418+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:13.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:13.728+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:13.968 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:13.959+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:14.038 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:14.029+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:14.237 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:14.232+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:14.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:14.427+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:14.703 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:14.697+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:14.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:14.984+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:15.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:15.031+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:15.212 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:15.206+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:15.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:15.430+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:15.671 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:15.663+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:16.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:15.995+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:16.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:16.039+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:16.190 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:16.184+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:16.406 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:16.398+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:16.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:16.677+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:16.979 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:16.972+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:17.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:17.054+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:17.197 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:17.191+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:17.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:17.416+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:17.671 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:17.666+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:17.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:17.985+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:18.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:18.022+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:18.222 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:18.216+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:18.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:18.461+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:18.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:18.677+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:18.979 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:18.974+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:19.001 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:18.994+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:19.229 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:19.222+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:19.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:19.477+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:19.719 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:19.712+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:19.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:19.938+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:20.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:20.026+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:20.279 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:20.274+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:20.488 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:20.483+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:20.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:20.668+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:20.921 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:20.914+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:20.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:20.980+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:21.287 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:21.276+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:21.514 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:21.508+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:21.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:21.682+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:21.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:21.962+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:21.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:21.975+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:22.303 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:22.298+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:22.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:22.485+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:22.652 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:22.645+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:22.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:22.966+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:23.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:22.999+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:23.346 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:23.339+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:23.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:23.456+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:23.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:23.681+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:23.931 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:23.924+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:23.979 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:23.973+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:24.339 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:24.334+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:24.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:24.416+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:24.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:24.641+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:24.898 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:24.892+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:24.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:24.982+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:25.385 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:25.379+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:25.410 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:25.402+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:25.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:25.628+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:25.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:25.903+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:26.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:26.033+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:26.347 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:26.340+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:26.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:26.387+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:26.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:26.621+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:26.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:26.892+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:27.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:27.040+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:27.301 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:27.297+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:27.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:27.415+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:27.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:27.640+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:27.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:27.856+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:28.114 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:28.024+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:28.269 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:28.264+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:28.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:28.397+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:28.641 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:28.633+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:28.876 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:28.868+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:28.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:28.988+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:29.293 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:29.286+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:29.415 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:29.410+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:29.644 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:29.637+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:29.911 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:29.903+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:29.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:29.977+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:30.258 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:30.253+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:30.395 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:30.390+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:30.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:30.616+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:30.914 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:30.906+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:30.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:30.966+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:31.278 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:31.273+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:31.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:31.403+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:31.642 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:31.635+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:31.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:31.939+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:31.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:31.979+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:32.326 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:32.321+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:32.400 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:32.393+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:32.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:32.678+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:32.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:32.909+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:32.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:32.989+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:33.302 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:33.297+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:33.410 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:33.405+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:33.713 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:33.705+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:33.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:33.933+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:34.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:34.028+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:34.324 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:34.319+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:34.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:34.444+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:34.673 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:34.666+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:34.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:34.934+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:35.030 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:35.025+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:35.321 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:35.316+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:35.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:35.417+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:35.718 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:35.712+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:35.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:35.898+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:36.072 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:36.050+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:36.327 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:36.321+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:36.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:36.446+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:36.711 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:36.703+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:36.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:36.858+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:37.035 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:37.029+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:37.367 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:37.360+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:37.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:37.400+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:37.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:37.674+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:37.769 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:07:37.762+0000 1694c700 -1 osd.5 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.150564+0000 front 2019-11-29T17:06:22.164028+0000 (oldest deadline 2019-11-29T17:07:37.503412+0000) 2019-11-29T17:07:37.893 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:07:37.887+0000 1694c700 -1 osd.6 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.673391+0000 front 2019-11-29T17:06:23.730962+0000 (oldest deadline 2019-11-29T17:07:04.751947+0000) 2019-11-29T17:07:38.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:07:38.035+0000 1694c700 -1 osd.1 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.918946+0000 front 2019-11-29T17:06:22.928137+0000 (oldest deadline 2019-11-29T17:07:06.127889+0000) 2019-11-29T17:07:38.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:07:38.371+0000 1694c700 -1 osd.3 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:23.474231+0000 front 2019-11-29T17:06:23.867710+0000 (oldest deadline 2019-11-29T17:07:05.756283+0000) 2019-11-29T17:07:38.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:38.391+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:07:38.646 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:07:38.640+0000 1694c700 -1 osd.7 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:20.768454+0000 front 2019-11-29T17:06:20.859337+0000 (oldest deadline 2019-11-29T17:07:05.991397+0000) 2019-11-29T17:07:38.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:07:38.780+0000 1694c700 -1 osd.5 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:22.150564+0000 front 2019-11-29T17:06:22.164028+0000 (oldest deadline 2019-11-29T17:07:37.503412+0000) 2019-11-29T17:07:38.810 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:07:38.803+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e296 v296) 2019-11-29T17:07:39.391 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:07:39.386+0000 1694c700 -1 osd.2 296 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:06:21.058448+0000 front 2019-11-29T17:06:21.065301+0000 (oldest deadline 2019-11-29T17:07:06.691089+0000) 2019-11-29T17:08:19.151 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:27.286 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.182 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:27.317 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.225 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:27.407 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.227 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:27.409 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.228 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:27.410 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.251 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:27.429 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.396 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:27.526 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.423 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:27.604 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:19.472 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:27.654 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:36.577 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:36.572+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:36.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:36.791+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:37.425 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:37.418+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:37.550 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:37.545+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:37.824 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:37.815+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:38.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:38.414+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:38.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:38.535+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:38.582 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:38.578+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:38.863 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:38.858+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:39.477 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:39.469+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:39.582 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:39.576+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:39.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:39.603+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:39.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:39.819+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:40.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:40.032+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:40.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:40.183+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:40.436 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:40.430+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:40.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:40.567+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:40.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:40.648+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:40.819 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:40.811+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:41.092 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:41.085+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:41.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:41.198+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:41.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:41.474+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:41.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:41.600+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:41.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:41.641+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:41.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:41.841+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:42.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:42.134+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:42.168 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:42.161+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:42.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:42.445+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:42.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:42.613+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:42.687 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:42.681+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:42.850 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:42.844+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:43.112 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:43.105+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:43.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:43.172+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:43.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:43.452+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:43.626 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:43.620+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:43.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:43.723+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:43.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:43.868+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:43.958 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:43.952+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:44.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:44.116+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:44.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:44.147+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:44.418 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:52.554 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:44.421+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:44.430 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:52.566 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.432 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:52.614 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.436 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:52.618 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.437 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:52.618 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.440 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:52.621 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.483 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:52:52.666 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.503 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:52:52.684 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.540 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:52:52.676 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:08:44.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:44.664+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:44.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:44.704+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:44.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:44.901+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:45.054 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:45.040+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:45.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:45.168+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:45.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:45.195+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:45.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:45.472+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:45.624 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:45.619+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:45.747 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:45.741+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:45.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:45.927+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:46.089 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:46.085+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:46.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:46.179+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:46.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:46.180+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:46.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:46.473+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:46.608 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:46.604+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:46.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:46.763+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:46.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:46.888+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:47.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:47.096+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:47.215 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:47.208+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:47.237 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:47.230+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:47.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:47.448+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:47.600 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:47.591+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:47.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:47.766+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:47.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:47.901+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:48.066 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:48.061+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:48.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:48.179+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:48.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:48.283+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:48.442 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:48.403+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:48.574 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:48.569+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:48.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:48.728+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:48.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:48.868+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:49.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:49.028+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:49.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:49.183+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:49.295 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:49.289+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:49.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:49.405+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:49.537 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:49.531+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:49.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:49.777+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:49.863 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:49.857+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:50.085 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:50.077+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:50.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:50.081+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:50.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:50.224+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:50.299 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:50.293+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:50.386 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:50.380+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:50.565 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:50.560+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:50.767 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:50.762+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:50.908 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:50.902+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:51.088 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:51.081+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:51.088 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:51.083+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:51.228 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:51.222+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:51.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:51.287+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:51.384 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:51.379+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:51.529 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:51.524+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:51.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:51.752+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:51.953 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:51.947+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:52.043 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:52.037+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:52.043 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:52.039+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:52.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:52.238+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:52.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:52.282+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:52.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:52.340+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:52.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:52.531+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:52.767 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:52.763+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:52.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:52.946+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:53.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:52.994+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:53.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:52.999+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:53.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:53.202+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:53.286 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:53.279+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:53.361 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:53.354+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:53.550 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:53.538+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:53.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:53.787+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:53.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:53.950+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:53.956 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:53.952+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:53.996 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:53.990+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:54.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:54.180+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:54.337 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:54.331+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:54.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:54.394+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:54.519 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:54.514+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:54.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:54.819+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:54.989 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:54.981+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:54.989 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:54.983+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:54.989 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:54.978+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:55.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:55.202+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:55.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:55.290+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:55.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:55.399+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:55.549 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:55.545+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:55.808 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:55.802+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:56.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:55.999+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:56.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:56.001+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:56.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:56.017+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:56.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:56.172+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:56.300 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:56.294+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:56.444 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:56.437+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:56.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:56.555+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:56.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:56.759+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:56.994 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:56.988+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:56.995 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:56.990+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:57.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:57.058+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:57.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:57.145+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:57.354 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:57.347+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:57.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:57.419+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:57.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:57.579+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:57.800 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:57.795+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:57.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:57.946+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:57.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:57.947+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:58.078 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:58.070+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:58.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:58.129+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:58.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:58.334+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:58.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:58.468+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:58.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:58.564+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:58.764 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:58.758+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:58.925 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:58.919+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:58.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:58.921+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:08:59.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:08:59.054+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:08:59.130 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:08:59.123+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:08:59.363 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:08:59.356+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:08:59.532 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:08:59.524+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:08:59.551 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:08:59.547+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:08:59.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:08:59.716+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:08:59.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:59.936+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:08:59.942 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:08:59.938+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:00.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:00.093+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:00.150 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:00.143+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:00.342 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:00.334+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:00.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:00.510+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:00.547 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:00.542+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:00.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:00.706+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:00.909 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:00.905+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:00.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:00.908+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:01.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:01.137+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:01.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:01.144+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:01.354 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:01.347+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:01.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:01.509+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:01.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:01.508+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:01.682 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:01.678+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:01.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:01.890+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:01.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:01.891+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:02.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:02.111+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:02.166 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:02.159+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:02.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:02.370+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:02.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:02.466+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:02.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:02.550+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:02.677 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:02.673+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:02.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:02.887+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:02.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:02.889+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:03.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:03.124+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:03.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:03.148+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:03.376 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:03.369+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:03.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:03.475+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:03.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:03.599+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:03.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:03.639+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:03.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:03.882+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:03.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:03.883+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:04.121 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:04.114+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:04.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:04.146+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:04.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:04.411+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:04.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:04.516+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:04.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:04.621+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:04.628 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:04.623+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:04.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:04.932+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:04.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:04.936+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:05.121 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:05.115+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:05.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:05.119+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:05.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:05.379+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:05.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:05.503+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:05.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:05.594+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:05.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:05.647+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:05.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:05.972+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:05.978 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:05.974+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:06.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:06.128+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:06.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:06.134+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:06.346 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:06.340+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:06.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:06.464+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:06.616 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:06.611+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:06.620 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:06.614+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:06.981 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:06.976+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:06.982 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:06.977+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:07.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:07.151+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:07.183 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:07.175+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:07.369 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:07.364+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:07.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:07.445+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:07.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:07.636+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:07.670 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:07.665+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:08.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:08.015+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:08.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:08.017+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:08.198 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:08.192+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:08.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:08.201+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:08.363 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:08.356+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:08.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:08.433+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:08.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:08.644+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:08.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:08.702+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:09.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:09.021+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:09.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:09.024+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:09.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:09.163+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:09.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:09.244+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:09.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:09.319+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:09.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:09.471+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:09.657 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:09.652+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:09.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:09.672+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:10.030 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:10.024+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:10.030 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:10.025+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:10.182 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:10.177+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:10.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:10.271+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:10.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:10.277+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:10.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:10.503+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:10.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:10.669+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:10.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:10.682+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:10.996 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:10.990+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:11.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:10.995+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:11.186 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:11.180+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:11.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:11.227+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:11.337 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:11.331+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:11.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:11.529+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:11.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:11.645+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:11.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:11.708+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:12.030 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:12.025+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:12.037 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:12.029+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:12.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:12.206+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:12.232 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:12.226+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:12.378 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:12.370+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:12.573 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:12.567+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:12.613 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:12.607+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:12.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:12.688+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:13.056 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:13.050+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:13.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:13.052+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:13.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:13.216+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:13.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:13.251+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:13.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:13.392+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:13.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:13.543+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:13.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:13.579+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:13.717 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:13.712+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:14.026 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:14.022+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:14.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:14.025+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:14.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:14.219+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:14.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:14.231+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:14.295 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:09:14.287+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e303 v303) 2019-11-29T17:09:14.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:14.412+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:14.511 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:14.505+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:14.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:14.591+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:14.754 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:14.749+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:15.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:14.999+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:15.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:15.000+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:15.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:15.243+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:15.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:15.251+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:15.390 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:15.384+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:15.483 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:15.477+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:15.602 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:15.598+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:15.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:15.763+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:15.976 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:15.971+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:15.976 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:15.972+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:16.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:16.258+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:16.310 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:16.304+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:16.395 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:16.389+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:16.532 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:16.526+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:16.648 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:16.644+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:16.790 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:16.785+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:17.015 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:17.009+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:17.016 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:17.011+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:17.313 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:17.306+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:17.351 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:17.346+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:17.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:17.374+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:17.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:17.487+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:17.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:17.668+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:17.755 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:17.749+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:18.056 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:18.051+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:18.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:18.055+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:18.342 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:18.337+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:18.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:18.382+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:18.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:18.397+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:18.527 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:18.520+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:18.628 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:18.623+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:18.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:09:18.765+0000 1694c700 -1 osd.1 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.256636+0000 front 2019-11-29T17:07:52.084900+0000 (oldest deadline 2019-11-29T17:08:35.936534+0000) 2019-11-29T17:09:19.030 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:19.025+0000 1694c700 -1 osd.0 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:08:10.061601+0000 (oldest deadline 2019-11-29T17:08:50.061601+0000) 2019-11-29T17:09:19.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:09:19.029+0000 1694c700 -1 osd.0 303 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e301) 2019-11-29T17:09:19.376 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:09:19.370+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e303 v303) 2019-11-29T17:09:19.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:09:19.379+0000 1694c700 -1 osd.7 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:56.045555+0000 front 2019-11-29T17:07:56.052985+0000 (oldest deadline 2019-11-29T17:08:39.569872+0000) 2019-11-29T17:09:19.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:19.413+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:19.429 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:19.424+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:19.485 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:09:19.480+0000 1694c700 -1 osd.6 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:52.278410+0000 front 2019-11-29T17:07:52.203016+0000 (oldest deadline 2019-11-29T17:08:36.880623+0000) 2019-11-29T17:09:19.630 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:19.624+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:09:20.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:09:20.390+0000 1694c700 -1 osd.5 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.406447+0000 front 2019-11-29T17:07:53.384808+0000 (oldest deadline 2019-11-29T17:08:39.261421+0000) 2019-11-29T17:09:20.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:09:20.473+0000 1694c700 -1 osd.4 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:53.514152+0000 front 2019-11-29T17:07:53.505947+0000 (oldest deadline 2019-11-29T17:08:36.370936+0000) 2019-11-29T17:09:20.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:09:20.666+0000 1694c700 -1 osd.2 303 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:07:55.699555+0000 front 2019-11-29T17:07:55.700126+0000 (oldest deadline 2019-11-29T17:08:38.499570+0000) 2019-11-29T17:10:53.283 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:53.276+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:53.503 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:53.496+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:53.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:53.512+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:53.840 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:53.833+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:54.149 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:54.129+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:54.300 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:54.289+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:54.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:54.496+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:54.523 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:54.517+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:54.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:54.841+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:55.136 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:55.127+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:55.303 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:55.292+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:55.495 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:55.488+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:55.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:55.531+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:55.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:10:55.751+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:10:55.827 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:55.820+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:56.119 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:56.115+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:56.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:56.328+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:56.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:56.456+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:56.573 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:56.567+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:56.741 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:10:56.734+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:10:56.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:56.860+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:57.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:10:57.026+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:10:57.113 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:57.108+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:57.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:57.359+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:57.422 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:57.414+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:57.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:57.567+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:57.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:10:57.765+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:10:57.900 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:57.893+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:58.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:10:58.077+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:10:58.145 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:58.135+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:58.354 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:58.348+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:58.447 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:58.431+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:58.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:58.530+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:58.802 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:10:58.795+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:10:58.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:58.936+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:10:59.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:10:59.067+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:10:59.161 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:10:59.156+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:10:59.384 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:10:59.380+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:10:59.410 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:10:59.400+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:10:59.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:10:59.537+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:10:59.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:10:59.823+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:10:59.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:10:59.960+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:00.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:00.118+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:00.151 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:00.146+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:00.348 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:00.341+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:00.420 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:00.413+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:00.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:00.525+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:00.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:00.788+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:00.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:00.968+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:01.167 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:01.159+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:01.175 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:01.170+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:01.379 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:01.374+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:01.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:01.455+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:01.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:01.526+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:01.811 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:01.805+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:02.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:02.001+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:02.192 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:02.188+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:02.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:02.212+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:02.367 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:02.362+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:02.442 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:02.433+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:02.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:02.529+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:02.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:02.839+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:03.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:03.032+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:03.191 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:03.187+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:03.197 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:03.193+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:03.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:03.411+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:03.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:03.443+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:03.583 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:03.576+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:03.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:03.888+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:04.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:04.076+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:04.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:04.143+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:04.221 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:04.216+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:04.420 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:04.414+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:04.500 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:04.494+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:04.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:04.574+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:04.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:04.891+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:05.123 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:05.116+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:05.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:05.171+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:05.247 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:05.242+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:05.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:05.449+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:05.519 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:05.513+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:05.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:05.558+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:05.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:05.890+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:06.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:06.172+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:06.204 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:06.198+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:06.239 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:06.233+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:06.470 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:06.465+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:06.516 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:06.510+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:06.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:06.539+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:06.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:06.852+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:07.181 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:07.176+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:07.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:07.196+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:07.254 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:07.248+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:07.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:07.508+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:07.527 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:07.519+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:07.555 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:07.548+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:07.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:07.813+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:08.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:08.191+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:08.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:08.226+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:08.290 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:08.286+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:08.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:08.463+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:08.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:08.520+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:08.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:08.526+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:08.799 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:08.792+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:09.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:09.150+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:09.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:09.228+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:09.283 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:09.277+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:09.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:09.424+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:09.539 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:09.531+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:09.551 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:09.536+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:09.824 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:09.817+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:10.190 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:10.185+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:10.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:10.191+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:10.309 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:10.304+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:10.466 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:10.461+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:10.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:10.542+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:10.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:10.578+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:10.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:10.826+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:11.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:11.205+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:11.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:11.225+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:11.304 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:11.297+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:11.433 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:11.426+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:11.514 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:11.506+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:11.613 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:11.606+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:11.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:11.869+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:12.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:12.237+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:12.255 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:12.247+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:12.273 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:12.262+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:12.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:12.471+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:12.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:12.534+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:12.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:12.570+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:12.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:12.873+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:13.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:13.194+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:13.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:13.218+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:13.302 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:13.297+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:13.507 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:13.501+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:13.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:13.549+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:13.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:13.554+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:13.855 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:13.848+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:14.182 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:14.174+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:14.228 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:14.223+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:14.361 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:14.346+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:14.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:14.543+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:14.576 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:14.569+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:14.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:14.596+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:14.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:14.898+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:15.182 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:15.177+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:15.221 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:15.213+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:15.321 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:15.315+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:15.600 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:15.595+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:15.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:15.622+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:15.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:15.643+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:15.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:15.854+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:16.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:16.206+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:16.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:16.207+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:16.294 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:16.289+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:16.602 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:16.598+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:16.655 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:16.647+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:16.657 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:16.649+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:16.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:16.823+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:17.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:17.165+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:17.179 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:17.170+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:17.249 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:17.244+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:17.605 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:17.598+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:17.616 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:17.609+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:17.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:17.693+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:17.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:17.833+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:18.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:18.134+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:18.213 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:18.206+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:18.238 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:18.232+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:18.567 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:18.559+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:18.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:18.605+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:18.742 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:18.736+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:18.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:18.793+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:19.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:19.121+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:19.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:19.225+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:19.275 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:19.270+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:19.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:19.565+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:19.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:19.573+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:19.764 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:19.753+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:19.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:19.770+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:20.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:20.133+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:20.261 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:20.255+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:20.267 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:20.261+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:20.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:20.574+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:20.588 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:20.581+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:20.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:20.749+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:20.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:20.767+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:21.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:21.107+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:21.252 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:21.247+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:21.312 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:21.306+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:21.613 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:21.607+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:21.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:21.613+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:21.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:21.723+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:21.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:21.802+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:22.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:22.088+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:22.259 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:22.252+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:22.345 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:22.340+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:22.576 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:22.568+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:22.643 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:22.638+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:22.700 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:22.693+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:22.778 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:22.771+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:23.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:23.072+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:23.225 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:23.219+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:23.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:23.366+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:23.539 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:23.532+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:23.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:23.650+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:23.721 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:23.713+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:23.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:23.738+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:24.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:24.129+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:24.265 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:24.258+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:24.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:24.374+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:24.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:24.505+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:24.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:24.672+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:24.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:24.705+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:24.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:24.768+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:25.033 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:11:25.029+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e310 v310) 2019-11-29T17:11:25.138 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:55:33.273 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.153 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:55:33.289 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:25.151+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:25.217 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:55:33.398 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.261 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:55:33.442 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.263 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:55:33.445 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.267 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:55:33.448 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:25.295+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:25.348 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:55:33.483 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.394 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:25.389+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:25.434 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:55:33.616 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.466 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:55:33.647 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:11:25.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:25.462+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:25.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:25.642+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:25.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:25.673+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:25.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:25.795+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:26.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:26.131+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:26.284 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:26.278+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:26.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:26.438+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:26.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:26.500+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:26.616 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:26.608+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:26.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:26.717+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:26.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:26.830+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:27.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:27.111+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:27.294 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:27.288+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:27.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:27.458+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:27.475 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:27.468+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:27.582 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:27.577+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:27.727 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:27.720+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:27.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:27.869+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:28.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:28.121+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:28.312 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:28.306+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:28.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:28.467+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:28.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:28.484+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:28.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:28.602+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:28.688 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:28.680+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:28.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:28.830+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:29.120 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:29.113+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:29.324 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:29.319+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:29.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:11:29.436+0000 1694c700 -1 osd.2 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.817737+0000 front 2019-11-29T17:10:11.842015+0000 (oldest deadline 2019-11-29T17:10:56.926928+0000) 2019-11-29T17:11:29.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:11:29.526+0000 1694c700 -1 osd.6 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.052419+0000 front 2019-11-29T17:10:08.315309+0000 (oldest deadline 2019-11-29T17:10:53.205761+0000) 2019-11-29T17:11:29.642 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:11:29.637+0000 1694c700 -1 osd.1 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.963420+0000 front 2019-11-29T17:10:07.956259+0000 (oldest deadline 2019-11-29T17:10:52.396762+0000) 2019-11-29T17:11:29.651 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:29.645+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:29.860 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:29.853+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:11:30.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:11:30.094+0000 1694c700 -1 osd.7 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:07.704185+0000 front 2019-11-29T17:10:07.973471+0000 (oldest deadline 2019-11-29T17:10:52.941921+0000) 2019-11-29T17:11:30.126 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:11:30.112+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e310 v310) 2019-11-29T17:11:30.341 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:11:30.305+0000 1694c700 -1 osd.3 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:08.999267+0000 front 2019-11-29T17:10:08.652244+0000 (oldest deadline 2019-11-29T17:10:53.194585+0000) 2019-11-29T17:11:30.633 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:11:30.601+0000 1694c700 -1 osd.4 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:12.036074+0000 front 2019-11-29T17:10:12.033437+0000 (oldest deadline 2019-11-29T17:10:54.897271+0000) 2019-11-29T17:11:30.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:11:30.875+0000 1694c700 -1 osd.5 310 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:10:11.230959+0000 front 2019-11-29T17:10:11.432723+0000 (oldest deadline 2019-11-29T17:10:52.654450+0000) 2019-11-29T17:12:28.900 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:28.894+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:29.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:29.879+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:29.958 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:29.952+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:30.124 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:30.119+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:30.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:30.222+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:30.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:30.264+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:30.863 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:30.857+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:30.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:30.913+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:30.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:30.982+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:31.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:31.088+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:31.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:31.245+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:31.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:31.250+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:31.360 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:31.354+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:31.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:31.826+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:31.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:31.918+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:32.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:31.998+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:32.081 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:32.076+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:32.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:32.213+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:32.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:32.253+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:32.318 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:32.312+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:32.884 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:32.877+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:32.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:32.970+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:33.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:33.021+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:33.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:33.097+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:33.241 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:33.235+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:33.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:33.275+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:33.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:33.324+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:33.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:33.882+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:33.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:33.944+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:34.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:34.048+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:34.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:34.055+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:34.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:34.199+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:34.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:34.282+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:34.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:34.327+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:34.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:34.925+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:34.978 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:34.973+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:35.035 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:35.031+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:35.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:35.095+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:35.211 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:35.204+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:35.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:35.296+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:35.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:35.329+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:35.957 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:35.951+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:35.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:35.986+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:36.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:36.057+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:36.111 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:36.106+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:36.171 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:36.166+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:36.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:36.282+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:36.382 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:36.376+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:36.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:36.910+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:36.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:36.977+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:37.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:37.022+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:37.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:37.024+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:37.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:37.072+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:37.164 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:37.158+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:37.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:37.297+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:37.345 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:37.339+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:37.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:37.935+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:37.978 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:37.972+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:38.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:38.031+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:38.042 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:38.036+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:38.043 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:38.038+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:38.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:38.168+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:38.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:38.265+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:38.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:38.324+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:38.912 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:38.904+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:38.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:38.992+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:39.027 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:39.022+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:39.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:39.029+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:39.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:39.030+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:39.183 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:39.175+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:39.278 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:39.270+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:39.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:39.349+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:39.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:39.914+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:40.042 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:40.035+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:40.043 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:40.038+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:40.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:40.042+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:40.056 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:40.050+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:40.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:40.207+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:40.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:40.298+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:40.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:40.343+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:40.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:40.961+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:41.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:41.026+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:41.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:41.064+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:41.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:41.081+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:41.087 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:41.082+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:41.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:41.238+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:41.308 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:41.301+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:41.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:41.365+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:41.571 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:56:49.706 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.577 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:56:49.713 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.592 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:56:49.774 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.594 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:56:49.776 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.600 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:56:49.781 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.602 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:56:49.784 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.718 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:05:56:49.853 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.758 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:05:56:49.939 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.773 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:05:56:49.954 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:12:41.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:41.986+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:42.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:42.033+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:42.044 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:42.039+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:42.045 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:42.041+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:42.083 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:42.078+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:42.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:42.246+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:42.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:42.315+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:42.348 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:42.342+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:42.957 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:42.950+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:43.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:43.012+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:43.085 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:43.080+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:43.087 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:43.083+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:43.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:43.098+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:43.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:43.256+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:43.293 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:43.287+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:43.330 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:43.324+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:43.934 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:43.927+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:43.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:43.987+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:44.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:44.066+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:44.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:44.068+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:44.091 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:44.086+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:44.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:44.269+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:44.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:44.281+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:44.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:44.294+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:44.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:44.945+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:44.985 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:44.978+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:45.050 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:45.044+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:45.051 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:45.046+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:45.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:45.084+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:45.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:45.266+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:45.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:45.298+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:45.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:45.334+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:45.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:45.929+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:45.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:45.988+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:46.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:46.014+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:46.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:46.016+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:46.077 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:46.071+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:46.290 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:46.283+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:46.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:46.352+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:46.374 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:46.367+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:46.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:46.922+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:46.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:46.993+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:47.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:46.996+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:47.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:47.020+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:47.124 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:47.119+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:47.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:47.278+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:47.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:47.350+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:47.399 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:47.392+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:47.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:47.890+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:48.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:47.998+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:48.006 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:48.001+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:48.012 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:48.005+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:48.139 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:48.134+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:48.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:48.326+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:48.360 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:48.354+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:48.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:48.355+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:48.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:48.871+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:49.046 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:49.040+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:49.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:49.042+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:49.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:49.052+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:49.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:49.165+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:49.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:49.323+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:49.350 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:49.343+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:49.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:49.369+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:49.884 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:49.877+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:50.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:50.029+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:50.037 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:50.032+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:50.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:50.069+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:50.145 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:50.141+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:50.350 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:50.340+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:50.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:50.341+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:50.371 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:50.365+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:50.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:50.877+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:51.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:51.051+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:51.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:51.057+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:51.063 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:51.058+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:51.124 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:51.120+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:51.334 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:51.328+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:51.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:51.356+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:51.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:51.374+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:51.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:51.910+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:52.095 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:52.090+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:52.098 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:52.094+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:52.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:52.099+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:52.120 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:52.115+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:52.328 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:52.323+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:52.339 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:52.334+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:52.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:52.399+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:52.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:52.876+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:53.085 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:53.079+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:53.112 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:53.105+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:53.112 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:53.108+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:53.155 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:53.150+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:53.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:53.316+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:53.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:53.385+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:53.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:53.407+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:53.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:53.857+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:54.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:54.044+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:54.160 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:54.154+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:54.161 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:54.156+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:54.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:54.180+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:54.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:54.353+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:54.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:54.375+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:54.431 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:54.425+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:54.850 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:54.843+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:55.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:54.998+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:55.147 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:55.140+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:55.149 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:55.142+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:55.220 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:55.215+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:55.313 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:55.307+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:55.360 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:55.354+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:55.388 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:55.382+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:55.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:55.839+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:55.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:55.988+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:56.179 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:56.175+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:56.192 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:56.186+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:56.192 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:56.188+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:56.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:56.324+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:56.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:56.326+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:56.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:56.350+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:56.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:56.880+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:56.972 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:56.966+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:57.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:57.172+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:57.196 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:57.190+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:57.196 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:57.192+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:57.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:57.326+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:57.339 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:57.332+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:57.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:57.345+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:57.888 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:57.882+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:57.980 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:57.976+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:58.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:58.176+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:58.221 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:58.215+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:58.222 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:58.217+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:58.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:58.322+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:58.382 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:58.376+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:58.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:58.377+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:58.873 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:58.866+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:12:58.965 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:12:58.960+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:12:59.190 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:59.184+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:12:59.191 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:12:59.186+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:12:59.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:12:59.207+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:12:59.379 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:12:59.373+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:12:59.392 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:12:59.386+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:12:59.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:12:59.387+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:12:59.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:12:59.855+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:00.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:00.001+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:00.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:00.183+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:00.226 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:00.221+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:00.227 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:00.223+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:00.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:00.350+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:00.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:00.357+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:00.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:00.385+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:00.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:00.896+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:00.989 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:00.983+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:01.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:01.143+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:01.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:01.256+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:01.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:01.258+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:01.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:01.364+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:01.410 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:01.405+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:01.442 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:01.437+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:01.897 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:01.890+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:01.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:01.988+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:02.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:02.136+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:02.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:02.247+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:02.255 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:02.249+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:02.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:02.329+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:02.418 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:02.412+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:02.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:02.470+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:02.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:02.942+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:02.994 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:02.989+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:03.161 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:03.156+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:03.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:03.249+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:03.256 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:03.252+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:03.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:03.310+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:03.459 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:03.453+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:03.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:03.502+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:03.981 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:03.968+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:03.989 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:03.982+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:04.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:04.150+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:04.236 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:04.230+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:04.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:04.232+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:04.346 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:04.339+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:04.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:04.479+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:04.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:04.482+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:04.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:04.929+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:05.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:05.010+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:05.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:05.115+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:05.268 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:05.261+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:05.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:05.264+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:05.394 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:05.387+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:05.458 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:05.452+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:05.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:05.480+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:05.520 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:13:05.514+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e316 v316) 2019-11-29T17:13:05.910 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:05.906+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:06.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:06.008+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:06.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:06.103+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:06.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:06.252+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:06.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:06.256+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:06.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:06.425+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:06.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:06.433+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:06.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:06.513+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:06.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:06.886+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:06.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:06.972+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:07.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:07.152+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:07.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:07.218+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:07.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:07.220+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:07.455 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:07.448+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:07.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:07.470+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:07.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:07.529+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:07.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:07.903+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:07.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:07.930+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:08.190 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:08.184+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:08.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:08.206+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:08.214 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:08.209+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:08.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:08.455+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:08.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:08.475+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:08.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:08.553+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:08.920 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:08.915+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:08.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:08.969+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:09.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:09.152+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:09.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:09.210+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:09.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:09.215+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:09.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:09.429+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:09.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:09.480+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:09.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:09.590+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:09.950 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:09.945+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:10.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:10.019+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:10.184 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:13:10.178+0000 1694c700 -1 osd.1 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:42.106528+0000 front 2019-11-29T17:11:42.118982+0000 (oldest deadline 2019-11-29T17:12:27.909266+0000) 2019-11-29T17:13:10.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:10.255+0000 1694c700 -1 osd.0 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:11:56.856471+0000 (oldest deadline 2019-11-29T17:12:36.856471+0000) 2019-11-29T17:13:10.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:13:10.257+0000 1694c700 -1 osd.0 316 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e314) 2019-11-29T17:13:10.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:13:10.404+0000 1694c700 -1 osd.7 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.348483+0000 front 2019-11-29T17:11:45.388033+0000 (oldest deadline 2019-11-29T17:12:31.219682+0000) 2019-11-29T17:13:10.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:13:10.528+0000 1694c700 -1 osd.4 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:46.782080+0000 front 2019-11-29T17:11:47.132057+0000 (oldest deadline 2019-11-29T17:12:29.668247+0000) 2019-11-29T17:13:10.599 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:13:10.586+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e316 v316) 2019-11-29T17:13:10.620 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:13:10.615+0000 1694c700 -1 osd.5 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.918170+0000 front 2019-11-29T17:11:48.074797+0000 (oldest deadline 2019-11-29T17:12:29.838706+0000) 2019-11-29T17:13:10.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:13:10.901+0000 1694c700 -1 osd.2 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:45.326953+0000 front 2019-11-29T17:11:45.345989+0000 (oldest deadline 2019-11-29T17:12:29.842668+0000) 2019-11-29T17:13:11.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:13:11.007+0000 1694c700 -1 osd.6 316 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:11:47.132158+0000 front 2019-11-29T17:11:47.119677+0000 (oldest deadline 2019-11-29T17:12:30.639333+0000) 2019-11-29T17:13:46.982 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:46.950+0000 34f8a700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:13:47.238 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:47.179+0000 31783700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:13:47.259 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:47.217+0000 114ab700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:13:47.581 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:47.469+0000 34f8a700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:13:47.683 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:47.581+0000 30f82700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:13:47.950 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:13:47.834+0000 34f8a700 -1 osd.3 322 build_incremental_map_msg missing incremental map 322 2019-11-29T17:14:44.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:44.413+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:44.992 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:44.988+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:45.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:45.277+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:45.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:45.466+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:46.020 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:46.014+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:46.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:46.289+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:46.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:46.514+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:46.595 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:46.589+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:46.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:46.661+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:47.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:47.034+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:47.290 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:47.282+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:47.554 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:47.546+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:47.648 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:47.642+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:47.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:47.662+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:47.816 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:47.811+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:48.013 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:48.008+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:48.290 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:48.276+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:48.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:48.561+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:48.643 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:48.638+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:48.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:48.700+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:48.839 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:48.834+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:48.985 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:48.979+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:49.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:49.250+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:49.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:49.526+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:49.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:49.686+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:49.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:49.724+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:49.815 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:49.809+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:50.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:50.000+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:50.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:50.210+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:50.538 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:50.531+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:50.695 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:50.687+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:50.747 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:50.741+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:50.843 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:50.837+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:50.984 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:50.974+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:51.177 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:51.170+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:51.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:51.505+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:51.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:51.722+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:51.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:51.781+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:51.797 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:51.793+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:52.027 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:52.021+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:52.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:52.151+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:52.544 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:52.537+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:52.715 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:52.708+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:52.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:52.757+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:52.772 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:52.766+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:53.079 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:53.074+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:53.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:53.135+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:53.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:53.565+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:53.695 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:53.688+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:53.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:53.757+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:53.778 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:53.773+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:54.121 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:54.116+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:54.136 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:54.128+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:54.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:54.553+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:54.673 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:54.663+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:54.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:54.729+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:54.752 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:54.747+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:55.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:14:54.999+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:14:55.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:55.105+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:55.168 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:55.163+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:55.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:55.510+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:55.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:55.628+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:55.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:55.686+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:55.715 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:55.710+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:56.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:14:56.014+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:14:56.124 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:56.117+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:56.148 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:56.142+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:56.544 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:56.537+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:56.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:56.626+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:56.647 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:56.643+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:56.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:56.754+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:57.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:14:57.061+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:14:57.106 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:57.098+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:57.117 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:57.112+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:57.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:57.591+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:57.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:57.634+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:57.642 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:57.634+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:57.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:57.782+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:58.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:58.065+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:58.085 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:58.080+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:58.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:14:58.078+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:14:58.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:58.629+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:58.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:58.644+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:58.698 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:58.687+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:58.794 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:58.788+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:14:59.077 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:14:59.069+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:14:59.079 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:14:59.074+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:14:59.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:14:59.086+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:14:59.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:14:59.625+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:14:59.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:14:59.671+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:14:59.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:14:59.717+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:14:59.833 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:14:59.826+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:00.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:00.038+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:00.049 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:00.043+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:00.088 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:00.080+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:00.603 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:00.594+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:00.721 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:00.713+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:00.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:00.717+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:00.835 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:00.829+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:01.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:01.039+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:01.054 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:01.049+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:01.066 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:01.059+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:01.571 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:01.563+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:01.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:01.725+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:01.759 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:01.754+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:01.879 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:01.872+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:02.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:02.013+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:02.097 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:02.090+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:02.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:02.107+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:02.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:02.565+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:02.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:02.697+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:02.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:02.727+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:02.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:02.909+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:03.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:03.014+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:03.114 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:03.105+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:03.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:03.148+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:03.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:03.552+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:03.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:03.739+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:03.764 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:03.758+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:03.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:03.891+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:04.079 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:04.071+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:04.120 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:04.115+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:04.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:04.153+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:04.551 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:04.545+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:04.710 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:04.703+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:04.717 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:04.712+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:04.857 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:04.852+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:05.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:05.113+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:05.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:05.125+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:05.151 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:05.145+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:05.591 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:05.584+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:05.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:05.679+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:05.749 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:05.744+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:05.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:05.849+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:06.137 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:06.128+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:06.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:06.133+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:06.170 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:06.164+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:06.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:06.600+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:06.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:06.687+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:06.751 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:06.745+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:06.891 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:06.886+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:07.119 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:07.111+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:07.126 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:07.119+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:07.135 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:07.127+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:07.589 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:07.578+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:07.705 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:07.698+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:07.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:07.751+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:07.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:07.842+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:08.110 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:08.105+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:08.111 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:08.104+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:08.116 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:08.110+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:08.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:08.622+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:08.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:08.675+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:08.757 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:08.747+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:08.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:08.817+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:09.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:09.118+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:09.127 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:09.122+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:09.142 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:09.135+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:09.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:09.631+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:09.653 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:09.646+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:09.726 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:09.721+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:09.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:09.780+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:10.129 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:10.122+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:10.133 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:10.128+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:10.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:10.159+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:10.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:10.618+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:10.660 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:10.653+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:10.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:10.708+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:10.748 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:10.742+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:11.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:11.100+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:11.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:11.136+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:11.157 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:11.152+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:11.591 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:11.583+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:11.714 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:11.702+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:11.726 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:11.719+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:11.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:11.768+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:12.099 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:12.092+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:12.109 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:12.103+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:12.195 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:12.190+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:12.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:12.600+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:12.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:12.718+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:12.759 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:12.753+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:12.767 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:12.760+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:13.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:13.062+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:13.136 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:13.130+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:13.239 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:13.233+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:13.639 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:13.632+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:13.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:13.718+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:13.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:13.755+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:13.771 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:13.762+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:14.056 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:14.049+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:14.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:14.155+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:14.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:14.284+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:14.661 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:14.655+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:14.708 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:14.702+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:14.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:14.712+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:14.761 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:14.754+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:15.085 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:15.078+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:15.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:15.139+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:15.326 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:15.322+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:15.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:15.643+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:15.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:15.718+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:15.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:15.723+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:15.778 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:15.770+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:16.109 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:16.102+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:16.119 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:16.113+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:16.304 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:16.298+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:16.628 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:16.621+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:16.720 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:16.716+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:16.747 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:16.741+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:16.781 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:16.774+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:17.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:17.076+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:17.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:17.161+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:17.339 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:17.334+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:17.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:17.599+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:17.769 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:17.761+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:17.791 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:17.786+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:17.799 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:17.793+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:18.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:18.091+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:18.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:18.159+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:18.322 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:18.316+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:18.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:18.626+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:18.808 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:18.802+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:18.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:18.808+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:18.838 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:18.830+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:19.115 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:19.108+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:19.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:19.149+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:19.277 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:19.272+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:19.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:19.592+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:19.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:19.781+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:19.859 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:19.852+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:19.882 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:19.872+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:20.130 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:20.124+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:20.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:20.133+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:20.258 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:20.254+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:20.640 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:15:20.634+0000 1694c700 -1 osd.6 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.529944+0000 front 2019-11-29T17:14:00.527759+0000 (oldest deadline 2019-11-29T17:14:43.828512+0000) 2019-11-29T17:15:20.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:20.766+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:20.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:15:20.877+0000 1694c700 -1 osd.1 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:03.295836+0000 front 2019-11-29T17:14:03.569137+0000 (oldest deadline 2019-11-29T17:14:47.374796+0000) 2019-11-29T17:15:20.883 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:15:20.877+0000 1694c700 -1 osd.7 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.210104+0000 front 2019-11-29T17:14:02.207161+0000 (oldest deadline 2019-11-29T17:14:45.816490+0000) 2019-11-29T17:15:21.064 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:15:21.058+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e322 v322) 2019-11-29T17:15:21.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:15:21.139+0000 1694c700 -1 osd.4 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:00.421543+0000 front 2019-11-29T17:14:00.449445+0000 (oldest deadline 2019-11-29T17:14:44.284922+0000) 2019-11-29T17:15:21.184 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:15:21.179+0000 1694c700 -1 osd.5 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.615225+0000 front 2019-11-29T17:14:02.708139+0000 (oldest deadline 2019-11-29T17:14:54.722407+0000) 2019-11-29T17:15:21.270 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:21.261+0000 1694c700 -1 osd.3 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:13:59.555807+0000 front 2019-11-29T17:13:59.544020+0000 (oldest deadline 2019-11-29T17:14:44.200545+0000) 2019-11-29T17:15:21.790 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:15:21.785+0000 1694c700 -1 osd.2 322 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:14:02.972825+0000 front 2019-11-29T17:14:02.927581+0000 (oldest deadline 2019-11-29T17:14:45.628392+0000) 2019-11-29T17:15:54.202 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:15:54.105+0000 30f82700 -1 osd.3 327 build_incremental_map_msg missing incremental map 327 2019-11-29T17:16:18.394 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:18.388+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:18.857 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:18.850+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:19.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:19.424+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:19.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:19.892+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:20.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:20.391+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:20.440 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:20.435+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:20.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:20.480+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:20.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:20.910+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:21.406 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:21.401+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:21.448 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:21.440+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:21.459 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:21.452+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:21.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:21.874+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:22.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:22.125+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:22.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:22.400+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:22.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:22.449+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:22.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:22.455+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:22.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:22.490+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:22.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:22.675+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:22.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:22.854+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:23.103 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:23.098+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:23.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:23.357+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:23.424 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:23.419+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:23.452 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:23.444+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:23.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:23.543+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:23.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:23.631+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:23.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:23.860+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:24.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:24.055+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:24.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:24.393+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:24.464 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:24.459+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:24.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:24.470+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:24.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:24.577+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:24.655 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:24.649+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:24.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:24.825+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:25.111 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:25.107+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:25.360 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:25.355+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:25.431 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:25.425+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:25.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:25.500+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:25.567 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:25.559+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:25.647 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:25.640+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:25.839 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:25.832+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:26.136 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:26.131+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:26.313 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:26.308+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:26.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:26.464+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:26.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:26.518+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:26.619 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:26.611+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:26.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:26.656+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:26.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:26.884+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:27.179 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:27.175+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:27.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:27.356+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:27.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:27.476+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:27.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:27.511+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:27.659 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:27.652+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:27.671 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:27.664+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:27.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:27.863+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:28.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:28.197+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:28.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:28.319+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:28.440 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:28.433+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:28.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:28.550+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:28.659 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:28.652+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:28.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:28.653+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:28.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:28.841+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:29.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:29.246+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:29.255 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:29.248+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:29.310 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:29.305+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:29.469 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:29.461+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:29.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:29.542+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:29.669 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:29.662+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:29.689 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:29.681+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:29.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:29.852+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:30.239 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:30.233+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:30.241 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:30.237+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:30.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:30.278+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:30.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:30.475+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:30.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:30.567+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:30.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:30.643+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:30.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:30.646+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:30.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:30.851+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:31.245 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:31.240+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:31.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:31.243+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:31.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:31.319+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:31.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:31.477+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:31.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:31.563+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:31.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:31.603+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:31.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:31.684+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:31.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:31.862+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:32.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:32.291+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:32.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:32.295+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:32.344 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:32.339+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:32.459 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:32.453+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:32.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:32.568+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:32.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:32.639+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:32.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:32.720+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:32.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:32.898+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:33.330 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:33.324+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:33.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:33.327+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:33.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:33.330+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:33.472 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:33.465+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:33.597 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:33.591+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:33.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:33.643+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:33.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:33.742+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:33.894 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:33.887+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:34.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:34.314+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:34.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:34.316+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:34.349 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:34.343+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:34.495 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:34.489+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:34.600 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:34.594+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:34.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:34.616+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:34.784 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:34.778+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:34.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:34.864+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:35.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:35.283+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:35.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:35.284+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:35.310 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:35.305+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:35.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:35.479+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:35.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:35.632+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:35.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:35.646+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:35.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:35.810+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:35.873 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:35.867+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:36.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:36.314+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:36.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:36.318+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:36.345 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:36.339+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:36.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:36.499+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:36.625 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:36.618+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:36.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:36.678+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:36.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:36.836+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:36.870 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:36.863+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:37.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:37.286+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:37.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:37.288+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:37.300 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:37.295+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:37.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:37.519+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:37.660 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:37.656+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:37.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:37.698+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:37.840 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:37.834+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:37.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:37.848+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:38.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:38.313+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:38.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:38.314+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:38.345 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:38.340+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:38.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:38.542+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:38.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:38.679+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:38.689 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:38.684+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:38.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:38.839+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:38.872 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:38.865+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:39.323 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:39.317+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:39.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:39.320+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:39.331 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:39.325+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:39.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:39.569+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:39.698 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:39.691+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:39.698 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:39.692+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:39.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:39.853+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:39.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:39.885+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:40.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:40.321+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:40.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:40.323+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:40.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:40.372+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:40.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:40.541+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:40.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:40.728+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:40.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:40.737+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:40.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:40.880+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:40.890 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:40.883+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:41.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:41.352+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:41.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:41.353+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:41.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:41.391+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:41.571 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:49.706 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.584 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:49.720 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:41.587+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:41.600 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:49.781 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.640 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:49.821 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.648 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:49.830 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.663 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:49.844 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:41.707+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:41.740 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:41.735+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:41.805 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:49.939 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:41.841+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:41.871 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:50.053 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:41.873 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:41.868+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:41.937 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:50.118 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:42.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:42.351+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:42.391 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:42.385+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:42.392 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:42.387+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:42.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:42.611+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:42.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:42.729+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:42.744 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:42.735+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:42.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:42.840+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:42.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:42.863+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:43.322 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:43.318+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:43.364 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:43.360+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:43.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:43.361+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:43.437 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:51.572 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.445 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:51.580 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.451 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:51.633 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.455 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:51.637 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.499 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:00:51.635 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.500 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:51.681 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.501 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:00:51.683 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.503 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:51.684 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.530 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:00:51.711 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:16:43.604 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:43.599+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:43.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:43.737+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:43.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:43.785+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:43.846 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:43.840+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:43.880 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:43.873+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:44.277 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:44.272+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:44.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:44.335+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:44.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:44.336+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:44.571 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:44.566+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:44.701 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:44.696+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:44.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:44.815+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:44.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:44.815+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:44.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:44.844+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:45.303 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:45.297+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:45.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:45.350+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:45.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:45.353+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:45.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:45.556+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:45.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:45.673+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:45.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:45.772+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:45.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:45.793+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:45.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:45.820+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:46.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:46.292+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:46.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:46.401+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:46.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:46.404+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:46.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:46.559+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:46.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:46.642+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:46.791 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:46.784+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:46.791 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:46.785+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:46.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:46.791+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:47.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:47.327+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:47.411 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:47.405+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:47.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:47.407+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:47.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:47.533+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:47.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:47.669+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:47.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:47.750+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:47.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:47.767+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:47.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:47.827+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:48.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:48.344+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:48.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:48.406+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:48.413 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:48.408+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:48.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:48.551+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:48.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:48.720+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:48.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:48.739+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:48.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:48.807+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:48.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:48.828+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:49.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:49.356+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:49.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:49.360+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:49.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:49.363+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:49.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:49.563+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:49.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:49.723+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:49.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:49.753+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:49.768 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:49.762+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:49.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:49.793+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:50.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:50.352+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:50.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:50.355+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:50.410 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:50.404+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:50.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:50.589+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:50.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:50.751+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:50.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:50.770+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:50.805 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:50.797+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:50.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:50.798+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:51.372 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:51.366+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:51.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:51.400+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:51.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:51.401+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:51.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:51.576+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:51.603 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:16:51.589+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e328 v328) 2019-11-29T17:16:51.772 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:51.766+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:51.780 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:51.773+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:51.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:51.775+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:51.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:51.826+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:52.351 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:52.345+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:52.379 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:52.371+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:52.380 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:52.375+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:52.572 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:52.566+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:52.747 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:52.740+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:52.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:52.744+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:52.759 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:52.753+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:52.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:52.806+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:53.370 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:53.365+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:53.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:53.406+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:53.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:53.407+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:53.624 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:53.618+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:53.737 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:53.726+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:53.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:53.757+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:53.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:53.768+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:53.796 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:53.791+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:54.401 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:54.395+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:54.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:54.456+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:54.464 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:54.459+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:54.593 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:54.588+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:54.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:54.726+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:54.772 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:54.765+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:54.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:54.792+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:54.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:54.818+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:55.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:55.373+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:55.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:55.439+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:55.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:55.444+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:55.642 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:55.636+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:55.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:55.714+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:55.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:55.743+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:55.785 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:55.779+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:55.818 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:55.813+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:56.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:56.352+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:56.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:56.489+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:56.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:56.491+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:56.609 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:16:56.602+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e328 v328) 2019-11-29T17:16:56.693 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:56.688+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:56.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:56.743+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:56.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:56.745+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:56.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:56.761+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:56.828 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:56.823+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:57.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:57.351+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:57.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:57.447+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:57.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:57.448+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:57.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:57.659+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:57.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:57.751+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:57.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:57.794+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:57.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:57.793+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:57.810 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:57.804+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:58.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:58.333+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:58.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:58.453+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:58.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:58.455+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:58.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:58.710+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:58.755 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:58.748+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:58.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:58.780+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:58.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:58.788+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:58.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:58.806+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:16:59.308 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:16:59.303+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:16:59.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:59.461+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:16:59.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:16:59.465+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:16:59.734 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:16:59.727+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:16:59.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:16:59.751+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:16:59.759 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:16:59.752+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:16:59.781 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:16:59.776+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:16:59.855 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:16:59.849+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:17:00.326 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:17:00.321+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:17:00.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:17:00.500+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:17:00.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:17:00.502+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:17:00.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:17:00.735+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:17:00.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:17:00.750+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:17:00.757 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:17:00.750+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:17:00.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:17:00.753+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:17:00.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:17:00.855+0000 1694c700 -1 osd.6 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:34.121542+0000 front 2019-11-29T17:15:34.107937+0000 (oldest deadline 2019-11-29T17:16:18.793889+0000) 2019-11-29T17:17:01.281 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:17:01.275+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:17:01.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:17:01.551+0000 1694c700 -1 osd.0 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:15:48.676788+0000 (oldest deadline 2019-11-29T17:16:28.676788+0000) 2019-11-29T17:17:01.557 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:17:01.553+0000 1694c700 -1 osd.0 328 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e326) 2019-11-29T17:17:01.688 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:17:01.675+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e328 v328) 2019-11-29T17:17:01.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:17:01.698+0000 1694c700 -1 osd.4 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.744424+0000 front 2019-11-29T17:15:37.582473+0000 (oldest deadline 2019-11-29T17:16:22.257084+0000) 2019-11-29T17:17:01.728 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:17:01.722+0000 1694c700 -1 osd.1 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.257319+0000 front 2019-11-29T17:15:36.257589+0000 (oldest deadline 2019-11-29T17:16:22.085506+0000) 2019-11-29T17:17:01.760 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:17:01.755+0000 1694c700 -1 osd.7 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.324604+0000 front 2019-11-29T17:15:36.323582+0000 (oldest deadline 2019-11-29T17:16:19.762463+0000) 2019-11-29T17:17:01.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:17:01.750+0000 1694c700 -1 osd.5 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:36.144135+0000 front 2019-11-29T17:15:36.175490+0000 (oldest deadline 2019-11-29T17:16:19.559389+0000) 2019-11-29T17:17:02.284 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:17:02.279+0000 1694c700 -1 osd.2 328 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:15:37.116938+0000 front 2019-11-29T17:15:37.926125+0000 (oldest deadline 2019-11-29T17:16:17.897912+0000) 2019-11-29T17:17:27.244 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:27.219+0000 38791700 -1 osd.3 328 build_incremental_map_msg missing incremental map 327 2019-11-29T17:17:32.723 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:32.673+0000 34f8a700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:32.874 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:32.820+0000 30f82700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:32.923 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:32.871+0000 11cac700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:32.999 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:32.952+0000 3578b700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:33.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:33.010+0000 3578b700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:33.080 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:33.053+0000 33787700 -1 osd.3 333 build_incremental_map_msg missing incremental map 333 2019-11-29T17:17:34.611 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:17:34.605+0000 30f82700 -1 osd.3 334 build_incremental_map_msg missing incremental map 333 2019-11-29T17:18:32.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:32.797+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:32.844 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:32.839+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:33.032 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:33.027+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:33.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:33.419+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:33.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:33.773+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:33.815 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:33.809+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:34.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:34.000+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:34.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:34.455+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:34.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:34.766+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:34.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:34.811+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:34.996 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:34.990+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:35.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:35.071+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:35.493 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:35.486+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:35.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:35.613+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:35.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:35.738+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:35.828 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:35.821+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:36.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:35.999+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:36.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:36.046+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:36.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:36.529+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:36.604 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:36.598+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:36.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:36.780+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:36.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:36.824+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:37.047 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:37.042+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:37.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:37.046+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:37.575 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:37.567+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:37.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:37.646+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:37.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:37.764+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:37.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:37.816+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:37.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:37.827+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:38.050 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:38.045+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:38.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:38.086+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:38.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:38.556+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:38.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:38.649+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:38.804 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:38.795+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:38.804 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:38.798+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:38.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:38.807+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:39.066 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:39.061+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:39.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:39.105+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:39.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:39.535+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:39.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:39.696+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:39.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:39.762+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:39.771 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:39.765+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:39.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:39.827+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:40.100 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:40.095+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:40.162 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:40.156+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:40.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:40.551+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:40.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:40.694+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:40.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:40.724+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:40.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:40.725+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:40.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:40.785+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:41.117 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:41.110+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:41.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:41.142+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:41.541 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:41.533+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:41.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:41.713+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:41.723 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:41.718+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:41.740 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:41.732+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:41.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:41.800+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:42.113 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:42.106+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:42.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:42.149+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:42.564 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:42.556+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:42.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:42.677+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:42.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:42.680+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:42.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:42.757+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:42.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:42.782+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:43.078 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:43.072+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:43.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:43.136+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:43.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:43.544+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:43.672 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:43.664+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:43.675 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:43.669+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:43.789 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:43.783+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:43.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:43.804+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:44.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:44.035+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:44.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:44.093+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:44.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:44.555+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:44.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:44.635+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:44.644 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:44.638+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:44.784 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:44.777+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:44.809 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:44.797+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:45.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:45.034+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:45.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:45.068+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:45.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:45.598+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:45.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:45.678+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:45.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:45.681+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:45.815 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:45.808+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:45.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:45.812+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:46.077 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:46.069+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:46.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:46.102+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:46.604 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:46.597+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:46.705 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:46.699+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:46.706 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:46.701+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:46.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:46.762+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:46.813 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:46.807+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:47.031 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:47.025+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:47.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:47.116+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:47.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:47.640+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:47.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:47.736+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:47.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:47.741+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:47.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:47.744+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:47.811 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:47.804+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:48.078 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:48.072+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:48.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:48.084+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:48.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:48.648+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:48.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:48.724+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:48.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:48.726+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:48.739 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:48.733+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:48.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:48.852+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:49.033 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:49.027+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:49.141 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:49.135+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:49.610 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:49.603+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:49.697 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:49.690+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:49.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:49.762+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:49.771 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:49.765+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:49.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:49.865+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:50.066 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:50.059+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:50.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:50.130+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:50.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:50.643+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:50.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:50.726+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:50.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:50.754+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:50.767 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:50.757+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:50.882 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:50.870+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:51.112 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:51.104+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:51.123 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:51.116+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:51.659 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:51.651+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:51.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:51.778+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:51.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:51.806+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:51.815 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:51.810+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:51.899 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:51.893+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:52.100 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:52.094+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:52.160 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:52.155+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:52.695 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:52.687+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:52.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:52.791+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:52.799 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:52.794+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:52.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:52.828+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:52.914 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:52.906+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:53.066 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:53.059+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:53.137 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:53.130+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:53.728 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:53.720+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:53.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:53.804+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:53.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:53.806+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:53.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:53.832+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:53.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:53.930+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:54.075 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:54.069+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:54.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:54.178+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:54.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:54.726+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:54.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:54.841+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:54.850 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:54.844+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:54.866 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:54.859+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:54.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:54.887+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:55.095 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:55.087+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:55.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:55.227+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:55.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:55.687+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:55.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:55.805+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:55.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:55.807+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:55.827 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:55.821+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:55.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:55.872+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:56.054 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:56.048+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:56.251 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:56.245+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:56.636 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:18:56.629+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:18:56.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:56.739+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:56.808 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:56.801+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:56.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:56.825+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:56.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:56.828+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:56.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:56.893+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:57.031 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:57.026+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:57.275 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:57.269+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:57.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:18:57.618+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:18:57.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:57.765+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:57.789 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:57.783+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:57.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:57.806+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:57.814 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:57.808+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:57.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:57.938+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:58.011 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:58.005+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:58.260 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:58.253+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:58.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:18:58.593+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:18:58.785 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:58.778+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:58.800 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:58.794+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:58.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:58.798+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:58.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:58.815+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:58.962 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:58.956+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:18:59.033 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:18:59.028+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:18:59.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:18:59.262+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:18:59.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:18:59.637+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:18:59.778 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:59.771+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:18:59.779 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:18:59.774+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:18:59.791 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:18:59.785+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:18:59.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:18:59.810+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:18:59.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:18:59.913+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:00.088 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:00.082+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:00.227 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:00.222+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:00.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:00.632+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:00.787 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:00.779+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:00.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:00.782+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:00.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:00.803+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:00.863 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:00.853+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:00.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:00.897+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:01.090 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:01.083+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:01.207 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:01.202+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:01.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:01.670+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:01.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:01.766+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:01.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:01.768+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:01.819 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:01.814+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:01.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:01.816+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:01.860 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:01.854+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:02.132 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:02.125+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:02.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:02.228+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:02.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:02.658+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:02.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:02.789+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:02.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:02.793+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:02.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:02.836+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:02.846 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:02.840+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:02.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:02.899+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:03.185 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:03.178+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:03.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:03.263+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:03.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:03.613+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:03.828 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:03.820+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:03.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:03.823+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:03.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:03.855+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:03.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:03.887+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:03.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:03.930+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:04.192 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:04.185+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:04.279 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:04.272+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:04.670 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:04.664+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:04.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:04.835+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:04.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:04.839+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:04.881 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:04.875+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:04.945 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:04.938+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:04.977 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:04.969+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:05.207 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:05.201+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:05.282 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:05.277+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:05.668 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:05.658+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:05.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:05.863+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:05.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:05.866+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:05.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:05.898+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:05.918 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:05.911+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:06.002 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:05.995+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:06.219 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:06.211+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:06.322 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:06.316+0000 1694c700 -1 osd.1 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.154645+0000 front 2019-11-29T17:17:49.216766+0000 (oldest deadline 2019-11-29T17:18:35.001049+0000) 2019-11-29T17:19:06.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:19:06.677+0000 1694c700 -1 osd.5 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.825634+0000 front 2019-11-29T17:17:51.844393+0000 (oldest deadline 2019-11-29T17:18:55.600971+0000) 2019-11-29T17:19:06.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:19:06.891+0000 1694c700 -1 osd.2 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.197802+0000 front 2019-11-29T17:17:50.196952+0000 (oldest deadline 2019-11-29T17:18:31.981447+0000) 2019-11-29T17:19:06.908 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:06.900+0000 1694c700 -1 osd.6 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:49.733500+0000 front 2019-11-29T17:17:49.203898+0000 (oldest deadline 2019-11-29T17:18:32.076231+0000) 2019-11-29T17:19:06.909 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:06.903+0000 1694c700 -1 osd.6 334 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:06.960 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:19:06.953+0000 1694c700 -1 osd.7 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.520318+0000 front 2019-11-29T17:17:50.521572+0000 (oldest deadline 2019-11-29T17:18:32.795628+0000) 2019-11-29T17:19:07.011 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:19:07.005+0000 1694c700 -1 osd.4 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:51.802834+0000 front 2019-11-29T17:17:51.954147+0000 (oldest deadline 2019-11-29T17:18:35.280128+0000) 2019-11-29T17:19:07.154 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:19:07.146+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e334 v334) 2019-11-29T17:19:07.180 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:19:07.174+0000 1694c700 -1 osd.3 334 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:17:50.196367+0000 front 2019-11-29T17:17:49.591587+0000 (oldest deadline 2019-11-29T17:18:32.322714+0000) 2019-11-29T17:19:07.882 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:07.877+0000 1694c700 -1 osd.6 335 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:08.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:08.929+0000 1694c700 -1 osd.6 336 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80953 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e334) 2019-11-29T17:19:40.334 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:40.323+0000 11cac700 -1 osd.6 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:40.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:40.340+0000 34f8a700 -1 osd.6 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:40.611 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:40.564+0000 3678d700 -1 osd.1 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:40.638 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:40.597+0000 31f84700 -1 osd.1 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:40.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:40.670+0000 38791700 -1 osd.6 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:40.748 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:40.618+0000 114ab700 -1 osd.1 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:41.021 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:41.015+0000 114ab700 -1 osd.1 338 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:41.781 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:19:41.774+0000 37f90700 -1 osd.1 339 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:41.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:19:41.796+0000 32785700 -1 osd.6 339 build_incremental_map_msg missing incremental map 338 2019-11-29T17:19:43.130 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.118+0000 31f84700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:43.169 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.153+0000 32785700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:43.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.298+0000 32785700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:43.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.315+0000 32785700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:43.407 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.403+0000 37f90700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:43.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:43.530+0000 33f88700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:44.213 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:44.208+0000 34f8a700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:45.736 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:45.719+0000 33f88700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:45.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:45.749+0000 32f86700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:19:45.800 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:19:45.774+0000 38f92700 -1 osd.0 340 build_incremental_map_msg missing incremental map 340 2019-11-29T17:20:05.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:05.562+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:06.180 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:06.171+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:06.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:06.335+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:06.552 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:06.545+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:07.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:07.183+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:07.378 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:07.373+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:07.520 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:07.515+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:08.160 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:08.152+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:08.408 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:08.401+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:08.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:08.487+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:08.558 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:08.550+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:08.819 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:08.811+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:09.186 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:09.178+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:09.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:09.397+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:09.522 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:09.517+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:09.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:09.555+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:09.791 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:09.784+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:10.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:10.170+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:10.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:10.446+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:10.487 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:10.480+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:10.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:10.518+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:10.780 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:10.774+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:11.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:11.154+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:11.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:11.444+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:11.483 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:11.477+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:11.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:11.557+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:11.791 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:11.784+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:12.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:12.131+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:12.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:12.405+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:12.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:12.513+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:12.591 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:12.585+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:12.827 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:12.819+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:13.164 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:13.157+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:13.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:13.376+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:13.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:13.479+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:13.644 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:13.636+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:13.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:13.803+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:14.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:14.197+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:14.367 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:14.362+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:14.493 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:14.488+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:14.609 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:14.601+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:14.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:14.800+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:15.054 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:15.047+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:15.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:15.249+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:15.419 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:15.412+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:15.505 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:15.496+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:15.614 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:15.607+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:15.786 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:15.779+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:16.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:16.094+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:16.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:16.247+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:16.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:16.450+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:16.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:16.465+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:16.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:16.660+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:16.748 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:16.742+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:17.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:17.063+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:17.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:17.220+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:17.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:17.426+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:17.507 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:17.501+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:17.658 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:17.651+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:17.722 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:17.715+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:18.049 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:18.040+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:18.049 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:18.042+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:18.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:18.273+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:18.471 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:18.464+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:18.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:18.512+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:18.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:18.618+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:18.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:18.677+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:19.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:19.086+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:19.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:19.089+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:19.286 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:19.278+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:19.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:19.452+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:19.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:19.517+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:19.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:19.623+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:19.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:19.676+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:20.135 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:20.129+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:20.135 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:20.130+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:20.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:20.294+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:20.474 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:20.467+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:20.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:20.520+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:20.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:20.665+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:20.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:20.669+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:21.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:21.170+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:21.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:21.177+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:21.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:21.257+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:21.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:21.484+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:21.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:21.546+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:21.646 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:21.639+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:21.715 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:21.709+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:22.190 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:22.184+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:22.192 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:22.187+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:22.290 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:22.284+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:22.528 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:22.523+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:22.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:22.576+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:22.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:22.637+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:22.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:22.683+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:23.185 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:23.178+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:23.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:23.180+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:23.316 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:23.310+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:23.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:23.530+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:23.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:23.598+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:23.632 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:23.622+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:23.717 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:23.710+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:24.221 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:24.216+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:24.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:24.219+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:24.329 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:24.322+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:24.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:24.511+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:24.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:24.599+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:24.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:24.622+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:24.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:24.736+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:25.185 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:25.180+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:25.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:25.183+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:25.291 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:25.284+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:25.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:25.491+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:25.578 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:25.571+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:25.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:25.638+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:25.791 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:25.785+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:26.198 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:26.191+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:26.198 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:26.194+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:26.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:26.295+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:26.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:26.486+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:26.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:26.560+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:26.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:26.642+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:26.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:26.831+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:27.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:27.200+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:27.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:27.202+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:27.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:27.271+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:27.475 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:27.469+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:27.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:27.547+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:27.640 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:27.622+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:27.841 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:27.835+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:28.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:28.234+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:28.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:28.252+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:28.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:28.256+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:28.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:28.463+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:28.515 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:28.509+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:28.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:28.631+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:28.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:28.863+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:29.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:29.225+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:29.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:29.303+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:29.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:29.304+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:29.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:29.504+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:29.531 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:29.518+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:29.641 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:29.634+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:29.888 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:29.880+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:30.250 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:30.240+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:30.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:30.284+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:30.290 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:30.285+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:30.501 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:30.495+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:30.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:30.562+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:30.649 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:30.645+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:30.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:30.908+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:31.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:31.210+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:31.271 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:31.266+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:31.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:31.268+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:31.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:31.522+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:31.539 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:31.534+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:31.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:31.648+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:31.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:31.868+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:32.210 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:32.203+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:32.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:32.270+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:32.278 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:32.271+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:32.417 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:32.411+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:32.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:32.498+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:32.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:32.552+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:32.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:32.675+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:32.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:32.842+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:33.246 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:33.240+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:33.246 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:33.242+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:33.254 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:33.248+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:33.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:33.380+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:33.532 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:33.526+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:33.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:33.538+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:33.690 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:33.684+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:33.879 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:33.873+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:34.258 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:34.251+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:34.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:34.287+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:34.295 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:34.288+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:34.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:34.432+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:34.505 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:34.499+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:34.588 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:34.582+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:34.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:34.713+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:34.839 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:34.832+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:35.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:35.275+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:35.305 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:35.300+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:35.307 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:35.302+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:35.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:35.464+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:35.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:35.482+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:35.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:35.545+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:35.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:35.670+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:35.801 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:35.789+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:36.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:36.240+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:36.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:36.261+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:36.268 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:36.262+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:36.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:36.480+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:36.522 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:36.516+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:36.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:36.546+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:36.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:36.658+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:36.789 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:36.775+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:36.985 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:04:45.120 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:36.997 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:04:45.132 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:36.997 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:04:45.179 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.003 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:04:45.184 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.006 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:04:45.186 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.008 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:04:45.189 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.236 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:04:45.417 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.247 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:04:45.428 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.254 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:04:45.389 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:20:37.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:37.270+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:37.287 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:37.281+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:37.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:37.283+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:37.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:37.474+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:37.516 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:37.511+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:37.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:37.547+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:37.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:37.617+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:37.736 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:37.729+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:37.749 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:20:37.735+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e340 v340) 2019-11-29T17:20:38.265 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:38.260+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:38.267 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:38.263+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:38.318 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:38.313+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:38.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:38.514+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:38.533 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:38.521+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:38.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:38.580+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:38.657 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:38.652+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:38.697 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:38.685+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:39.277 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:39.272+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:39.277 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:39.273+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:39.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:39.291+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:39.503 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:39.497+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:39.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:39.506+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:39.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:39.590+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:39.687 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:39.680+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:39.714 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:39.707+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:40.232 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:40.226+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:40.232 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:40.227+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:40.349 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:40.343+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:40.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:40.494+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:40.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:40.514+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:40.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:40.642+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:40.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:40.681+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:40.704 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:40.699+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:41.242 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:41.237+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:41.245 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:41.241+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:41.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:41.318+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:41.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:41.451+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:41.561 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:41.555+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:41.693 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:41.685+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:41.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:41.695+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:41.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:41.724+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:42.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:42.194+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:42.204 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:42.197+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:42.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:42.371+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:42.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:42.483+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:42.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:42.603+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:42.673 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:42.666+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:42.690 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:42.683+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:42.731 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:42.725+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:42.788 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:20:42.779+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e340 v340) 2019-11-29T17:20:43.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:43.190+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:43.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:43.193+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:43.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:43.371+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:43.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:43.528+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:43.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:43.565+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:43.673 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:43.666+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:43.714 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:43.708+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:43.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:43.728+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:44.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:44.209+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:44.217 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:44.211+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:44.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:44.384+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:44.523 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:44.514+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:44.539 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:44.528+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:44.646 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:44.640+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:44.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:44.715+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:44.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:44.718+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:45.188 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:45.181+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:45.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:45.183+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:45.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:45.369+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:45.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:45.484+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:45.567 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:45.560+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:45.618 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:45.611+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:45.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:45.682+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:45.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:45.764+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:46.194 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:46.188+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:46.194 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:46.189+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:46.415 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:46.409+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:46.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:46.462+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:46.614 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:46.607+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:46.615 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:46.608+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:46.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:46.667+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:46.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:46.787+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:47.167 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:47.162+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:47.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:47.163+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:47.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:47.431+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:47.444 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:47.436+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:47.611 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:47.605+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:47.635 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:47.627+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:47.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:47.715+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:47.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:47.789+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:47.796 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:20:47.792+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e340 v340) 2019-11-29T17:20:48.142 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:48.135+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:48.144 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:48.137+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:48.470 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:48.462+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:48.484 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:48.478+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:48.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:48.583+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:48.668 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:48.662+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:48.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:48.706+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:48.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:48.800+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:49.183 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:49.178+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:49.185 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:49.181+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:49.432 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:49.420+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:49.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:49.443+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:49.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:49.541+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:49.682 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:49.676+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:49.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:49.688+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:49.841 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:49.834+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:50.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:50.167+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:50.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:50.171+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:50.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:50.427+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:50.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:50.456+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:50.575 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:50.568+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:50.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:50.703+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:50.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:50.724+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:50.799 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:50.792+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:51.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:51.156+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:51.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:51.157+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:51.418 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:51.413+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:51.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:51.491+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:51.579 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:51.570+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:51.701 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:51.696+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:51.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:51.735+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:51.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:51.776+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:52.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:52.200+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:52.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:52.206+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:52.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:52.372+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:52.544 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:20:52.536+0000 1694c700 -1 osd.5 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.587747+0000 front 2019-11-29T17:19:24.586857+0000 (oldest deadline 2019-11-29T17:20:05.333633+0000) 2019-11-29T17:20:52.545 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:52.536+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:52.720 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:20:52.714+0000 1694c700 -1 osd.1 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:22.819390+0000 front 2019-11-29T17:19:22.809785+0000 (oldest deadline 2019-11-29T17:20:05.643579+0000) 2019-11-29T17:20:52.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:20:52.732+0000 1694c700 -1 osd.6 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.591946+0000 front 2019-11-29T17:19:24.587919+0000 (oldest deadline 2019-11-29T17:20:07.849986+0000) 2019-11-29T17:20:52.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:20:52.761+0000 1694c700 -1 osd.4 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.166462+0000 front 2019-11-29T17:19:24.528736+0000 (oldest deadline 2019-11-29T17:20:32.120316+0000) 2019-11-29T17:20:52.868 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:20:52.858+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e340 v340) 2019-11-29T17:20:53.193 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:53.188+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:53.194 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:53.189+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:53.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:53.385+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:53.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:53.514+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:54.155 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:54.149+0000 1694c700 -1 osd.0 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:19:37.944778+0000 (oldest deadline 2019-11-29T17:20:17.944778+0000) 2019-11-29T17:20:54.155 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:54.150+0000 1694c700 -1 osd.0 340 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:20:54.402 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:20:54.396+0000 1694c700 -1 osd.2 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:21.780854+0000 front 2019-11-29T17:19:21.451230+0000 (oldest deadline 2019-11-29T17:20:05.527278+0000) 2019-11-29T17:20:54.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:20:54.497+0000 1694c700 -1 osd.7 340 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:19:24.736304+0000 front 2019-11-29T17:19:24.695908+0000 (oldest deadline 2019-11-29T17:20:08.770443+0000) 2019-11-29T17:20:55.140 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:20:55.127+0000 1694c700 -1 osd.0 342 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e338) 2019-11-29T17:22:21.223 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:21.215+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:21.314 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:21.303+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:21.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:21.767+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:22.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:22.183+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:22.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:22.314+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:22.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:22.752+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:22.780 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:22.774+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:23.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:23.205+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:23.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:23.342+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:23.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:23.412+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:23.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:23.469+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:23.794 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:23.788+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:23.799 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:23.792+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:24.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:24.114+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:24.244 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:24.235+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:24.325 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:24.318+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:24.463 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:24.453+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:24.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:24.468+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:24.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:24.777+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:24.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:24.847+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:25.104 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:25.097+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:25.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:25.244+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:25.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:25.356+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:25.463 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:25.455+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:25.480 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:25.473+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:25.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:25.764+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:25.857 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:25.849+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:26.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:26.104+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:26.241 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:26.231+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:26.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:26.330+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:26.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:26.431+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:26.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:26.431+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:26.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:26.728+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:26.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:26.831+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:27.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:27.059+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:27.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:27.235+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:27.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:27.365+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:27.413 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:27.405+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:27.470 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:27.463+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:27.761 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:27.751+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:27.867 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:27.859+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:28.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:28.026+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:28.233 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:28.225+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:28.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:28.396+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:28.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:28.415+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:28.439 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:28.432+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:28.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:28.781+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:28.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:28.864+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:29.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:29.037+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:29.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:29.180+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:29.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:29.396+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:29.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:29.418+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:29.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:29.457+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:29.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:29.748+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:29.858 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:29.851+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:30.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:29.993+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:30.232 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:30.225+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:30.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:30.380+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:30.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:30.446+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:30.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:30.488+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:30.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:30.706+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:30.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:30.855+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:30.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:30.991+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:31.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:31.277+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:31.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:31.407+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:31.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:31.501+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:31.526 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:31.514+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:31.734 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:31.728+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:31.851 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:31.844+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:32.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:32.037+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:32.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:32.242+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:32.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:32.376+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:32.485 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:32.478+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:32.513 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:32.507+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:32.717 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:32.711+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:32.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:32.890+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:33.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:33.032+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:33.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:33.214+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:33.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:33.340+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:33.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:33.519+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:33.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:33.525+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:33.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:33.688+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:33.936 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:33.929+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:33.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:33.991+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:34.262 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:34.254+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:34.378 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:34.370+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:34.545 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:34.539+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:34.573 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:34.567+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:34.712 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:34.706+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:34.950 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:34.943+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:34.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:34.986+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:35.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:35.273+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:35.363 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:35.355+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:35.512 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:35.504+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:35.577 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:35.571+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:35.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:35.706+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:35.939 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:35.932+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:36.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:35.969+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:36.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:36.314+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:36.412 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:36.404+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:36.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:36.494+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:36.551 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:36.545+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:36.707 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:36.701+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:36.993 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:36.985+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:37.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:37.004+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:37.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:37.281+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:37.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:37.417+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:37.550 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:37.544+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:37.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:37.546+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:37.742 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:37.735+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:37.955 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:37.944+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:37.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:37.991+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:38.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:38.257+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:38.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:38.409+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:38.514 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:38.506+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:38.550 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:38.543+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:38.717 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:38.711+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:38.963 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:38.955+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:39.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:38.996+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:39.255 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:39.248+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:39.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:39.439+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:39.515 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:39.508+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:39.520 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:39.513+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:39.705 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:39.699+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:39.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:39.985+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:39.996 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:39.989+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:40.237 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:40.229+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:40.493 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:40.478+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:40.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:40.509+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:40.564 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:40.559+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:40.662 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:40.656+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:41.008 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:41.001+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:41.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:41.018+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:41.255 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:41.248+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:41.485 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:41.469+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:41.521 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:41.516+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:41.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:41.529+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:41.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:41.647+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:42.030 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:42.022+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:42.056 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:42.051+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:42.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:42.280+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:42.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:42.465+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:42.508 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:42.498+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:42.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:42.503+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:42.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:42.636+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:43.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:43.038+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:43.072 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:43.066+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:43.268 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:43.260+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:43.469 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:43.463+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:43.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:43.491+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:43.544 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:43.536+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:43.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:43.633+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:44.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:44.037+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:44.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:44.059+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:44.258 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:44.251+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:44.460 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:44.454+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:44.461 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:44.448+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:44.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:44.574+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:44.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:44.664+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:45.035 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:45.028+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:45.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:45.046+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:45.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:45.244+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:45.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:45.407+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:45.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:45.463+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:45.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:45.527+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:45.688 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:45.682+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:46.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:46.038+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:46.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:46.038+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:46.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:46.221+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:46.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:46.371+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:46.521 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:46.516+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:46.566 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:46.555+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:46.685 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:46.680+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:47.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:47.017+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:47.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:47.027+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:47.187 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:47.180+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:47.362 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:47.355+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:47.526 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:47.521+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:47.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:47.536+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:47.730 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:47.724+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:47.997 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:47.989+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:48.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:48.064+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:48.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:48.142+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:48.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:48.399+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:48.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:48.522+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:48.538 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:48.531+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:48.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:48.737+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:49.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:49.022+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:49.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:49.035+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:49.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:49.168+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:49.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:49.424+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:49.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:49.481+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:49.515 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:49.508+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:49.731 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:49.725+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:50.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:50.025+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:50.052 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:50.045+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:50.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:50.203+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:50.455 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:50.449+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:50.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:50.466+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:50.485 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:50.479+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:50.781 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:50.772+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:51.061 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:51.054+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:51.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:51.056+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:51.258 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:51.250+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:51.460 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:51.452+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:51.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:51.503+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:51.512 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:51.506+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:51.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:51.738+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:52.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:52.052+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:52.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:52.102+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:52.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:52.218+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:52.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:52.499+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:52.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:22:52.548+0000 1694c700 -1 osd.3 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.079465+0000 front 2019-11-29T17:21:38.673331+0000 (oldest deadline 2019-11-29T17:22:23.402039+0000) 2019-11-29T17:22:52.555 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:22:52.546+0000 1694c700 -1 osd.6 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.777631+0000 front 2019-11-29T17:21:37.270482+0000 (oldest deadline 2019-11-29T17:22:22.594796+0000) 2019-11-29T17:22:52.772 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:22:52.765+0000 1694c700 -1 osd.2 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.148095+0000 front 2019-11-29T17:21:36.671306+0000 (oldest deadline 2019-11-29T17:22:22.394993+0000) 2019-11-29T17:22:53.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:22:53.091+0000 1694c700 -1 osd.4 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:37.815519+0000 front 2019-11-29T17:21:37.813809+0000 (oldest deadline 2019-11-29T17:22:21.690802+0000) 2019-11-29T17:22:53.105 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:22:53.099+0000 1694c700 -1 osd.1 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:38.094315+0000 front 2019-11-29T17:21:37.436174+0000 (oldest deadline 2019-11-29T17:22:23.258052+0000) 2019-11-29T17:22:53.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:22:53.264+0000 1694c700 -1 osd.5 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.003097+0000 front 2019-11-29T17:21:36.018747+0000 (oldest deadline 2019-11-29T17:22:20.657449+0000) 2019-11-29T17:22:53.348 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:22:53.337+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e346 v346) 2019-11-29T17:22:53.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:22:53.492+0000 1694c700 -1 osd.7 346 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:21:36.629651+0000 front 2019-11-29T17:21:36.628157+0000 (oldest deadline 2019-11-29T17:22:20.552054+0000) 2019-11-29T17:22:55.634 INFO:teuthology.orchestra.run.smithi182.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-11-29T17:23:29.128 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:23:29.055+0000 30f82700 -1 osd.3 351 build_incremental_map_msg missing incremental map 351 2019-11-29T17:23:29.210 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:23:29.170+0000 34f8a700 -1 osd.3 351 build_incremental_map_msg missing incremental map 351 2019-11-29T17:23:29.327 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:23:29.216+0000 32785700 -1 osd.3 351 build_incremental_map_msg missing incremental map 351 2019-11-29T17:23:49.471 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:49.467+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:50.477 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:50.472+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:51.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:51.475+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:51.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:51.863+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:52.466 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:52.458+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:52.477 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:52.472+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:52.885 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:52.877+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:53.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:53.413+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:53.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:53.425+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:53.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:53.858+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:54.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:54.418+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:54.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:54.451+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:54.467 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:54.459+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:54.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:54.832+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:55.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:55.419+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:23:55.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:55.423+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:55.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:55.453+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:55.462 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:55.455+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:55.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:23:55.534+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:23:55.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:55.879+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:56.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:23:56.288+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:23:56.419 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:56.414+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:23:56.421 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:56.417+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:56.428 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:56.421+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:56.483 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:56.477+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:56.588 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:23:56.578+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:23:56.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:56.849+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:57.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:23:57.298+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:23:57.434 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:57.426+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:57.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:57.436+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:23:57.445 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:57.440+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:57.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:57.514+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:57.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:23:57.635+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:23:57.879 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:57.871+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:57.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:23:57.946+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:23:58.316 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:23:58.306+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:23:58.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:58.399+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:23:58.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:58.403+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:58.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:58.429+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:58.503 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:58.497+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:58.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:23:58.640+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:23:58.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:58.857+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:23:59.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:23:58.995+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:23:59.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:23:59.284+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:23:59.411 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:59.406+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:23:59.413 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:23:59.408+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:23:59.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:23:59.435+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:23:59.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:23:59.515+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:23:59.693 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:23:59.682+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:23:59.863 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:23:59.856+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:00.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:00.009+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:00.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:00.265+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:00.425 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:00.418+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:00.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:00.420+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:00.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:00.489+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:00.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:00.518+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:00.679 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:00.672+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:00.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:00.816+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:01.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:01.017+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:01.275 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:01.267+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:01.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:01.451+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:01.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:01.453+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:01.521 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:01.513+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:01.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:01.533+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:01.711 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:01.704+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:01.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:01.824+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:02.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:02.041+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:02.268 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:02.261+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:02.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:02.427+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:02.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:02.429+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:02.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:02.478+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:02.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:02.533+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:02.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:02.674+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:02.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:02.878+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:03.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:03.026+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:03.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:03.282+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:03.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:03.443+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:03.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:03.444+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:03.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:03.499+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:03.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:03.503+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:03.688 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:03.682+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:03.890 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:03.883+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:04.009 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:04.004+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:04.012 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:04.007+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:04.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:04.307+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:04.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:04.453+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:04.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:04.479+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:04.487 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:04.481+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:04.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:04.532+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:04.713 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:04.687+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:04.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:04.852+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:05.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:05.017+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:05.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:05.021+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:05.360 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:05.354+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:05.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:05.479+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:05.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:05.479+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:05.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:05.485+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:05.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:05.554+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:05.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:05.667+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:05.904 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:05.894+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:05.996 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:05.989+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:05.997 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:05.991+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:06.404 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:06.397+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:06.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:06.516+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:06.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:06.531+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:06.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:06.533+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:06.611 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:06.605+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:06.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:06.628+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:06.906 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:06.900+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:07.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:07.029+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:07.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:07.032+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:07.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:07.378+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:07.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:07.477+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:07.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:07.543+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:07.550 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:07.545+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:07.640 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:07.633+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:07.662 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:07.656+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:07.926 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:07.920+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:07.991 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:07.985+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:07.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:07.988+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:08.407 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:08.400+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:08.506 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:08.499+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:08.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:08.502+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:08.516 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:08.510+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:08.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:08.604+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:08.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:08.677+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:08.900 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:08.887+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:09.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:09.009+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:09.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:09.013+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:09.403 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:09.396+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:09.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:09.520+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:09.528 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:09.523+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:09.568 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:09.562+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:09.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:09.574+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:09.655 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:09.647+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:09.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:09.918+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:10.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:10.041+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:10.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:10.042+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:10.418 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:10.411+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:10.492 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:10.484+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:10.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:10.486+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:10.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:10.544+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:10.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:10.561+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:10.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:10.660+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:10.926 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:10.919+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:11.045 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:11.038+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:11.046 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:11.040+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:11.455 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:11.448+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:11.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:11.449+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:11.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:11.451+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:11.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:11.519+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:11.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:11.573+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:11.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:11.724+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:11.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:11.939+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:12.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:12.022+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:12.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:12.024+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:12.409 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:12.402+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:12.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:12.434+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:12.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:12.436+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:12.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:12.520+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:12.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:12.551+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:12.722 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:12.715+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:12.974 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:12.968+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:13.037 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:13.031+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:13.040 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:13.035+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:13.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:13.444+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:13.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:13.474+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:13.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:13.478+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:13.506 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:13.499+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:13.576 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:13.570+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:13.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:13.726+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:13.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:13.939+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:14.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:14.014+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:14.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:14.015+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:14.069 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:22.203 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.077 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:22.211 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:22.324 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.145 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:22.325 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.149 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:22.330 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.163 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:22.344 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.384 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:22.519 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.404 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:22.584 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.428 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:22.609 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:14.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:14.435+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:14.510 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:14.502+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:14.510 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:14.504+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:14.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:14.528+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:14.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:14.553+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:14.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:14.740+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:14.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:14.940+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:15.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:15.061+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:15.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:15.063+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:15.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:15.460+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:15.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:15.463+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:15.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:15.474+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:15.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:15.510+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:15.540 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:15.534+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:15.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:15.781+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:15.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:15.943+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:16.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:16.026+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:16.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:16.028+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:16.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:16.458+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:16.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:16.460+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:16.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:16.467+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:16.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:16.474+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:16.546 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:16.541+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:16.776 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:16.770+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:16.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:16.966+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:17.085 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:17.073+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:17.104 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:17.076+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:17.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:17.451+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:17.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:17.468+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:17.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:17.469+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:17.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:17.522+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:17.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:17.592+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:17.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:17.808+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:17.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:17.931+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:18.035 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:18.029+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:18.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:18.033+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:18.436 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:18.430+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:18.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:18.433+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:18.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:18.479+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:18.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:18.526+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:18.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:18.550+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:18.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:18.849+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:18.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:18.924+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:19.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:19.033+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:19.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:19.035+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:19.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:19.462+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:19.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:19.466+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:19.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:19.500+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:19.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:19.502+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:19.546 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:19.541+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:19.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:19.862+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:19.968 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:19.962+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:20.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:20.022+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:20.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:20.023+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:20.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:20.492+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:20.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:20.492+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:20.503 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:20.496+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:20.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:20.514+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:20.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:20.592+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:20.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:20.895+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:20.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:20.936+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:21.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:21.056+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:21.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:21.059+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:21.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:21.470+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:21.507 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:21.500+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:21.527 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:21.520+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:21.527 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:21.522+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:21.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:21.548+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:21.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:21.920+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:21.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:21.935+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:22.050 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:22.045+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:22.052 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:22.047+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:22.496 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:22.490+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:22.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:22.509+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:22.516 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:22.510+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:22.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:22.537+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:22.545 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:22.538+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:22.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:22.929+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:22.972 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:22.966+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:23.095 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:23.089+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:23.097 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:23.093+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:23.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:23.488+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:23.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:23.491+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:23.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:23.527+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:23.541 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:23.535+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:23.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:23.568+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:23.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:23.904+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:23.951 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:23.944+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:24.004 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:24:23.992+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e352 v352) 2019-11-29T17:24:24.077 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:24.071+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:24.077 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:24.072+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:24.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:24.504+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:24.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:24.507+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:24.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:24.549+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:24.580 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:24.572+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:24.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:24.586+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:24.879 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:24.872+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:24.936 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:24.930+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:25.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:25.053+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:25.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:25.055+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:25.525 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:25.519+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:25.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:25.522+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:25.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:25.523+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:25.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:25.529+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:25.635 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:25.624+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:25.878 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:25.871+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:25.926 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:25.920+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:26.079 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:26.072+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:26.081 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:26.074+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:26.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:26.491+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:26.498 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:26.494+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:26.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:26.522+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:26.587 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:26.580+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:26.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:26.632+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:26.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:26.908+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:26.923 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:26.917+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:26.942 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:35.077 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:26.952 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:35.087 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:26.958 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:35.139 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:26.958 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:35.139 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:26.962 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:35.143 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:26.963 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:35.144 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:27.006 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:08:35.187 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:27.008 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:08:35.143 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:27.018 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:08:35.198 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:24:27.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:27.054+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:27.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:27.055+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:27.463 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:27.457+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:27.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:27.459+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:27.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:27.503+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:27.615 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:27.608+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:27.664 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:27.659+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:27.886 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:27.879+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:27.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:27.935+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:28.074 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:28.068+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:28.075 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:28.070+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:28.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:28.420+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:28.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:28.422+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:28.511 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:28.504+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:28.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:28.612+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:28.642 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:28.635+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:28.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:28.852+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:28.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:28.951+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:29.018 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:24:29.012+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e352 v352) 2019-11-29T17:24:29.061 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:29.055+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:29.063 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:29.059+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:29.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:29.420+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:29.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:29.424+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:29.503 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:29.496+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:29.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:29.631+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:29.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:29.660+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:29.888 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:29.881+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:29.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:29.943+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:30.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:30.094+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:30.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:30.096+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:30.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:30.451+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:30.460 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:30.453+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:30.460 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:30.455+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:30.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:30.597+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:30.698 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:30.692+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:30.891 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:30.884+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:30.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:30.954+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:31.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:31.142+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:31.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:31.143+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:31.452 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:31.445+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:31.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:31.505+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:31.512 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:31.507+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:31.587 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:31.580+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:31.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:31.718+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:31.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:31.859+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:31.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:31.945+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:32.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:32.126+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:32.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:32.128+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:32.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:32.436+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:32.472 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:32.465+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:32.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:32.467+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:32.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:32.558+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:32.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:32.743+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:32.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:32.883+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:32.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:32.966+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:33.169 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:33.163+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:33.170 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:33.165+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:33.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:24:33.480+0000 1694c700 -1 osd.4 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.692853+0000 front 2019-11-29T17:23:08.709056+0000 (oldest deadline 2019-11-29T17:23:51.509218+0000) 2019-11-29T17:24:33.492 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:33.485+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:33.495 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:33.491+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:33.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:33.520+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:33.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:24:33.737+0000 1694c700 -1 osd.1 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.339415+0000 front 2019-11-29T17:23:08.259221+0000 (oldest deadline 2019-11-29T17:23:53.505394+0000) 2019-11-29T17:24:33.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:24:33.889+0000 1694c700 -1 osd.7 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:10.087797+0000 front 2019-11-29T17:23:10.092620+0000 (oldest deadline 2019-11-29T17:23:55.356406+0000) 2019-11-29T17:24:34.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:24:33.999+0000 1694c700 -1 osd.5 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:08.033435+0000 front 2019-11-29T17:23:08.213662+0000 (oldest deadline 2019-11-29T17:23:51.447096+0000) 2019-11-29T17:24:34.104 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:24:34.094+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e352 v352) 2019-11-29T17:24:34.145 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:34.137+0000 1694c700 -1 osd.0 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:23:23.415558+0000 (oldest deadline 2019-11-29T17:24:03.415558+0000) 2019-11-29T17:24:34.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:24:34.162+0000 1694c700 -1 osd.0 352 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e350) 2019-11-29T17:24:34.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:34.485+0000 1694c700 -1 osd.2 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.242751+0000 front 2019-11-29T17:23:09.243372+0000 (oldest deadline 2019-11-29T17:23:55.030859+0000) 2019-11-29T17:24:34.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:34.486+0000 1694c700 -1 osd.2 352 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:34.551 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:24:34.544+0000 1694c700 -1 osd.6 352 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:23:09.874455+0000 front 2019-11-29T17:23:09.925542+0000 (oldest deadline 2019-11-29T17:23:55.462846+0000) 2019-11-29T17:24:35.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:24:35.522+0000 1694c700 -1 osd.2 354 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:108933 6.f 6:f3bf49f5:root::.bucket.meta.:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected e348) 2019-11-29T17:24:36.155 INFO:teuthology.orchestra.run.smithi182.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-11-29T17:25:04.423 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:09:12.549 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.446 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:09:12.581 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.473 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:09:12.653 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.475 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:09:12.656 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.476 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:09:12.656 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.480 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:09:12.660 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.508 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:09:12.642 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.542 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:09:12.723 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:25:04.552 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:09:12.733 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:26:05.806 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:05.798+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:06.156 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:06.151+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:06.606 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:06.597+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:06.790 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:06.779+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:06.884 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:06.870+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:07.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:07.136+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:07.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:07.557+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:07.566 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:07.560+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:07.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:07.818+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:07.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:07.844+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:08.167 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:08.161+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:08.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:08.231+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:08.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:08.522+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:08.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:08.584+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:08.809 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:08.802+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:08.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:08.821+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:09.219 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:09.209+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:09.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:09.224+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:09.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:09.539+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:09.581 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:09.572+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:09.832 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:09.823+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:09.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:09.839+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:10.196 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:10.189+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:10.242 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:10.233+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:10.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:10.534+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:10.553 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:10.547+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:10.817 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:10.810+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:10.826 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:10.817+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:10.886 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:10.878+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:11.223 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:11.217+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:11.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:11.256+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:11.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:11.580+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:11.602 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:11.595+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:11.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:11.776+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:11.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:11.797+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:11.923 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:11.914+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:12.204 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:12.199+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:12.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:12.225+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:12.580 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:12.572+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:12.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:12.582+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:12.759 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:12.753+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:12.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:12.761+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:12.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:12.893+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:13.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:13.203+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:13.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:13.238+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:13.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:13.532+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:13.627 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:13.621+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:13.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:13.738+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:13.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:13.759+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:13.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:13.865+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:14.184 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:14.177+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:14.295 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:14.285+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:14.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:14.569+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:14.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:14.644+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:14.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:14.761+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:14.784 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:14.779+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:14.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:14.885+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:15.171 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:15.166+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:15.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:15.284+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:15.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:15.592+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:15.654 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:15.648+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:15.796 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:15.789+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:15.817 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:15.808+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:15.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:15.936+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:16.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:16.171+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:16.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:16.324+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:16.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:16.636+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:16.678 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:16.672+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:16.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:16.805+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:16.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:16.826+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:16.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:16.933+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:17.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:17.150+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:17.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:17.348+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:17.610 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:17.602+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:17.671 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:17.664+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:17.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:17.830+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:17.877 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:17.868+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:17.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:17.942+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:18.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:18.103+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:18.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:18.327+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:18.611 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:18.603+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:18.696 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:18.691+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:18.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:18.806+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:18.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:18.854+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:18.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:18.987+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:19.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:19.095+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:19.312 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:19.303+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:19.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:19.656+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:19.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:19.680+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:19.800 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:19.794+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:19.914 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:19.907+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:20.018 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:20.012+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:20.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:20.055+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:20.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:20.295+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:20.636 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:20.627+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:20.712 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:20.706+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:20.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:20.822+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:20.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:20.914+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:21.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:21.062+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:21.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:21.076+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:21.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:21.293+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:21.620 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:21.613+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:21.673 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:21.666+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:21.790 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:21.783+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:21.948 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:21.940+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:22.025 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:22.019+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:22.056 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:22.051+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:22.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:22.314+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:22.581 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:22.573+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:22.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:22.645+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:22.763 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:22.755+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:22.998 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:22.991+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:23.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:22.998+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:23.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:23.022+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:23.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:23.352+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:23.619 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:23.612+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:23.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:23.619+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:23.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:23.805+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:23.986 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:23.978+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:23.989 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:23.982+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:24.015 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:24.008+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:24.353 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:24.346+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:24.627 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:24.619+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:24.647 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:24.639+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:24.851 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:24.845+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:24.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:24.963+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:24.976 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:24.969+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:24.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:24.987+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:25.338 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:25.330+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:25.632 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:25.626+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:25.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:25.693+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:25.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:25.850+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:25.964 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:25.956+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:25.968 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:25.962+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:26.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:26.019+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:26.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:26.330+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:26.645 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:26.639+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:26.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:26.743+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:26.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:26.898+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:26.928 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:26.921+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:26.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:26.986+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:27.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:27.004+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:27.340 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:27.333+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:27.599 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:27.593+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:27.718 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:27.711+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:27.900 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:27.894+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:27.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:27.938+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:27.978 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:27.972+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:27.996 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:27.989+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:28.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:28.327+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:28.590 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:28.584+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:28.702 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:28.695+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:28.914 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:28.907+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:28.962 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:28.955+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:29.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:29.002+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:29.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:29.029+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:29.349 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:29.343+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:29.629 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:29.622+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:29.747 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:29.740+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:29.872 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:29.863+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:29.965 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:29.951+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:29.974 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:29.968+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:30.082 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:30.075+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:30.367 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:30.358+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:30.629 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:30.619+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:30.759 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:30.752+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:30.861 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:30.854+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:30.949 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:30.938+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:30.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:30.954+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:31.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:31.064+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:31.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:31.407+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:31.624 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:31.616+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:31.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:31.781+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:31.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:31.861+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:31.963 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:31.956+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:31.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:31.977+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:32.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:32.022+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:32.427 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:32.421+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:32.629 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:32.622+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:32.808 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:32.800+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:32.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:32.851+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:32.947 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:32.939+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:33.005 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:32.998+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:33.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:33.026+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:33.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:33.457+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:33.667 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:33.660+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:33.845 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:33.837+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:33.848 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:33.842+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:33.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:33.925+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:34.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:34.029+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:34.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:34.071+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:34.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:34.498+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:34.708 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:34.703+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:34.842 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:34.835+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:34.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:34.854+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:34.949 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:34.937+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:35.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:35.056+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:35.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:35.059+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:35.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:35.541+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:35.727 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:35.720+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:35.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:35.808+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:35.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:35.879+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:35.967 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:35.960+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:36.035 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:36.027+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:36.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:36.047+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:36.540 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:36.530+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:36.780 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:36.773+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:36.790 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:36.784+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:36.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:36.886+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:36.938 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:36.933+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:37.081 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:37.074+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:37.094 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:37.081+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:37.555 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:37.546+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:37.825 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:37.815+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:37.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:37.834+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:37.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:37.890+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:37.919 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:37.911+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:38.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:38.067+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:38.084 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:38.078+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:38.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:38.521+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:38.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:38.805+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:26:38.843 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:26:38.837+0000 1694c700 -1 osd.3 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:23.039806+0000 front 2019-11-29T17:25:23.161717+0000 (oldest deadline 2019-11-29T17:26:06.891449+0000) 2019-11-29T17:26:38.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:26:38.895+0000 1694c700 -1 osd.4 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.484581+0000 front 2019-11-29T17:25:21.632114+0000 (oldest deadline 2019-11-29T17:26:05.551636+0000) 2019-11-29T17:26:38.909 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:26:38.902+0000 1694c700 -1 osd.5 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:21.982171+0000 front 2019-11-29T17:25:21.974419+0000 (oldest deadline 2019-11-29T17:26:06.576906+0000) 2019-11-29T17:26:39.077 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:26:39.071+0000 1694c700 -1 osd.1 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.241472+0000 front 2019-11-29T17:25:24.248623+0000 (oldest deadline 2019-11-29T17:26:05.423729+0000) 2019-11-29T17:26:39.114 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:26:39.098+0000 1694c700 -1 osd.6 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:22.699736+0000 front 2019-11-29T17:25:22.706992+0000 (oldest deadline 2019-11-29T17:26:06.766272+0000) 2019-11-29T17:26:39.560 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:26:39.551+0000 1694c700 -1 osd.7 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.954163+0000 front 2019-11-29T17:25:24.952670+0000 (oldest deadline 2019-11-29T17:26:07.720968+0000) 2019-11-29T17:26:39.643 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:26:39.635+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e358 v358) 2019-11-29T17:26:39.766 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:26:39.761+0000 1694c700 -1 osd.2 358 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:25:24.310652+0000 front 2019-11-29T17:25:24.310199+0000 (oldest deadline 2019-11-29T17:26:10.051925+0000) 2019-11-29T17:27:37.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:37.377+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:37.440 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:37.433+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:38.133 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:38.123+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:38.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:38.406+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:38.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:38.452+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:39.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:39.123+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:39.216 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:39.209+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:39.403 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:39.395+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:39.481 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:39.475+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:40.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:40.139+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:40.206 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:40.200+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:40.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:40.421+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:40.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:40.432+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:40.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:40.507+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:41.150 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:41.142+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:41.246 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:41.241+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:41.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:41.397+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:41.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:41.469+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:41.519 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:41.513+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:42.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:42.156+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:42.223 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:42.216+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:42.400 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:42.392+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:42.493 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:42.485+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:42.499 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:42.493+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:42.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:42.871+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:43.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:43.006+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:43.188 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:43.181+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:43.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:43.203+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:43.356 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:43.350+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:43.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:43.464+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:43.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:43.498+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:43.896 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:43.890+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:43.982 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:43.975+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:44.177 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:44.170+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:44.227 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:44.215+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:44.395 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:44.388+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:44.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:44.492+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:44.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:44.519+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:44.899 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:44.894+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:45.030 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:45.024+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:45.172 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:45.160+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:45.244 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:45.238+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:45.407 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:45.398+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:45.474 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:45.468+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:45.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:45.507+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:45.861 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:45.855+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:46.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:45.998+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:46.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:46.170+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:46.289 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:46.284+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:46.436 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:46.430+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:46.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:46.462+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:46.508 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:46.502+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:46.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:46.848+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:47.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:47.045+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:47.164 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:47.157+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:47.289 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:47.284+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:47.417 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:47.410+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:47.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:47.443+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:47.495 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:47.489+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:47.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:47.872+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:48.104 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:48.097+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:48.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:48.126+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:48.331 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:48.324+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:48.447 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:48.440+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:48.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:48.484+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:48.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:48.536+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:48.875 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:48.868+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:48.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:48.871+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:49.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:49.133+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:49.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:49.153+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:49.359 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:49.353+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:49.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:49.434+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:49.451 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:49.444+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:49.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:49.577+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:49.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:49.847+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:49.869 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:49.852+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:50.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:50.092+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:50.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:50.153+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:50.379 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:50.368+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:50.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:50.392+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:50.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:50.438+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:50.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:50.595+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:50.837 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:50.830+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:50.837 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:50.832+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:51.129 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:51.122+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:51.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:51.141+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:51.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:51.399+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:51.448 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:51.441+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:51.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:51.456+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:51.623 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:51.615+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:51.837 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:51.831+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:51.838 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:51.834+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:52.102 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:52.095+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:52.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:52.104+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:52.421 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:52.412+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:52.442 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:52.436+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:52.447 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:52.438+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:52.673 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:52.667+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:52.825 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:52.818+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:52.825 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:52.820+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:53.088 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:53.081+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:53.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:53.110+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:53.392 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:53.386+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:53.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:53.422+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:53.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:53.491+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:53.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:53.684+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:53.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:53.867+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:53.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:53.871+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:54.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:54.060+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:54.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:54.155+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:54.400 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:54.393+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:54.461 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:54.453+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:54.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:54.465+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:54.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:54.686+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:54.848 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:54.841+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:54.848 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:54.844+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:55.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:55.063+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:55.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:55.137+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:55.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:55.388+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:55.479 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:55.472+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:55.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:55.509+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:55.668 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:55.662+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:55.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:55.890+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:55.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:55.893+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:56.093 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:56.083+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:56.139 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:56.131+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:56.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:56.353+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:56.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:56.502+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:56.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:56.506+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:56.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:56.713+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:56.873 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:56.867+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:56.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:56.871+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:57.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:57.075+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:57.133 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:57.126+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:57.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:57.391+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:57.484 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:57.474+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:57.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:57.526+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:57.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:57.726+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:57.863 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:57.855+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:57.864 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:57.859+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:58.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:58.109+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:58.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:58.145+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:58.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:58.371+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:58.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:58.433+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:58.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:58.555+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:58.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:58.696+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:58.906 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:58.899+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:58.908 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:58.901+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:27:59.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:27:59.107+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:27:59.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:27:59.156+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:27:59.359 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:27:59.352+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:27:59.443 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:27:59.436+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:27:59.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:27:59.525+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:27:59.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:27:59.680+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:27:59.872 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:59.866+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:27:59.873 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:27:59.867+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:00.073 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:00.066+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:00.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:00.146+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:00.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:00.375+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:00.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:00.461+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:00.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:00.580+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:00.657 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:00.650+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:00.852 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:00.847+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:00.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:00.850+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:01.087 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:01.080+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:01.206 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:01.198+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:01.337 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:01.331+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:01.496 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:01.489+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:01.615 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:01.608+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:01.704 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:01.697+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:01.886 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:01.881+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:01.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:01.884+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:02.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:02.087+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:02.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:02.215+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:02.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:02.308+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:02.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:02.477+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:02.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:02.644+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:02.738 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:02.731+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:02.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:02.881+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:02.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:02.884+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:03.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:03.081+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:03.220 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:03.213+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:03.267 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:03.261+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:03.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:03.507+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:03.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:03.644+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:03.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:03.749+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:03.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:03.920+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:03.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:03.922+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:04.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:04.118+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:04.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:04.171+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:04.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:04.259+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:04.473 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:04.466+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:04.630 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:04.623+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:04.754 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:04.747+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:04.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:04.932+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:04.939 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:04.933+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:05.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:05.080+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:05.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:05.146+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:05.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:05.236+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:05.461 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:05.451+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:05.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:05.646+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:05.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:05.731+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:05.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:05.947+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:05.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:05.949+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:06.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:06.114+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:06.155 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:06.147+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:06.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:06.195+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:06.496 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:06.487+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:06.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:06.663+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:06.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:06.763+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:06.916 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:06.908+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:06.917 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:06.911+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:07.097 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:07.090+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:07.131 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:07.124+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:07.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:07.228+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:07.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:07.495+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:07.711 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:07.705+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:07.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:07.746+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:07.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:07.868+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:07.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:07.871+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:08.116 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:08.109+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:08.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:08.144+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:08.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:08.214+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:08.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:08.455+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:08.728 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:08.721+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:08.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:08.775+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:08.925 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:08.918+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:08.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:08.920+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:09.147 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:09.140+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:09.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:09.173+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:09.181 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:09.176+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:09.505 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:09.496+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:09.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:09.684+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:09.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:09.787+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:09.935 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:09.927+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:09.935 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:09.930+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:09.994 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:28:09.984+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e365 v365) 2019-11-29T17:28:10.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:10.150+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:10.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:10.178+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:10.196 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:10.189+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:10.546 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:10.539+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:10.706 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:10.700+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:10.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:10.822+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:10.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:10.938+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:11.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:10.942+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:11.119 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:11.112+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:11.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:11.145+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:11.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:11.241+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:11.556 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:11.550+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:11.715 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:11.709+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:11.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:11.839+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:11.946 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:11.938+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:11.947 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:11.941+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:12.106 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:12.099+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:12.120 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:12.113+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:12.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:12.288+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:12.511 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:12.505+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:12.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:12.687+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:12.817 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:12.810+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:12.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:12.944+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:12.955 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:12.948+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:13.087 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:13.080+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:13.095 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:13.088+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:13.308 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:13.301+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:13.500 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:13.493+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:13.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:13.668+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:13.850 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:13.844+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:13.920 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:13.912+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:13.923 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:13.917+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:14.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:14.074+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:14.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:14.127+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:14.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:14.348+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:14.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:14.527+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:14.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:14.711+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:14.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:14.802+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:14.931 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:14.924+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:14.932 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:14.926+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:15.037 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:28:15.031+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e365 v365) 2019-11-29T17:28:15.090 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:15.084+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:15.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:15.109+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:15.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:15.373+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:15.556 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:15.549+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:15.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:15.750+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:15.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:15.758+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:15.909 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:15.900+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:15.921 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:15.905+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:16.095 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:16.088+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:16.165 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:16.157+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:16.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:16.425+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:16.533 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:16.526+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:16.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:16.756+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:16.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:16.769+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:16.916 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:16.910+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:16.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:16.913+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:17.096 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:17.089+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:17.130 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:17.124+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:17.479 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:17.473+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:17.509 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:17.502+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:17.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:17.752+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:17.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:17.805+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:17.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:17.883+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:17.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:17.884+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:18.112 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:18.103+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:18.155 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:18.147+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:18.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:18.426+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:18.474 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:18.464+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:18.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:18.731+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:18.854 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:18.845+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:18.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:18.932+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:18.939 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:18.933+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:19.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:19.068+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:19.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:19.201+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:19.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:19.452+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:19.465 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:28:19.457+0000 1694c700 -1 osd.5 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:55.533619+0000 front 2019-11-29T17:26:55.531588+0000 (oldest deadline 2019-11-29T17:27:39.564932+0000) 2019-11-29T17:28:19.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:28:19.767+0000 1694c700 -1 osd.1 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:52.772233+0000 front 2019-11-29T17:26:52.775465+0000 (oldest deadline 2019-11-29T17:27:38.668298+0000) 2019-11-29T17:28:19.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:19.898+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:19.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:19.945+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:19.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:19.946+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:20.120 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:28:20.112+0000 1694c700 -1 osd.4 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.576913+0000 front 2019-11-29T17:26:54.595978+0000 (oldest deadline 2019-11-29T17:27:37.970534+0000) 2019-11-29T17:28:20.156 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:28:20.134+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e365 v365) 2019-11-29T17:28:20.222 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:28:20.214+0000 1694c700 -1 osd.7 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:56.977613+0000 front 2019-11-29T17:26:56.804746+0000 (oldest deadline 2019-11-29T17:27:42.053254+0000) 2019-11-29T17:28:20.455 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:28:20.450+0000 1694c700 -1 osd.2 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.478686+0000 front 2019-11-29T17:26:54.533646+0000 (oldest deadline 2019-11-29T17:27:37.363922+0000) 2019-11-29T17:28:20.923 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:28:20.915+0000 1694c700 -1 osd.6 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:26:54.908250+0000 front 2019-11-29T17:26:54.869628+0000 (oldest deadline 2019-11-29T17:27:37.151553+0000) 2019-11-29T17:28:21.007 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:20.997+0000 1694c700 -1 osd.0 365 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:27:08.665563+0000 (oldest deadline 2019-11-29T17:27:48.665563+0000) 2019-11-29T17:28:21.016 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:28:20.999+0000 1694c700 -1 osd.0 365 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4358.0:109063 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e362) 2019-11-29T17:28:21.558 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:12:29.692 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.570 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:12:29.704 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.588 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:12:29.767 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.590 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:12:29.771 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.592 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:12:29.772 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.599 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:12:29.775 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.796 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:12:29.930 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.966 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:12:30.140 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:28:21.989 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:12:30.169 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:29:55.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:29:55.145+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:29:55.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:29:55.412+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:29:55.722 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:29:55.716+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:29:55.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:29:55.897+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:29:56.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:29:56.125+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:29:56.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:29:56.397+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:29:56.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:29:56.572+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:29:56.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:29:56.710+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:29:56.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:29:56.939+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:29:57.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:29:57.168+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:29:57.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:29:57.406+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:29:57.542 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:29:57.537+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:29:57.551 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:29:57.543+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:29:57.704 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:29:57.697+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:29:57.960 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:29:57.951+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:29:58.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:29:58.154+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:29:58.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:29:58.394+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:29:58.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:29:58.497+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:29:58.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:29:58.511+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:29:58.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:29:58.526+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:29:58.709 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:29:58.702+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:29:58.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:29:58.952+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:29:59.120 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:29:59.114+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:29:59.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:29:59.409+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:29:59.468 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:29:59.460+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:29:59.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:29:59.551+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:29:59.560 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:29:59.554+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:29:59.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:29:59.717+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:29:59.930 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:29:59.916+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:00.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:00.157+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:00.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:00.448+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:00.470 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:00.463+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:00.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:00.527+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:00.548 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:00.541+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:00.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:00.687+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:00.882 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:00.876+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:01.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:01.156+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:01.406 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:01.400+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:01.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:01.466+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:01.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:01.494+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:01.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:01.575+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:01.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:01.731+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:01.854 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:01.847+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:02.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:02.154+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:02.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:02.364+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:02.458 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:02.452+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:02.501 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:02.493+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:02.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:02.599+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:02.763 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:02.757+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:02.817 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:02.808+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:03.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:03.179+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:03.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:03.404+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:03.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:03.436+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:03.499 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:03.491+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:03.628 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:03.620+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:03.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:03.740+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:03.843 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:03.836+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:04.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:04.178+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:04.407 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:04.401+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:04.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:04.434+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:04.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:04.541+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:04.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:04.671+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:04.704 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:04.696+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:04.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:04.827+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:05.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:05.164+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:05.434 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:05.428+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:05.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:05.438+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:05.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:05.520+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:05.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:05.637+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:05.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:05.653+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:05.885 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:05.878+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:06.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:06.178+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:06.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:06.408+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:06.481 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:06.474+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:06.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:06.567+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:06.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:06.611+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:06.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:06.631+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:06.895 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:06.887+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:07.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:07.165+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:07.454 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:07.448+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:07.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:07.510+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:07.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:07.522+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:07.607 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:07.598+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:07.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:07.676+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:07.926 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:07.918+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:08.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:08.211+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:08.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:08.473+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:08.547 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:08.540+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:08.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:08.565+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:08.629 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:08.622+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:08.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:08.647+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:08.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:08.905+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:09.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:09.246+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:09.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:09.463+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:09.544 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:09.537+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:09.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:09.580+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:09.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:09.618+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:09.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:09.664+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:09.960 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:09.952+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:10.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:10.245+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:10.466 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:10.460+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:10.566 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:10.559+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:10.595 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:10.588+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:10.623 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:10.616+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:10.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:10.666+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:10.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:10.978+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:11.248 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:11.240+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:11.500 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:11.493+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:11.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:11.551+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:11.621 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:11.612+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:11.630 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:11.624+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:11.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:11.644+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:11.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:11.976+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:12.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:12.232+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:12.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:12.504+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:12.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:12.584+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:12.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:12.636+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:12.657 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:12.651+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:12.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:12.650+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:12.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:12.939+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:13.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:13.241+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:13.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:13.537+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:13.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:13.571+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:13.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:13.609+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:13.635 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:13.629+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:13.663 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:13.656+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:13.928 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:13.920+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:14.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:14.207+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:14.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:14.539+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:14.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:14.581+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:14.604 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:14.598+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:14.676 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:14.669+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:14.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:14.675+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:14.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:14.957+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:15.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:15.168+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:15.539 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:15.532+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:15.573 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:15.552+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:15.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:15.575+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:15.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:15.688+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:15.705 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:15.698+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:15.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:15.943+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:16.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:16.172+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:16.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:16.542+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:16.552 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:16.546+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:16.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:16.549+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:16.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:16.687+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:16.723 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:16.716+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:16.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:16.950+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:17.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:17.203+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:17.507 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:17.501+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:17.538 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:17.531+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:17.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:17.538+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:17.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:17.692+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:17.715 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:17.709+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:17.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:17.923+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:18.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:18.160+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:18.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:18.547+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:18.554 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:18.545+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:18.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:18.573+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:18.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:18.673+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:18.747 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:18.741+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:18.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:18.916+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:19.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:19.162+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:19.522 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:19.516+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:19.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:19.533+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:19.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:19.578+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:19.696 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:19.690+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:19.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:19.718+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:19.903 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:19.895+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:20.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:20.149+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:20.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:20.521+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:20.543 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:20.537+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:20.613 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:20.607+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:20.655 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:20.648+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:20.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:20.725+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:20.920 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:20.913+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:21.124 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:21.117+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:21.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:21.563+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:21.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:21.586+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:21.633 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:21.627+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:21.639 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:21.633+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:21.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:21.724+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:21.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:21.945+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:22.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:22.130+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:22.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:22.521+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:22.637 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:22.630+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:22.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:22.654+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:22.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:22.685+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:22.768 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:22.761+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:22.996 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:22.989+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:23.109 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:23.102+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:23.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:23.491+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:23.647 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:23.641+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:23.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:23.684+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:23.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:23.735+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:23.810 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:23.802+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:23.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:23.962+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:24.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:24.130+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:24.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:24.529+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:24.642 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:24.632+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:24.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:24.670+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:24.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:24.753+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:24.821 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:24.814+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:25.023 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:25.016+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:25.196 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:25.187+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:25.505 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:25.500+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:25.547 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:30:25.541+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e372 v372) 2019-11-29T17:30:25.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:25.642+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:25.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:25.685+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:25.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:25.802+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:25.855 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:25.848+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:26.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:26.045+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:26.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:26.141+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:26.482 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:26.476+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:26.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:26.620+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:26.653 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:26.647+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:26.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:26.775+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:26.851 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:26.844+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:27.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:27.032+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:27.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:27.163+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:27.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:27.526+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:27.597 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:27.589+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:27.655 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:27.648+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:27.778 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:27.772+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:27.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:27.893+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:28.000 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:27.993+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:28.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:28.134+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:28.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:28.512+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:28.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:28.548+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:28.645 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:28.634+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:28.808 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:28.800+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:28.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:28.935+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:28.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:28.980+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:29.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:29.146+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:29.491 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:29.485+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:29.559 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:29.551+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:29.611 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:29.606+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:29.764 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:29.758+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:29.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:30:29.984+0000 1694c700 -1 osd.6 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.956667+0000 front 2019-11-29T17:29:12.719906+0000 (oldest deadline 2019-11-29T17:29:56.511846+0000) 2019-11-29T17:30:30.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:30:30.020+0000 1694c700 -1 osd.5 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.436544+0000 front 2019-11-29T17:29:12.430492+0000 (oldest deadline 2019-11-29T17:29:55.675729+0000) 2019-11-29T17:30:30.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:30.179+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:30:30.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:30:30.465+0000 1694c700 -1 osd.1 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.427547+0000 front 2019-11-29T17:29:12.399817+0000 (oldest deadline 2019-11-29T17:29:54.681706+0000) 2019-11-29T17:30:30.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:30:30.604+0000 1694c700 -1 osd.4 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.648875+0000 front 2019-11-29T17:29:12.672966+0000 (oldest deadline 2019-11-29T17:29:57.912986+0000) 2019-11-29T17:30:30.617 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:30:30.612+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e372 v372) 2019-11-29T17:30:30.634 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:30:30.629+0000 1694c700 -1 osd.3 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:10.169657+0000 front 2019-11-29T17:29:10.224011+0000 (oldest deadline 2019-11-29T17:29:56.062870+0000) 2019-11-29T17:30:30.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:30:30.809+0000 1694c700 -1 osd.2 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:12.214326+0000 front 2019-11-29T17:29:12.400660+0000 (oldest deadline 2019-11-29T17:29:55.076195+0000) 2019-11-29T17:30:31.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:30:31.189+0000 1694c700 -1 osd.7 372 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:29:11.427071+0000 front 2019-11-29T17:29:11.020121+0000 (oldest deadline 2019-11-29T17:29:54.422659+0000) 2019-11-29T17:31:02.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.225+0000 114ab700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.252+0000 3578b700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.392 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.297+0000 3578b700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.336+0000 31f84700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.358+0000 3578b700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.543 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.381+0000 3678d700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.582 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.428+0000 31f84700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:02.863 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:02.625+0000 31f84700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:03.108 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:03.064+0000 34789700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:03.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:03.286+0000 38f92700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:03.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:03.313+0000 37f90700 -1 osd.0 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:03.649 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:31:03.610+0000 30f82700 -1 osd.3 377 build_incremental_map_msg missing incremental map 377 2019-11-29T17:31:28.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:28.258+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:29.246 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:29.239+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:29.291 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:29.284+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:29.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:29.934+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:30.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:30.244+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:30.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:30.250+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:30.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:30.338+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:30.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:30.916+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:31.220 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:31.213+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:31.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:31.289+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:31.382 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:31.374+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:31.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:31.934+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:31.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:31.968+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:32.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:32.190+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:32.283 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:32.276+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:32.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:32.396+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:32.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:32.512+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:32.972 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:32.966+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:32.978 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:32.970+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:33.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:33.026+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:33.236 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:33.230+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:33.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:33.233+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:33.413 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:33.405+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:33.514 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:33.506+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:33.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:33.961+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:34.001 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:33.996+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:34.071 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:34.064+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:34.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:34.198+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:34.244 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:34.238+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:34.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:34.417+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:34.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:34.522+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:35.008 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:35.002+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:35.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:35.005+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:35.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:35.018+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:35.218 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:35.211+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:35.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:35.273+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:35.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:35.468+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:35.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:35.559+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:36.030 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:36.023+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:36.054 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:36.049+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:36.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:36.068+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:36.240 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:36.233+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:36.324 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:36.317+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:36.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:36.454+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:36.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:36.555+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:37.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:37.063+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:37.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:37.084+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:37.104 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:37.099+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:37.216 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:37.209+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:37.283 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:37.277+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:37.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:37.455+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:37.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:37.527+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:38.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:38.047+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:38.128 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:38.122+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:38.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:38.128+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:38.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:38.256+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:38.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:38.319+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:38.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:38.500+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:38.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:38.566+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:39.030 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:39.023+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:39.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:39.088+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:39.111 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:39.105+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:39.114 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:39.109+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:39.222 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:39.216+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:39.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:39.364+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:39.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:39.535+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:39.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:39.588+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:40.033 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:40.027+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:40.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:40.106+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:40.139 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:40.132+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:40.140 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:40.134+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:40.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:40.271+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:40.368 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:40.361+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:40.516 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:40.509+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:40.584 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:40.578+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:41.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:41.079+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:41.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:41.130+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:41.139 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:41.132+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:41.147 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:41.142+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:41.283 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:41.276+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:41.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:41.390+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:41.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:41.527+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:41.623 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:41.616+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:42.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:42.084+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:42.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:42.086+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:42.105 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:42.099+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:42.145 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:42.140+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:42.316 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:42.308+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:42.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:42.420+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:42.547 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:42.541+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:42.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:42.579+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:43.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:43.064+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:43.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:43.066+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:43.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:43.101+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:43.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:43.152+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:43.313 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:43.302+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:43.444 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:43.437+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:43.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:43.568+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:43.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:43.596+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:44.112 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:44.104+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:44.112 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:44.107+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:44.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:44.114+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:44.126 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:44.119+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:44.340 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:44.333+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:44.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:44.479+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:44.590 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:44.583+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:44.611 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:44.604+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:45.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:45.104+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:45.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:45.127+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:45.133 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:45.129+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:45.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:45.160+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:45.299 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:45.292+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:45.481 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:45.474+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:45.630 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:45.623+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:45.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:45.642+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:46.109 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:46.102+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:46.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:46.104+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:46.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:46.121+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:46.192 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:46.186+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:46.331 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:46.325+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:46.459 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:46.452+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:46.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:46.613+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:46.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:46.642+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:47.124 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:47.118+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:47.126 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:47.121+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:47.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:47.122+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:47.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:47.236+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:47.351 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:47.344+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:47.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:47.450+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:47.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:47.638+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:47.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:47.687+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:48.108 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:48.100+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:48.109 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:48.104+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:48.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:48.139+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:48.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:48.225+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:48.359 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:48.347+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:48.486 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:48.479+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:48.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:48.623+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:48.706 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:48.698+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:49.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:49.064+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:49.073 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:49.066+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:49.139 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:49.132+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:49.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:49.224+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:49.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:49.397+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:49.479 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:49.473+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:49.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:49.655+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:49.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:49.735+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:50.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:50.027+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:50.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:50.029+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:50.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:50.119+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:50.222 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:50.213+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:50.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:50.439+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:50.450 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:50.443+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:50.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:50.622+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:50.783 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:50.776+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:51.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:50.998+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:51.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:51.000+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:51.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:51.113+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:51.184 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:51.176+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:51.411 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:51.405+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:51.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:51.471+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:51.604 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:51.597+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:51.822 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:51.815+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:51.974 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:51.967+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:51.976 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:51.969+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:52.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:52.158+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:52.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:52.212+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:52.394 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:52.387+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:52.496 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:52.490+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:52.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:52.622+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:52.862 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:52.857+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:52.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:52.985+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:52.994 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:52.990+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:53.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:53.150+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:53.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:53.215+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:53.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:53.422+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:53.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:53.447+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:53.619 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:53.612+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:53.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:53.871+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:53.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:53.975+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:53.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:53.979+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:54.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:54.170+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:54.264 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:54.258+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:54.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:54.381+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:54.499 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:54.492+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:54.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:54.595+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:54.859 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:54.852+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:54.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:54.962+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:54.970 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:54.965+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:55.217 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:55.210+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:55.313 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:55.307+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:55.432 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:55.425+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:55.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:55.522+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:55.599 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:55.593+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:55.905 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:55.899+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:55.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:55.981+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:55.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:55.985+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:56.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:56.246+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:56.286 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:56.281+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:56.402 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:56.395+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:56.581 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:56.574+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:56.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:56.614+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:56.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:56.909+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:57.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:57.025+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:57.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:57.029+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:57.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:57.228+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:57.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:57.240+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:57.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:57.364+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:57.601 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:57.593+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:57.612 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:57.606+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:57.967 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:57.960+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:58.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:58.064+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:58.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:58.067+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:58.241 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:58.234+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:58.259 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:58.252+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:58.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:58.334+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:58.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:58.582+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:58.650 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:58.644+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:58.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:58.958+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:31:59.119 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:59.112+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:31:59.121 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:31:59.114+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:31:59.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:31:59.271+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:31:59.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:31:59.274+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:31:59.374 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:31:59.369+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:31:59.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:31:59.585+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:31:59.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:31:59.696+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:31:59.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:31:59.943+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:00.170 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:00.164+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:00.171 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:00.165+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:00.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:00.238+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:00.253 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:00.247+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:00.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:00.364+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:00.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:00.579+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:00.711 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:00.703+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:00.967 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:00.960+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:01.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:01.180+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:01.188 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:01.182+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:01.208 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:01.202+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:01.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:01.273+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:01.351 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:01.344+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:01.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:01.586+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:01.745 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:01.738+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:01.958 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:01.952+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:02.145 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:02.140+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:02.146 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:02.141+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:02.163 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:02.157+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:02.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:02.230+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:02.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:02.377+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:02.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:02.584+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:02.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:02.773+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:03.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:03.002+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:03.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:03.170+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:03.178 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:03.173+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:03.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:03.195+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:03.204 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:03.199+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:03.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:03.418+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:03.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:03.581+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:03.762 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:03.754+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:03.993 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:03.987+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:04.135 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:04.126+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:04.135 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:04.127+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:04.207 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:04.201+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:04.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:04.238+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:04.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:04.458+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:04.567 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:04.559+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:04.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:04.797+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:05.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:05.022+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:05.167 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:05.160+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:05.167 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:05.162+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:05.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:05.231+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:05.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:05.236+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:05.465 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:05.457+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:05.524 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:05.516+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:05.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:05.776+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:05.914 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:32:05.905+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e378 v378) 2019-11-29T17:32:06.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:06.033+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:06.131 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:06.124+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:06.134 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:06.129+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:06.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:06.211+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:06.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:06.246+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:06.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:06.460+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:06.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:06.571+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:06.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:06.821+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:07.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:07.056+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:07.179 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:07.168+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:07.179 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:07.172+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:07.238 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:07.232+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:07.296 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:07.289+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:07.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:07.437+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:07.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:07.563+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:07.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:07.862+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:08.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:08.033+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:08.179 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:08.171+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:08.180 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:08.174+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:08.259 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:08.253+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:08.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:08.270+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:08.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:08.456+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:08.543 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:08.535+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:08.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:08.875+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:08.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:08.989+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:09.173 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:09.166+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:09.175 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:09.168+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:09.288 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:09.274+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:09.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:09.278+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:09.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:09.459+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:09.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:09.529+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:09.867 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:09.859+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:10.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:10.014+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:10.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:10.201+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:10.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:10.204+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:10.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:10.251+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:10.261 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:10.255+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:10.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:32:10.449+0000 1694c700 -1 osd.5 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:42.455700+0000 front 2019-11-29T17:30:42.465825+0000 (oldest deadline 2019-11-29T17:31:27.427943+0000) 2019-11-29T17:32:10.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:10.578+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:10.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:10.867+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:10.989 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:32:10.979+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e378 v378) 2019-11-29T17:32:11.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:32:11.041+0000 1694c700 -1 osd.1 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.397289+0000 front 2019-11-29T17:30:47.195284+0000 (oldest deadline 2019-11-29T17:31:32.417999+0000) 2019-11-29T17:32:11.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:11.195+0000 1694c700 -1 osd.0 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:30:59.019276+0000 (oldest deadline 2019-11-29T17:31:39.019276+0000) 2019-11-29T17:32:11.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:11.197+0000 1694c700 -1 osd.0 378 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e376) 2019-11-29T17:32:11.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:32:11.226+0000 1694c700 -1 osd.7 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.792760+0000 front 2019-11-29T17:30:46.127683+0000 (oldest deadline 2019-11-29T17:31:28.966435+0000) 2019-11-29T17:32:11.300 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:32:11.294+0000 1694c700 -1 osd.2 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:47.049400+0000 front 2019-11-29T17:30:47.311786+0000 (oldest deadline 2019-11-29T17:31:32.662054+0000) 2019-11-29T17:32:11.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:32:11.618+0000 1694c700 -1 osd.4 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:44.795537+0000 front 2019-11-29T17:30:44.740347+0000 (oldest deadline 2019-11-29T17:31:30.017759+0000) 2019-11-29T17:32:11.701 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:32:11.691+0000 34f8a700 -1 osd.0 379 build_incremental_map_msg missing incremental map 377 2019-11-29T17:32:11.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:32:11.846+0000 1694c700 -1 osd.6 378 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:30:46.237671+0000 front 2019-11-29T17:30:46.210403+0000 (oldest deadline 2019-11-29T17:31:28.501723+0000) 2019-11-29T17:32:21.387 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:16:29.522 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.407 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:16:29.541 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.416 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:16:29.597 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.419 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:16:29.600 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.425 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:16:29.604 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.425 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:16:29.605 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.644 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:16:29.778 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.653 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:16:29.833 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:21.724 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:16:29.904 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:32:37.837 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:32:37.813+0000 38791700 -1 osd.3 378 build_incremental_map_msg missing incremental map 377 2019-11-29T17:32:37.992 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:32:37.976+0000 2144f700 -1 reset not still connected to 0xeb14730 2019-11-29T17:33:26.480 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:17:34.615 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.493 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:17:34.628 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.512 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:17:34.693 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.553 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:17:34.733 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.555 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:17:34.736 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.562 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:17:34.743 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.567 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:17:34.702 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.614 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:17:34.794 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:26.673 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:17:34.854 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:33:41.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:41.959+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:42.262 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:42.254+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:42.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:42.515+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:42.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:42.615+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:42.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:42.945+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:43.059 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:43.053+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:43.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:43.231+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:43.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:43.526+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:43.562 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:43.555+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:43.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:43.570+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:43.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:43.968+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:44.103 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:44.096+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:44.279 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:44.272+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:44.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:44.572+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:44.579 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:44.571+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:44.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:44.620+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:44.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:44.963+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:45.055 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:45.049+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:45.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:45.317+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:45.593 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:45.587+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:45.594 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:45.585+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:45.616 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:45.608+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:45.909 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:45.901+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:45.944 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:45.937+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:46.098 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:46.091+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:46.352 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:46.344+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:46.585 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:46.577+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:46.611 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:46.606+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:46.619 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:46.613+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:46.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:46.872+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:46.942 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:46.935+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:47.088 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:47.082+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:47.387 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:47.379+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:47.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:47.628+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:47.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:47.637+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:47.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:47.651+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:47.899 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:47.890+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:47.899 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:47.891+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:48.055 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:48.048+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:48.415 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:48.407+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:48.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:48.629+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:48.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:48.677+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:48.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:48.677+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:48.913 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:48.904+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:48.961 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:48.917+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:49.095 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:49.089+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:49.421 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:49.413+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:49.650 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:49.644+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:49.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:49.668+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:49.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:49.667+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:49.870 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:49.863+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:49.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:49.887+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:50.054 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:50.047+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:50.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:50.458+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:50.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:50.621+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:50.677 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:50.670+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:50.713 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:50.705+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:50.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:50.830+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:50.876 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:50.866+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:51.020 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:51.012+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:51.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:51.501+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:51.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:51.591+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:51.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:51.627+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:51.759 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:51.752+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:51.842 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:51.834+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:51.887 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:51.879+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:52.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:52.020+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:52.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:52.531+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:52.602 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:52.596+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:52.635 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:52.630+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:52.767 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:52.759+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:52.844 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:52.836+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:52.932 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:52.924+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:53.046 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:53.039+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:53.500 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:53.493+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:53.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:53.615+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:53.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:53.663+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:53.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:53.737+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:53.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:53.865+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:53.893 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:53.886+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:54.018 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:54.012+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:54.475 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:54.468+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:54.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:54.592+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:54.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:54.664+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:54.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:54.774+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:54.835 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:54.828+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:54.939 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:54.929+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:55.070 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:55.064+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:55.440 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:55.433+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:55.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:55.637+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:55.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:55.652+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:55.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:55.767+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:55.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:55.785+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:55.980 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:55.973+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:56.092 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:56.085+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:56.405 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:56.398+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:56.628 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:56.622+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:56.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:56.632+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:56.734 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:56.728+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:56.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:56.834+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:56.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:56.941+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:57.053 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:57.045+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:57.374 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:57.367+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:57.657 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:57.650+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:57.662 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:57.657+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:57.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:57.687+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:57.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:57.839+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:57.963 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:57.956+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:58.093 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:58.085+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:58.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:58.363+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:58.689 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:58.681+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:58.706 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:58.699+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:58.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:58.726+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:58.860 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:58.853+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:33:58.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:58.926+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:59.124 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:33:59.116+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:33:59.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:33:59.416+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:33:59.657 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:33:59.649+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:33:59.676 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:33:59.669+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:33:59.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:33:59.696+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:33:59.912 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:33:59.905+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:33:59.915 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:33:59.906+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:00.090 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:00.084+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:00.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:00.456+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:00.654 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:00.647+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:00.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:00.653+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:00.736 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:00.728+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:00.886 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:00.880+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:00.915 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:00.908+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:01.090 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:01.083+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:01.455 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:01.448+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:01.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:01.631+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:01.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:01.676+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:01.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:01.781+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:01.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:01.867+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:01.928 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:01.920+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:02.074 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:02.068+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:02.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:02.483+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:02.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:02.632+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:02.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:02.726+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:02.824 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:02.816+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:02.905 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:02.898+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:02.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:02.936+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:03.045 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:03.035+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:03.528 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:03.521+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:03.615 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:03.609+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:03.778 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:03.771+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:03.823 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:03.815+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:03.912 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:03.904+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:03.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:03.962+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:04.012 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:03.999+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:04.507 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:04.500+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:04.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:04.627+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:04.754 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:04.748+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:04.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:04.813+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:04.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:04.943+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:05.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:05.004+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:05.049 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:05.038+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:05.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:05.535+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:05.665 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:05.658+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:05.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:05.724+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:05.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:05.768+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:05.942 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:05.934+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:06.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:05.998+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:06.057 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:06.049+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:06.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:06.568+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:06.643 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:06.637+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:06.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:06.686+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:06.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:06.772+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:06.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:06.889+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:07.029 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:07.022+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:07.073 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:07.066+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:07.561 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:07.554+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:07.616 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:07.609+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:07.695 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:07.690+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:07.824 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:07.817+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:07.876 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:07.869+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:08.001 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:07.996+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:08.062 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:08.056+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:08.519 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:08.512+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:08.645 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:08.637+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:08.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:08.698+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:08.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:08.825+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:08.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:08.896+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:09.035 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:09.026+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:09.057 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:09.049+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:09.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:09.479+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:09.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:09.644+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:09.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:09.727+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:09.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:09.790+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:09.936 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:09.928+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:10.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:10.022+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:10.045 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:10.037+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:10.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:10.476+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:10.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:10.636+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:10.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:10.686+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:10.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:10.776+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:10.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:10.955+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:11.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:11.016+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:11.085 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:11.078+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:11.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:11.517+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:11.662 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:11.657+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:11.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:11.666+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:11.753 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:11.744+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:11.934 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:11.927+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:12.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:11.999+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:12.056 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:12.049+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:12.526 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:12.518+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:12.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:12.612+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:12.660 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:12.653+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:12.734 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:12.727+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:12.909 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:12.897+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:13.051 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:13.044+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:13.092 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:13.085+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:13.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:13.479+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:13.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:13.572+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:13.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:13.643+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:13.745 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:13.739+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:13.919 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:13.907+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:14.045 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:14.039+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:14.087 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:14.078+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:14.547 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:14.540+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:14.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:14.560+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:14.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:14.693+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:14.706 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:14.698+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:14.926 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:14.918+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:15.036 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:15.029+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:15.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:15.035+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:15.516 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:15.508+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:15.617 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:15.609+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:15.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:15.649+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:15.698 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:15.691+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:15.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:15.934+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:16.030 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:16.023+0000 1694c700 -1 osd.3 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:58.303360+0000 front 2019-11-29T17:32:58.269849+0000 (oldest deadline 2019-11-29T17:33:42.351245+0000) 2019-11-29T17:34:16.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:34:16.040+0000 1694c700 -1 osd.4 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.181381+0000 front 2019-11-29T17:33:00.183146+0000 (oldest deadline 2019-11-29T17:33:45.580687+0000) 2019-11-29T17:34:16.556 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:34:16.547+0000 1694c700 -1 osd.5 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.919481+0000 front 2019-11-29T17:32:59.943725+0000 (oldest deadline 2019-11-29T17:33:41.690905+0000) 2019-11-29T17:34:16.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:34:16.613+0000 1694c700 -1 osd.1 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:59.874512+0000 front 2019-11-29T17:32:59.615100+0000 (oldest deadline 2019-11-29T17:33:42.111189+0000) 2019-11-29T17:34:16.636 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:34:16.630+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e384 v384) 2019-11-29T17:34:16.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:34:16.653+0000 1694c700 -1 osd.2 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:57.986090+0000 front 2019-11-29T17:32:57.846784+0000 (oldest deadline 2019-11-29T17:33:42.303142+0000) 2019-11-29T17:34:16.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:34:16.684+0000 1694c700 -1 osd.6 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:33:00.618679+0000 front 2019-11-29T17:33:00.813070+0000 (oldest deadline 2019-11-29T17:33:43.485045+0000) 2019-11-29T17:34:16.918 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:34:16.910+0000 1694c700 -1 osd.7 384 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:32:56.041673+0000 front 2019-11-29T17:32:56.044598+0000 (oldest deadline 2019-11-29T17:33:41.655627+0000) 2019-11-29T17:34:51.861 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:34:51.807+0000 30f82700 -1 osd.3 389 build_incremental_map_msg missing incremental map 388 2019-11-29T17:35:15.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:15.500+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:15.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:15.889+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:15.945 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:15.937+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:16.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:16.495+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:16.863 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:16.858+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:16.909 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:16.903+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:17.530 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:17.516+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:17.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:17.862+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:17.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:17.945+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:18.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:18.006+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:18.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:18.478+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:18.822 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:18.815+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:18.886 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:18.880+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:18.978 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:18.971+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:18.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:18.992+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:19.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:19.192+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:19.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:19.514+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:19.839 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:19.831+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:19.858 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:19.852+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:19.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:19.979+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:19.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:19.983+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:20.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:20.237+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:20.524 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:20.517+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:20.843 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:20.836+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:20.854 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:20.847+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:20.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:20.976+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:21.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:21.000+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:21.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:21.204+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:21.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:21.535+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:21.690 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:21.685+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:21.802 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:21.796+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:21.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:21.814+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:21.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:21.957+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:22.019 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:22.013+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:22.196 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:22.189+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:22.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:22.499+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:22.665 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:22.660+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:22.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:22.774+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:22.801 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:22.795+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:23.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:22.994+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:23.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:23.020+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:23.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:23.145+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:23.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:23.471+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:23.695 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:23.690+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:23.803 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:23.797+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:23.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:23.801+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:24.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:24.022+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:24.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:24.043+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:24.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:24.147+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:24.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:24.439+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:24.717 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:24.710+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:24.791 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:24.784+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:24.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:24.818+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:24.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:24.984+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:25.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:25.071+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:25.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:25.174+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:25.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:25.473+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:25.696 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:25.689+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:25.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:25.775+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:25.824 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:25.817+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:25.963 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:25.955+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:26.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:26.032+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:26.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:26.142+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:26.486 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:26.478+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:26.703 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:26.697+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:26.787 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:26.778+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:26.810 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:26.803+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:26.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:26.915+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:27.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:27.024+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:27.172 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:27.164+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:27.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:27.481+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:27.687 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:27.680+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:27.689 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:27.682+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:27.795 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:27.788+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:27.835 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:27.829+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:27.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:27.901+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:28.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:28.029+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:28.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:28.185+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:28.506 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:28.499+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:28.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:28.731+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:28.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:28.736+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:28.757 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:28.750+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:28.823 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:28.817+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:28.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:28.917+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:29.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:29.020+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:29.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:29.186+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:29.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:29.513+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:29.744 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:29.735+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:29.744 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:29.738+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:29.748 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:29.741+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:29.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:29.804+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:29.920 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:29.914+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:29.990 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:29.984+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:30.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:30.205+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:30.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:30.546+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:30.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:30.699+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:30.782 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:30.776+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:30.783 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:30.777+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:30.825 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:30.817+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:30.954 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:30.947+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:31.002 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:30.994+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:31.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:31.226+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:31.549 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:31.541+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:31.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:31.737+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:31.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:31.766+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:31.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:31.767+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:31.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:31.778+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:31.949 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:31.943+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:31.962 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:31.956+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:32.247 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:32.241+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:32.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:32.565+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:32.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:32.696+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:32.806 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:32.799+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:32.819 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:32.812+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:32.819 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:32.814+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:32.922 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:32.915+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:32.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:32.946+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:33.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:33.204+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:33.544 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:33.536+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:33.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:33.719+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:33.790 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:33.783+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:33.856 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:33.848+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:33.857 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:33.851+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:33.969 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:33.962+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:33.983 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:33.976+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:34.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:34.183+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:34.576 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:34.563+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:34.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:34.694+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:34.772 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:34.764+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:34.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:34.893+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:34.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:34.896+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:34.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:34.972+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:34.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:34.973+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:35.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:35.164+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:35.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:35.621+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:35.734 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:35.726+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:35.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:35.743+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:35.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:35.867+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:35.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:35.870+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:35.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:35.942+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:36.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:36.018+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:36.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:36.130+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:36.647 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:36.639+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:36.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:36.776+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:36.791 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:36.785+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:36.865 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:36.859+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:36.866 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:36.860+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:36.998 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:36.991+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:37.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:37.018+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:37.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:37.112+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:37.619 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:37.612+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:37.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:37.769+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:37.822 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:37.816+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:37.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:37.869+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:37.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:37.871+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:37.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:37.990+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:38.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:38.023+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:38.105 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:38.098+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:38.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:38.598+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:38.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:38.776+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:38.811 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:38.805+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:38.875 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:38.870+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:38.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:38.873+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:39.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:39.017+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:39.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:39.026+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:39.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:39.128+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:39.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:39.621+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:39.797 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:39.791+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:39.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:39.821+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:39.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:39.882+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:39.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:39.883+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:40.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:40.002+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:40.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:40.046+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:40.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:40.122+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:40.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:40.600+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:40.833 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:40.827+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:40.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:40.872+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:40.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:40.887+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:40.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:40.889+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:41.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:41.037+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:41.093 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:41.086+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:41.175 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:41.169+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:41.615 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:41.607+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:41.857 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:41.851+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:41.858 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:41.852+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:41.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:41.871+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:41.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:41.910+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:42.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:42.063+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:42.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:42.098+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:42.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:42.159+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:42.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:42.566+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:42.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:42.888+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:42.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:42.895+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:42.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:42.899+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:42.908 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:42.902+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:43.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:43.072+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:43.089 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:43.083+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:43.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:43.157+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:43.554 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:43.548+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:43.874 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:43.867+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:43.922 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:43.916+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:43.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:43.920+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:43.933 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:43.927+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:44.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:44.054+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:44.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:44.058+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:44.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:44.139+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:44.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:44.545+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:44.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:44.874+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:44.885 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:44.878+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:44.886 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:44.880+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:44.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:44.959+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:45.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:45.017+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:45.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:45.084+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:45.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:45.129+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:45.568 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:45.561+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:45.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:45.867+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:45.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:45.884+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:45.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:45.886+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:45.986 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:45.980+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:46.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:46.039+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:46.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:46.102+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:46.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:46.117+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:46.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:46.564+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:46.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:46.896+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:46.910 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:46.902+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:46.911 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:35:46.901+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e390 v390) 2019-11-29T17:35:46.911 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:46.905+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:46.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:46.966+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:47.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:47.030+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:47.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:47.122+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:47.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:47.150+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:47.544 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:47.537+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:47.919 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:47.910+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:47.961 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:47.954+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:47.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:47.959+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:48.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:48.001+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:48.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:48.046+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:48.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:48.082+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:48.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:48.198+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:48.543 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:48.535+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:48.922 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:48.915+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:48.923 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:48.917+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:48.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:48.925+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:48.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:48.969+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:49.028 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:49.021+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:49.097 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:35:49.089+0000 1694c700 -1 osd.7 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:32.624533+0000 front 2019-11-29T17:34:32.625825+0000 (oldest deadline 2019-11-29T17:35:18.498638+0000) 2019-11-29T17:35:49.257 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:49.251+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:49.576 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:49.568+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:49.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:49.920+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:49.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:49.936+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:49.953 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:49.946+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:49.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:49.949+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:50.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:50.051+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:50.308 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:50.303+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:50.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:50.547+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:50.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:50.877+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:50.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:50.917+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:50.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:50.920+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:50.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:50.986+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:51.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:51.079+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:51.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:51.273+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:51.543 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:51.535+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:51.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:51.854+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:51.933 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:35:51.922+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e390 v390) 2019-11-29T17:35:51.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:51.950+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:51.962 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:51.956+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:51.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:51.959+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:52.122 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:52.114+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:52.239 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:52.234+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:52.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:52.575+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:52.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:52.837+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:52.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:52.920+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:52.928 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:52.922+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:52.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:52.924+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:53.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:53.086+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:53.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:53.197+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:53.626 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:53.618+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:53.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:53.855+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:53.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:53.907+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:53.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:53.943+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:53.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:53.945+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:54.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:54.116+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:54.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:54.215+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:54.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:54.595+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:54.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:54.906+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:55.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:54.906+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:55.109 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:54.937+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:55.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:54.938+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:55.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:55.168+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:55.190 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:55.184+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:55.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:55.628+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:55.891 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:55.885+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:55.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:55.908+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:55.987 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:55.982+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:55.988 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:55.983+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:56.152 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:56.141+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:56.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:56.150+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:56.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:56.598+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:56.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:56.909+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:56.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:56.932+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:56.953 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:35:56.942+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e390 v390) 2019-11-29T17:35:57.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:57.015+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:57.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:57.017+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:57.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:57.150+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:57.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:57.161+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:57.601 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:57.595+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:57.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:57.895+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:57.987 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:57.982+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:57.988 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:57.982+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:57.989 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:57.984+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:58.116 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:58.109+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:58.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:58.133+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:58.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:58.553+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:58.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:58.875+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:35:59.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:59.024+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:35:59.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:35:59.027+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:35:59.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:35:59.036+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:35:59.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:35:59.085+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:35:59.099 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:35:59.092+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:35:59.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:35:59.519+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:35:59.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:35:59.859+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:36:00.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:00.004+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:36:00.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:00.008+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:36:00.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:36:00.012+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:36:00.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:36:00.041+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:36:00.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:36:00.125+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:36:00.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:36:00.506+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:36:00.822 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:36:00.815+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:36:01.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:36:01.000+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:36:01.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:01.016+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:36:01.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:01.019+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:36:01.039 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:36:01.033+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:36:01.128 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:36:01.122+0000 1694c700 -1 osd.5 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:29.213810+0000 front 2019-11-29T17:34:29.661765+0000 (oldest deadline 2019-11-29T17:35:14.986934+0000) 2019-11-29T17:36:01.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:36:01.475+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:36:01.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:36:01.846+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:36:02.006 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:36:01.999+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:36:02.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:36:02.018+0000 1694c700 -1 osd.1 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.861057+0000 front 2019-11-29T17:34:33.488258+0000 (oldest deadline 2019-11-29T17:35:15.132759+0000) 2019-11-29T17:36:02.036 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:36:02.028+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e390 v390) 2019-11-29T17:36:02.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:02.054+0000 1694c700 -1 osd.0 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:34:47.127481+0000 (oldest deadline 2019-11-29T17:35:27.127481+0000) 2019-11-29T17:36:02.063 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:36:02.057+0000 1694c700 -1 osd.0 390 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e388) 2019-11-29T17:36:02.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:36:02.497+0000 1694c700 -1 osd.4 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:30.127480+0000 front 2019-11-29T17:34:29.608281+0000 (oldest deadline 2019-11-29T17:35:15.437563+0000) 2019-11-29T17:36:02.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:36:02.884+0000 1694c700 -1 osd.6 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.816374+0000 front 2019-11-29T17:34:33.814444+0000 (oldest deadline 2019-11-29T17:35:18.066712+0000) 2019-11-29T17:36:03.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:36:03.042+0000 1694c700 -1 osd.2 390 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:34:33.569047+0000 front 2019-11-29T17:34:33.874899+0000 (oldest deadline 2019-11-29T17:35:17.648439+0000) 2019-11-29T17:36:18.364 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:20:26.498 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.375 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:20:26.556 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.379 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:20:26.559 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.382 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:20:26.562 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.382 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:20:26.563 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.391 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:20:26.525 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.603 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:20:26.738 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.625 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:20:26.805 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:36:18.662 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:20:26.843 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:37:27.337 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:27.332+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:27.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:27.402+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:27.562 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:27.556+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:28.318 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:28.311+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:28.401 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:28.393+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:28.513 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:28.506+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:28.568 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:28.560+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:29.188 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:29.181+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:29.316 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:29.310+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:29.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:29.400+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:29.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:29.482+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:29.569 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:29.563+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:30.236 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:30.228+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:30.324 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:30.317+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:30.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:30.372+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:30.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:30.518+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:30.532 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:30.524+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:30.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:30.847+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:31.220 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:31.213+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:31.354 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:31.346+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:31.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:31.363+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:31.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:31.547+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:31.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:31.564+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:31.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:31.854+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:32.270 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:32.262+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:32.398 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:32.391+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:32.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:32.399+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:32.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:32.508+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:32.564 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:32.548+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:32.826 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:32.818+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:33.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:33.230+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:33.289 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:33.282+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:33.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:33.378+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:33.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:33.408+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:33.493 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:33.485+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:33.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:33.560+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:33.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:33.843+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:34.213 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:34.206+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:34.312 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:34.305+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:34.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:34.364+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:34.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:34.421+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:34.538 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:34.530+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:34.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:34.564+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:34.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:34.845+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:35.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:35.250+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:35.321 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:35.313+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:35.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:35.391+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:35.430 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:35.424+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:35.554 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:35.546+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:35.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:35.596+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:35.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:35.841+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:36.273 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:36.266+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:36.325 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:36.317+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:36.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:36.431+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:36.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:36.472+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:36.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:36.577+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:36.591 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:36.583+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:36.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:36.801+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:37.281 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:37.275+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:37.305 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:37.299+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:37.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:37.401+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:37.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:37.523+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:37.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:37.580+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:37.606 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:37.599+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:37.828 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:37.821+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:38.261 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:38.251+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:38.344 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:38.337+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:38.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:38.394+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:38.542 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:38.536+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:38.622 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:38.615+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:38.642 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:38.635+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:38.885 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:38.868+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:39.251 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:39.243+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:39.326 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:39.318+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:39.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:39.398+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:39.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:39.520+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:39.596 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:39.588+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:39.602 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:39.595+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:39.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:39.836+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:40.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:40.221+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:40.318 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:40.312+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:40.460 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:40.452+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:40.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:40.547+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:40.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:40.619+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:40.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:40.622+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:40.842 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:40.835+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:41.270 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:41.264+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:41.364 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:41.358+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:41.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:41.456+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:41.592 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:41.585+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:41.609 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:41.603+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:41.642 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:41.628+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:41.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:41.850+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:42.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:42.277+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:42.370 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:42.363+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:42.494 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:42.486+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:42.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:42.606+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:42.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:42.611+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:42.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:42.673+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:42.882 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:42.872+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:43.330 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:43.320+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:43.402 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:43.395+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:43.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:43.486+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:43.605 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:43.597+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:43.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:43.654+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:43.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:43.671+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:43.883 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:43.876+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:44.282 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:44.274+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:44.406 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:44.399+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:44.460 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:44.453+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:44.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:44.606+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:44.661 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:44.653+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:44.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:44.726+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:44.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:44.926+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:45.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:45.271+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:45.373 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:45.367+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:45.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:45.505+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:45.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:45.568+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:45.617 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:45.610+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:45.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:45.682+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:45.901 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:45.893+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:46.260 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:46.251+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:46.352 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:46.343+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:46.481 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:46.473+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:46.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:46.562+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:46.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:46.651+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:46.716 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:46.709+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:46.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:46.857+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:47.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:47.241+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:47.338 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:47.331+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:47.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:47.430+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:47.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:47.527+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:47.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:47.634+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:47.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:47.728+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:47.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:47.827+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:48.251 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:48.242+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:48.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:48.292+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:48.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:48.418+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:48.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:48.556+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:48.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:48.604+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:48.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:48.695+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:48.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:48.847+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:49.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:49.256+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:49.339 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:49.333+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:49.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:49.415+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:49.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:49.519+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:49.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:49.645+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:49.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:49.718+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:49.819 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:49.812+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:50.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:50.266+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:50.313 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:50.307+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:50.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:50.457+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:50.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:50.525+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:50.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:50.653+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:50.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:50.741+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:50.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:50.770+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:51.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:51.250+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:51.282 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:51.275+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:51.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:51.423+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:51.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:51.557+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:51.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:51.635+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:51.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:51.743+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:51.825 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:51.817+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:52.247 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:52.238+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:52.313 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:52.304+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:52.455 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:52.447+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:52.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:52.542+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:52.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:52.647+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:52.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:52.766+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:52.834 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:52.827+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:53.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:53.236+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:53.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:53.283+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:53.424 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:53.416+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:53.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:53.587+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:53.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:53.618+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:53.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:53.762+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:53.811 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:53.803+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:54.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:54.263+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:54.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:54.324+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:54.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:54.373+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:54.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:54.572+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:54.611 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:54.603+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:54.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:54.766+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:54.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:54.799+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:55.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:55.289+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:55.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:55.371+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:55.415 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:55.408+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:55.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:55.612+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:55.635 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:55.627+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:55.785 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:55.778+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:55.796 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:55.789+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:56.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:56.288+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:56.425 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:56.419+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:56.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:56.417+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:56.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:56.590+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:56.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:56.656+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:56.818 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:56.804+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:56.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:56.809+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:57.300 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:57.292+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:57.383 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:57.377+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:57.448 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:57.437+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:57.593 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:57.587+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:57.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:57.688+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:57.810 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:57.802+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:57.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:57.806+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:58.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:58.335+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:58.359 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:58.354+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:58.457 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:58.446+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:58.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:58.612+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:58.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:58.664+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:58.841 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:58.834+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:58.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:58.837+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:37:59.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:37:59.322+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:37:59.334 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:37:59.326+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:37:59.412 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:37:59.404+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:37:59.635 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:37:59.623+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:37:59.723 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:37:59.715+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:37:59.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:37:59.848+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:37:59.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:37:59.869+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:38:00.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:38:00.325+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:38:00.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:38:00.372+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:38:00.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:38:00.391+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:38:00.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:38:00.620+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:38:00.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:38:00.737+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:38:00.827 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:38:00.819+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:38:00.871 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:38:00.864+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:38:01.293 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:38:01.279+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:38:01.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:38:01.380+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:38:01.424 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:38:01.417+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:38:01.676 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:38:01.669+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:38:01.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:38:01.776+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:38:01.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:38:01.868+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:38:01.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:38:01.869+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:38:02.301 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:38:02.294+0000 1694c700 -1 osd.3 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.445975+0000 front 2019-11-29T17:36:46.468054+0000 (oldest deadline 2019-11-29T17:37:28.297235+0000) 2019-11-29T17:38:02.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:38:02.384+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:38:02.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:38:02.458+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:38:02.662 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:38:02.656+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:38:02.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:38:02.770+0000 1694c700 -1 osd.1 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.977688+0000 front 2019-11-29T17:36:44.624546+0000 (oldest deadline 2019-11-29T17:37:26.946901+0000) 2019-11-29T17:38:02.911 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:38:02.905+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e396 v396) 2019-11-29T17:38:02.914 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:38:02.907+0000 1694c700 -1 osd.7 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:44.813763+0000 front 2019-11-29T17:36:45.444454+0000 (oldest deadline 2019-11-29T17:37:30.686005+0000) 2019-11-29T17:38:02.923 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:38:02.916+0000 1694c700 -1 osd.6 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.271624+0000 front 2019-11-29T17:36:45.415422+0000 (oldest deadline 2019-11-29T17:37:28.036904+0000) 2019-11-29T17:38:03.064 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:22:11.199 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.126 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:22:11.260 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.134 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:22:11.315 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.138 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:22:11.319 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.161 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:22:11.342 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.187 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:22:11.367 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.273 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:22:11.454 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.338 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:22:11.516 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.342 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:22:11.477 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:38:03.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:38:03.416+0000 1694c700 -1 osd.4 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:46.999071+0000 front 2019-11-29T17:36:46.932631+0000 (oldest deadline 2019-11-29T17:37:32.803606+0000) 2019-11-29T17:38:03.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:38:03.421+0000 1694c700 -1 osd.5 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:45.796628+0000 front 2019-11-29T17:36:45.581703+0000 (oldest deadline 2019-11-29T17:37:27.257793+0000) 2019-11-29T17:38:03.664 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:38:03.657+0000 1694c700 -1 osd.2 396 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:36:47.038742+0000 front 2019-11-29T17:36:43.129568+0000 (oldest deadline 2019-11-29T17:37:26.977063+0000) 2019-11-29T17:39:01.264 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:01.257+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:02.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:02.127+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:02.277 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:02.270+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:02.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:02.847+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:03.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:03.085+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:03.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:03.256+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:03.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:03.266+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:03.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:03.270+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:03.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:03.814+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:04.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:04.088+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:04.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:04.263+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:04.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:04.269+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:04.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:04.285+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:04.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:04.446+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:04.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:04.816+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:05.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:05.046+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:05.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:05.292+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:05.309 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:05.303+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:05.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:05.311+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:05.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:05.470+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:05.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:05.782+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:06.098 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:06.089+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:06.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:06.262+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:06.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:06.303+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:06.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:06.318+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:06.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:06.466+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:06.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:06.819+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:07.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:07.086+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:07.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:07.233+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:07.344 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:07.338+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:07.370 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:07.363+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:07.479 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:07.473+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:07.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:07.829+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:08.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:08.064+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:08.224 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:08.218+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:08.353 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:08.346+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:08.369 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:08.361+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:08.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:08.518+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:08.868 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:08.858+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:09.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:09.111+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:09.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:09.269+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:09.395 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:09.389+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:09.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:09.413+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:09.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:09.455+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:09.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:09.563+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:09.923 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:09.909+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:10.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:10.067+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:10.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:10.240+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:10.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:10.406+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:10.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:10.426+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:10.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:10.460+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:10.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:10.567+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:10.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:10.922+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:11.045 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:11.037+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:11.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:11.235+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:11.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:11.412+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:11.443 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:11.437+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:11.493 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:11.486+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:11.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:11.568+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:11.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:11.895+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:12.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:12.014+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:12.282 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:12.274+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:12.387 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:12.382+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:12.467 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:12.460+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:12.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:12.482+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:12.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:12.567+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:12.904 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:12.891+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:13.076 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:13.069+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:13.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:13.241+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:13.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:13.338+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:13.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:13.471+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:13.490 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:13.482+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:13.603 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:13.596+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:13.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:13.876+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:14.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:14.033+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:14.229 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:14.224+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:14.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:14.356+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:14.453 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:14.446+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:14.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:14.494+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:14.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:14.579+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:14.844 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:14.837+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:15.076 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:15.062+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:15.239 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:15.234+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:15.395 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:15.388+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:15.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:15.390+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:15.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:15.480+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:15.490 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:15.484+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:15.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:15.569+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:15.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:15.817+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:16.074 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:16.066+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:16.253 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:16.238+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:16.428 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:16.419+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:16.428 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:16.420+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:16.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:16.440+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:16.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:16.494+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:16.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:16.521+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:16.813 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:16.806+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:17.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:17.085+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:17.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:17.209+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:17.397 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:17.391+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:17.401 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:17.395+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:17.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:17.413+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:17.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:17.461+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:17.490 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:17.485+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:17.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:17.822+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:18.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:18.064+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:18.195 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:18.187+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:18.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:18.414+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:18.424 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:18.417+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:18.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:18.419+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:18.460 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:18.453+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:18.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:18.488+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:18.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:18.817+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:19.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:19.056+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:19.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:19.213+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:19.382 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:19.376+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:19.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:19.379+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:19.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:19.422+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:19.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:19.468+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:19.486 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:19.479+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:19.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:19.860+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:20.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:20.092+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:20.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:20.170+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:20.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:20.352+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:20.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:20.354+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:20.459 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:20.453+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:20.460 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:20.453+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:20.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:20.517+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:20.898 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:20.892+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:21.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:21.055+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:21.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:21.151+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:21.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:21.348+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:21.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:21.350+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:21.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:21.435+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:21.457 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:21.451+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:21.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:21.525+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:21.865 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:21.857+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:22.117 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:22.111+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:22.120 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:22.113+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:22.343 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:22.336+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:22.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:22.338+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:22.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:22.392+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:22.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:22.431+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:22.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:22.554+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:22.911 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:22.904+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:23.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:23.087+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:23.109 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:23.102+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:23.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:23.300+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:23.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:23.301+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:23.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:23.393+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:23.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:23.479+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:23.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:23.601+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:23.903 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:23.896+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:24.085 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:24.078+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:24.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:24.084+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:24.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:24.287+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:24.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:24.288+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:24.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:24.386+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:24.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:24.472+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:24.641 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:24.636+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:24.954 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:24.947+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:25.072 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:25.066+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:25.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:25.084+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:25.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:25.337+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:25.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:25.339+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:25.381 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:25.375+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:25.494 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:25.483+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:25.646 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:25.639+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:25.981 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:25.974+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:26.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:26.054+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:26.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:26.061+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:26.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:26.293+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:26.300 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:26.294+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:26.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:26.412+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:26.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:26.496+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:26.615 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:26.609+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:27.004 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:26.996+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:27.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:27.037+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:27.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:27.089+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:27.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:27.282+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:27.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:27.283+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:27.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:27.396+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:27.514 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:27.508+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:27.611 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:27.603+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:27.989 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:27.981+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:28.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:28.003+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:28.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:28.138+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:28.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:28.313+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:28.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:28.317+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:28.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:28.433+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:28.490 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:28.484+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:28.632 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:28.625+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:28.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:28.948+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:29.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:29.010+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:29.194 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:29.182+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:29.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:29.352+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:29.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:29.354+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:29.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:29.418+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:29.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:29.529+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:29.592 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:29.586+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:29.938 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:29.930+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:30.047 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:30.041+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:30.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:30.223+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:30.368 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:30.361+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:30.369 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:30.364+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:30.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:30.471+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:30.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:30.490+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:30.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:30.604+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:30.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:30.917+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:31.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:31.055+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:31.254 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:31.246+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:31.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:31.410+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:31.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:31.414+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:31.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:31.465+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:31.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:31.527+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:31.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:31.655+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:31.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:31.916+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:32.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:32.015+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:32.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:32.227+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:32.466 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:32.458+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:32.467 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:32.461+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:32.484 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:32.476+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:32.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:32.535+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:32.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:32.665+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:32.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:32.924+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:33.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:33.028+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:33.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:33.182+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:33.212 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:39:33.200+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e403 v403) 2019-11-29T17:39:33.458 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:33.451+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:33.515 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:33.509+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:33.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:33.510+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:33.523 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:33.516+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:33.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:33.662+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:33.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:33.934+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:34.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:34.072+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:34.204 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:34.196+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:34.436 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:34.429+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:34.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:34.525+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:34.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:34.527+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:34.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:34.557+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:34.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:34.679+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:34.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:34.919+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:35.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:35.046+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:35.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:35.157+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:35.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:35.459+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:35.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:35.511+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:35.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:35.514+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:35.610 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:35.602+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:35.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:35.665+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:35.891 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:35.882+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:36.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:36.043+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:36.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:36.151+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:36.461 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:36.451+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:36.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:36.512+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:36.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:36.515+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:36.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:36.653+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:36.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:36.697+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:36.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:36.933+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:37.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:37.055+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:37.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:37.130+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:37.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:37.480+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:37.549 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:37.542+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:37.550 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:37.544+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:37.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:37.674+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:37.681 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:37.673+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:37.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:37.978+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:38.032 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:38.026+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:38.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:38.131+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:38.235 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:39:38.222+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e403 v403) 2019-11-29T17:39:38.496 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:38.487+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:38.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:38.563+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:38.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:38.564+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:38.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:38.654+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:38.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:38.673+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:38.970 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:38.962+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:39.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:39.018+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:39.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:39.126+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:39.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:39.471+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:39.601 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:39.594+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:39.602 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:39.595+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:39.646 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:39.638+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:39.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:39.708+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:39.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:39.938+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:40.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:40.039+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:40.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:40.170+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:40.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:40.507+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:40.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:40.549+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:40.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:40.553+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:40.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:40.651+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:40.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:40.668+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:40.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:40.952+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:41.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:41.093+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:41.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:41.148+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:41.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:41.515+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:41.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:41.589+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:41.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:41.591+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:41.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:41.642+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:41.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:41.672+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:41.987 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:41.980+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:42.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:42.126+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:42.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:42.148+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:42.545 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:42.537+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:42.598 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:42.592+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:42.602 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:42.596+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:42.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:42.596+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:42.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:42.687+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:43.038 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:43.032+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:43.130 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:43.123+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:43.184 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:43.177+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:43.254 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:39:43.244+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e403 v403) 2019-11-29T17:39:43.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:43.576+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:43.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:43.603+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:43.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:43.604+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:43.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:43.642+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:43.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:43.680+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:44.061 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:44.049+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:44.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:44.143+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:44.188 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:44.181+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:44.608 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:44.601+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:44.628 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:44.621+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:44.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:44.625+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:44.674 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:44.666+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:44.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:44.671+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:45.080 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:45.073+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:45.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:45.134+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:45.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:45.207+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:45.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:45.606+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:45.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:45.611+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:45.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:45.636+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:45.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:45.645+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:45.652 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:45.645+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:46.100 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:46.092+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:46.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:46.151+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:46.193 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:46.183+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:46.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:46.588+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:46.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:46.589+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:46.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:46.617+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:46.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:46.661+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:46.670 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:46.663+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:47.090 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:47.082+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:47.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:47.186+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:47.208 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:47.198+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:47.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:47.543+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:47.550 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:47.545+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:47.621 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:39:47.613+0000 1694c700 -1 osd.5 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:16.564619+0000 front 2019-11-29T17:38:16.532300+0000 (oldest deadline 2019-11-29T17:39:02.352585+0000) 2019-11-29T17:39:47.656 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:47.645+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:39:47.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:39:47.706+0000 1694c700 -1 osd.1 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.735760+0000 front 2019-11-29T17:38:19.736443+0000 (oldest deadline 2019-11-29T17:39:03.488181+0000) 2019-11-29T17:39:48.104 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:39:48.097+0000 1694c700 -1 osd.4 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:19.121828+0000 front 2019-11-29T17:38:18.859712+0000 (oldest deadline 2019-11-29T17:39:02.084187+0000) 2019-11-29T17:39:48.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:39:48.169+0000 1694c700 -1 osd.7 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.195767+0000 front 2019-11-29T17:38:17.188204+0000 (oldest deadline 2019-11-29T17:39:01.863863+0000) 2019-11-29T17:39:48.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:39:48.239+0000 1694c700 -1 osd.2 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:15.836927+0000 front 2019-11-29T17:38:15.985367+0000 (oldest deadline 2019-11-29T17:39:01.125597+0000) 2019-11-29T17:39:48.388 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:39:48.361+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e403 v403) 2019-11-29T17:39:48.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:48.501+0000 1694c700 -1 osd.0 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:38:35.219325+0000 (oldest deadline 2019-11-29T17:39:15.219325+0000) 2019-11-29T17:39:48.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:39:48.503+0000 1694c700 -1 osd.0 403 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e401) 2019-11-29T17:39:48.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:39:48.697+0000 1694c700 -1 osd.6 403 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:38:17.266190+0000 front 2019-11-29T17:38:17.247256+0000 (oldest deadline 2019-11-29T17:39:03.127379+0000) 2019-11-29T17:40:13.668 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:24:21.803 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.683 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:24:21.817 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.688 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:24:21.868 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.694 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:24:21.873 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.695 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:24:21.875 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.697 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:24:21.877 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.849 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:24:22.029 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.862 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:24:22.032 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:40:13.881 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:24:22.015 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:17.374 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:17.366+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:17.660 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:17.653+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:17.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:17.863+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:18.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:18.324+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:18.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:18.334+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:18.689 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:18.683+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:18.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:18.903+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:19.346 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:19.329+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:19.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:19.375+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:19.399 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:19.393+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:19.646 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:19.639+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:19.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:19.717+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:19.925 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:19.914+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:20.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:20.368+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:20.386 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:20.379+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:20.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:20.410+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:20.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:20.679+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:20.695 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:20.686+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:20.889 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:20.881+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:21.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:21.364+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:21.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:21.376+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:21.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:21.381+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:21.706 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:21.699+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:21.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:21.732+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:21.854 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:21.846+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:21.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:21.925+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:22.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:22.327+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:22.389 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:22.382+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:22.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:22.436+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:22.723 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:22.716+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:22.749 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:22.742+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:22.875 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:22.869+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:22.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:22.949+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:23.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:23.358+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:23.370 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:23.363+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:23.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:23.436+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:23.721 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:23.713+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:23.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:23.729+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:23.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:23.828+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:23.989 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:23.980+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:24.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:24.362+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:24.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:24.384+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:24.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:24.427+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:24.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:24.731+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:24.752 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:24.745+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:24.840 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:24.829+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:25.002 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:24.994+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:25.385 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:25.377+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:25.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:25.387+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:25.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:25.403+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:25.706 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:25.699+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:25.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:25.770+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:25.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:25.880+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:25.980 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:25.971+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:26.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:26.369+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:26.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:26.386+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:26.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:26.419+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:26.758 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:26.751+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:26.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:26.769+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:26.844 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:26.836+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:26.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:26.954+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:27.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:27.372+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:27.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:27.397+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:27.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:27.451+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:27.729 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:27.722+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:27.748 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:27.741+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:27.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:27.814+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:28.006 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:27.997+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:28.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:28.342+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:28.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:28.439+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:28.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:28.450+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:28.740 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:28.732+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:28.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:28.737+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:28.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:28.851+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:29.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:29.046+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:29.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:29.361+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:29.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:29.414+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:29.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:29.449+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:29.697 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:29.690+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:29.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:29.706+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:29.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:29.904+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:30.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:30.099+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:30.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:30.402+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:30.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:30.439+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:30.447 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:30.441+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:30.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:30.674+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:30.692 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:30.686+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:30.946 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:30.939+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:31.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:31.085+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:31.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:31.398+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:31.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:31.408+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:31.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:31.410+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:31.656 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:31.648+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:31.714 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:31.706+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:31.935 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:31.927+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:32.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:32.137+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:32.387 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:32.380+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:32.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:32.381+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:32.389 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:32.382+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:32.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:32.623+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:32.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:32.679+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:32.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:32.885+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:33.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:33.189+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:33.397 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:33.387+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:33.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:33.394+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:33.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:33.414+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:33.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:33.600+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:33.720 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:33.712+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:33.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:33.905+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:34.164 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:34.156+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:34.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:34.387+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:34.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:34.402+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:34.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:34.466+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:34.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:34.575+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:34.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:34.678+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:34.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:34.949+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:35.182 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:35.173+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:35.367 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:35.360+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:35.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:35.404+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:35.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:35.474+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:35.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:35.572+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:35.718 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:35.712+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:35.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:35.988+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:36.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:36.206+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:36.341 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:36.331+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:36.372 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:36.365+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:36.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:36.457+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:36.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:36.557+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:36.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:36.685+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:36.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:36.983+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:37.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:37.204+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:37.344 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:37.332+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:37.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:37.408+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:37.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:37.441+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:37.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:37.513+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:37.680 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:37.665+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:38.010 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:38.003+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:38.184 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:38.172+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:38.394 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:38.386+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:38.424 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:38.401+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:38.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:41:38.455+0000 1694c700 -1 osd.1 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.815192+0000 front 2019-11-29T17:40:35.291127+0000 (oldest deadline 2019-11-29T17:41:18.179726+0000) 2019-11-29T17:41:38.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:38.507+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:38.722 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:38.710+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:39.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:39.010+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:39.156 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:39.149+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:39.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:39.362+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:39.386 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:39.379+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:39.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:39.508+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:39.734 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:39.725+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:40.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:40.045+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:40.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:40.165+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:40.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:40.347+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:40.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:40.427+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:40.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:40.544+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:40.719 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:40.712+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:41.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:41.008+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:41.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:41.217+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:41.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:41.329+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:41.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:41.475+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:41.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:41.502+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:41.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:41.679+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:42.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:42.035+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:42.232 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:42.223+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:42.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:42.362+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:42.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:42.476+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:42.513 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:42.506+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:42.724 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:42.705+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:43.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:43.060+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:43.267 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:43.260+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:43.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:43.406+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:43.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:43.490+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:43.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:43.508+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:43.724 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:43.717+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:44.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:44.042+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:44.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:44.280+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:44.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:44.413+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:44.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:44.496+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:44.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:44.559+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:44.755 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:44.747+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:45.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:45.082+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:45.303 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:45.294+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:45.466 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:45.458+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:45.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:45.537+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:45.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:45.549+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:45.754 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:45.746+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:46.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:46.107+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:46.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:46.324+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:46.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:46.504+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:46.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:46.509+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:46.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:46.577+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:46.733 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:46.725+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:47.146 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:47.139+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:47.338 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:47.329+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:47.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:47.543+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:47.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:47.550+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:47.614 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:47.606+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:47.762 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:47.755+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:48.167 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:48.160+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:48.361 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:48.352+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:48.524 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:48.515+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:48.578 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:48.569+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:48.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:48.602+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:48.812 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:48.805+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:48.898 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:41:48.892+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e408 v408) 2019-11-29T17:41:48.949 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:25:57.083 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:48.952 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:25:57.087 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:48.971 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:25:57.151 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:48.986 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:25:57.165 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:48.997 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:25:57.177 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:49.029 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:25:57.209 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:49.029 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:25:57.164 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:49.094 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:25:57.274 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:49.097 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:25:57.278 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:41:49.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:49.137+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:49.359 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:49.352+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:49.521 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:49.503+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:49.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:49.541+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:49.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:49.627+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:49.774 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:49.767+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:50.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:50.140+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:50.414 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:50.402+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:50.496 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:50.485+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:50.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:50.548+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:50.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:50.636+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:50.754 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:50.746+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:51.192 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:51.186+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:51.440 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:51.432+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:51.526 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:51.518+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:51.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:51.537+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:51.609 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:51.599+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:51.800 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:51.793+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:52.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:52.224+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:52.455 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:52.446+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:52.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:52.489+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:52.560 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:52.552+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:52.566 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:52.558+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:52.779 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:52.771+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:53.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:41:53.229+0000 1694c700 -1 osd.2 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.993981+0000 front 2019-11-29T17:40:36.003226+0000 (oldest deadline 2019-11-29T17:41:20.973299+0000) 2019-11-29T17:41:53.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:53.453+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:53.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:53.462+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:53.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:53.545+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:41:53.598 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:41:53.590+0000 1694c700 -1 osd.6 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:34.358438+0000 front 2019-11-29T17:40:34.757312+0000 (oldest deadline 2019-11-29T17:41:18.803923+0000) 2019-11-29T17:41:53.825 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:41:53.815+0000 1694c700 -1 osd.3 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.703091+0000 front 2019-11-29T17:40:35.849344+0000 (oldest deadline 2019-11-29T17:41:17.364175+0000) 2019-11-29T17:41:53.975 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:41:53.969+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e408 v408) 2019-11-29T17:41:54.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:41:54.439+0000 1694c700 -1 osd.4 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.896225+0000 front 2019-11-29T17:40:33.821752+0000 (oldest deadline 2019-11-29T17:41:19.687984+0000) 2019-11-29T17:41:54.499 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:41:54.491+0000 1694c700 -1 osd.5 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:35.984316+0000 front 2019-11-29T17:40:36.020968+0000 (oldest deadline 2019-11-29T17:41:17.061722+0000) 2019-11-29T17:41:54.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:41:54.589+0000 1694c700 -1 osd.7 408 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:40:33.370914+0000 front 2019-11-29T17:40:33.294108+0000 (oldest deadline 2019-11-29T17:41:16.758440+0000) 2019-11-29T17:42:25.662 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:25.596+0000 33787700 -1 osd.0 414 build_incremental_map_msg missing incremental map 414 2019-11-29T17:42:27.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:27.402+0000 32f86700 -1 osd.0 414 build_incremental_map_msg missing incremental map 414 2019-11-29T17:42:51.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:51.377+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:51.664 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:51.657+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:51.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:51.685+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:52.087 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:52.080+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:52.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:52.367+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:52.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:52.652+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:52.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:52.667+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:53.094 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:53.087+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:53.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:53.334+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:53.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:53.648+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:53.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:53.667+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:53.804 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:53.797+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:54.080 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:54.074+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:54.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:54.297+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:54.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:54.662+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:54.697 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:54.690+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:54.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:54.758+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:54.952 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:54.945+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:42:55.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:55.059+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:55.268 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:55.261+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:55.303 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:55.297+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:42:55.712 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:55.706+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:55.714 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:55.708+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:55.811 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:55.804+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:55.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:55.925+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:42:56.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:56.027+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:56.319 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:56.313+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:56.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:56.350+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:42:56.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:56.661+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:56.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:56.759+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:56.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:56.799+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:56.908 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:56.900+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:42:57.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:57.075+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:57.349 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:57.341+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:57.351 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:57.346+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:42:57.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:57.676+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:57.794 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:57.787+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:57.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:57.812+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:57.935 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:57.927+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:42:58.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:58.062+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:58.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:58.325+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:58.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:58.351+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:42:58.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:58.686+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:58.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:58.823+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:58.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:58.825+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:58.891 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:58.883+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:42:59.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:42:59.085+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:42:59.325 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:42:59.320+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:42:59.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:42:59.358+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:42:59.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:42:59.652+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:42:59.791 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:42:59.783+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:42:59.818 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:42:59.811+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:42:59.848 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:42:59.841+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:00.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:00.040+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:00.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:00.354+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:00.396 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:00.390+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:00.617 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:00.611+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:00.766 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:00.759+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:00.821 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:00.814+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:00.860 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:00.854+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:01.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:01.015+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:01.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:01.347+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:01.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:01.430+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:01.615 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:01.608+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:01.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:01.720+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:01.779 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:01.773+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:01.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:01.815+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:01.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:01.978+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:02.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:02.353+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:02.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:02.354+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:02.440 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:02.435+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:02.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:02.583+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:02.737 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:02.729+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:02.757 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:02.749+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:02.835 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:02.828+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:03.020 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:03.012+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:03.324 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:03.315+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:03.324 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:03.318+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:03.444 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:03.436+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:03.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:03.573+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:03.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:03.718+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:03.755 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:03.747+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:03.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:03.819+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:03.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:03.984+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:04.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:04.355+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:04.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:04.357+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:04.496 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:04.488+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:04.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:04.571+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:04.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:04.704+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:04.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:04.745+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:04.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:04.870+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:05.018 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:05.011+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:05.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:05.349+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:05.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:05.353+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:05.456 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:05.450+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:05.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:05.538+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:05.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:05.709+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:05.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:05.754+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:05.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:05.888+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:06.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:06.021+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:06.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:06.341+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:06.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:06.345+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:06.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:06.469+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:06.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:06.566+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:06.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:06.684+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:06.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:06.743+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:06.938 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:06.930+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:07.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:07.059+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:07.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:07.356+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:07.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:07.360+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:07.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:07.493+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:07.573 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:07.567+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:07.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:07.642+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:07.738 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:07.731+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:07.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:07.968+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:08.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:08.043+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:08.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:08.381+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:08.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:08.383+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:08.529 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:08.521+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:08.530 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:08.523+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:08.619 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:08.611+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:08.706 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:08.699+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:08.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:08.987+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:09.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:09.010+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:09.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:09.339+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:09.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:09.340+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:09.560 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:09.552+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:09.580 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:09.573+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:09.651 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:09.644+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:09.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:09.714+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:10.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:10.009+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:10.026 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:10.019+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:10.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:10.382+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:10.390 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:10.384+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:10.522 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:10.516+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:10.620 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:10.613+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:10.656 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:10.649+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:10.759 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:10.751+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:10.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:10.971+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:10.982 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:10.975+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:11.383 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:11.376+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:11.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:11.380+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:11.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:11.487+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:11.612 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:11.604+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:11.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:11.644+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:11.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:11.739+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:11.991 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:11.984+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:11.992 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:11.985+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:12.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:12.423+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:12.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:12.424+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:12.470 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:12.464+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:12.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:12.592+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:12.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:12.670+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:12.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:12.752+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:12.956 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:12.942+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:12.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:12.986+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:13.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:13.421+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:13.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:13.449+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:13.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:13.453+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:13.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:13.591+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:13.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:13.725+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:13.805 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:13.799+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:13.952 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:13.945+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:14.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:14.028+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:14.411 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:14.403+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:14.493 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:14.486+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:14.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:14.490+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:14.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:14.547+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:14.711 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:14.704+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:14.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:14.778+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:14.953 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:14.944+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:15.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:15.020+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:15.426 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:15.417+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:15.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:15.472+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:15.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:15.474+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:15.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:15.561+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:15.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:15.667+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:15.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:15.751+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:15.977 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:15.969+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:16.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:15.999+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:16.440 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:16.432+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:16.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:16.506+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:16.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:16.509+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:16.600 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:16.592+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:16.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:16.670+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:16.717 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:16.712+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:17.011 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:17.002+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:17.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:17.049+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:17.462 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:17.453+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:17.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:17.538+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:17.547 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:17.541+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:17.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:17.548+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:17.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:17.677+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:17.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:17.719+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:17.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:17.960+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:18.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:18.094+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:18.474 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:18.466+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:18.522 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:18.514+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:18.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:18.517+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:18.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:18.582+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:18.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:18.677+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:18.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:18.752+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:18.929 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:18.921+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:19.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:19.108+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:19.445 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:19.436+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:19.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:19.550+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:19.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:19.552+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:19.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:19.630+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:19.711 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:19.703+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:19.720 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:19.713+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:19.919 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:19.911+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:20.107 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:20.098+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:20.421 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:20.412+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:20.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:20.597+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:20.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:20.598+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:20.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:20.673+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:20.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:20.684+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:20.701 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:20.694+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:20.934 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:20.927+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:21.078 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:21.070+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:21.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:21.433+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:21.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:21.579+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:21.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:21.581+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:21.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:21.676+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:21.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:21.698+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:21.726 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:21.719+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:21.984 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:21.975+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:22.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:22.084+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:22.439 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:22.431+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:22.601 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:22.594+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:22.601 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:22.596+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:22.639 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:22.633+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:22.685 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:22.679+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:22.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:22.737+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:23.002 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:22.994+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:23.147 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:23.139+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:23.450 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:23.442+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:23.615 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:23.609+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:23.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:23.614+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:23.623 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:23.618+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:23.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:23.675+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:23.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:23.740+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:24.044 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:24.036+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:24.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:24.109+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:24.273 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:43:24.266+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e414 v414) 2019-11-29T17:43:24.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:24.459+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:24.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:24.591+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:24.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:24.621+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:24.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:24.623+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:24.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:24.701+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:24.789 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:24.783+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:25.039 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:25.031+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:25.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:25.116+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:25.497 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:25.490+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:25.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:25.627+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:25.656 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:25.649+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:25.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:25.651+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:25.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:25.751+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:25.837 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:25.825+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:26.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:26.045+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:26.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:26.109+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:26.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:26.519+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:26.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:26.633+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:26.704 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:26.697+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:26.704 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:26.698+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:26.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:26.762+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:26.789 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:26.783+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:27.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:27.010+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:27.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:27.147+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:27.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:27.511+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:27.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:27.646+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:27.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:27.740+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:27.751 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:27.745+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:27.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:27.746+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:27.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:27.782+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:28.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:28.060+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:28.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:28.198+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:28.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:28.494+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:28.682 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:28.675+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:28.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:28.731+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:28.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:28.733+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:28.766 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:28.759+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:28.835 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:28.828+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:29.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:29.053+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:29.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:29.232+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:29.300 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:43:29.289+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e414 v414) 2019-11-29T17:43:29.459 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:29.450+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:29.719 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:29.713+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:29.738 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:29.732+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:29.785 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:29.779+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:29.785 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:29.780+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:29.886 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:29.880+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:30.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:30.065+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:30.286 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:30.278+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:30.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:30.460+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:30.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:30.717+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:30.776 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:30.769+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:30.783 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:30.777+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:30.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:30.782+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:30.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:30.841+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:31.107 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:31.100+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:31.314 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:31.306+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:31.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:31.503+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:31.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:31.707+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:31.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:31.814+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:31.831 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:31.824+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:31.832 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:31.827+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:31.888 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:31.882+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:32.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:32.084+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:32.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:32.302+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:32.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:32.518+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:32.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:32.750+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:32.820 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:32.813+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:32.822 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:32.816+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:32.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:32.852+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:32.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:32.862+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:33.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:33.064+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:33.338 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:33.331+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:33.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:43:33.544+0000 1694c700 -1 osd.5 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.891097+0000 front 2019-11-29T17:42:10.533631+0000 (oldest deadline 2019-11-29T17:42:51.061352+0000) 2019-11-29T17:43:33.789 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:33.783+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:33.824 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:33.819+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:33.826 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:33.821+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:33.856 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:33.850+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:33.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:43:33.892+0000 1694c700 -1 osd.1 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331878+0000 front 2019-11-29T17:42:10.360972+0000 (oldest deadline 2019-11-29T17:42:51.453533+0000) 2019-11-29T17:43:34.100 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:43:34.093+0000 1694c700 -1 osd.4 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.537611+0000 front 2019-11-29T17:42:10.538363+0000 (oldest deadline 2019-11-29T17:42:54.352150+0000) 2019-11-29T17:43:34.367 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:43:34.359+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e414 v414) 2019-11-29T17:43:34.371 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:34.364+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:34.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:34.806+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:34.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:34.871+0000 1694c700 -1 osd.0 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:42:21.507132+0000 (oldest deadline 2019-11-29T17:43:01.507132+0000) 2019-11-29T17:43:34.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:34.874+0000 1694c700 -1 osd.0 414 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:109896 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e413) 2019-11-29T17:43:34.886 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:34.879+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:35.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:43:35.385+0000 1694c700 -1 osd.6 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.534104+0000 front 2019-11-29T17:42:10.536046+0000 (oldest deadline 2019-11-29T17:42:51.075240+0000) 2019-11-29T17:43:35.773 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:43:35.767+0000 1694c700 -1 osd.2 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:11.046246+0000 front 2019-11-29T17:42:05.740664+0000 (oldest deadline 2019-11-29T17:42:50.983610+0000) 2019-11-29T17:43:35.852 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:43:35.846+0000 1694c700 -1 osd.7 414 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:42:10.331294+0000 front 2019-11-29T17:42:09.966868+0000 (oldest deadline 2019-11-29T17:42:53.140714+0000) 2019-11-29T17:43:35.989 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:35.927+0000 38f92700 -1 osd.0 415 build_incremental_map_msg missing incremental map 414 2019-11-29T17:43:36.006 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:43:35.995+0000 1694c700 -1 osd.0 415 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:80673 7.f 7.264047ff (undecoded) ondisk+retry+write+known_if_redirected e413) 2019-11-29T17:44:05.175 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.154+0000 114ab700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.169+0000 11cac700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.312 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.203+0000 11cac700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.315+0000 114ab700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.376 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.339+0000 114ab700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:44:05.441+0000 33f88700 -1 osd.2 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.606 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:44:05.564+0000 36f8e700 -1 osd.0 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:05.665 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:44:05.656+0000 31783700 -1 osd.1 419 build_incremental_map_msg missing incremental map 419 2019-11-29T17:44:06.878 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:28:15.013 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:06.885 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:28:15.020 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:06.892 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:28:15.073 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:06.897 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:28:15.077 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:06.898 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:28:15.079 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:06.901 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:28:15.081 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:07.048 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:28:15.182 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:07.059 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:28:15.239 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:44:07.071 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:28:15.251 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:45:06.871 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:06.864+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:07.045 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:07.034+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:07.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:07.188+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:07.828 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:07.820+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:08.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:08.003+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:08.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:08.161+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:08.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:08.223+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:08.793 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:08.785+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:08.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:08.957+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:09.030 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:09.023+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:09.202 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:09.194+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:09.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:09.271+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:09.760 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:09.753+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:09.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:09.971+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:10.034 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:10.027+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:10.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:10.213+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:10.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:10.269+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:10.757 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:10.750+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:11.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:11.009+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:11.045 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:11.032+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:11.202 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:11.195+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:11.293 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:11.283+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:11.790 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:11.783+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:11.862 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:11.856+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:11.989 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:11.982+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:12.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:12.085+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:12.095 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:12.086+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:12.204 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:12.196+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:12.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:12.262+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:12.775 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:12.768+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:12.816 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:12.810+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:12.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:12.978+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:13.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:13.070+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:13.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:13.100+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:13.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:13.248+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:13.274 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:13.266+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:13.744 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:13.737+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:13.826 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:13.817+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:14.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:14.018+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:14.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:14.046+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:14.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:14.057+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:14.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:14.248+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:14.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:14.295+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:14.789 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:14.782+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:14.856 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:14.848+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:15.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:15.034+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:15.067 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:15.060+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:15.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:15.104+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:15.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:15.299+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:15.342 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:15.334+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:15.748 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:15.740+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:15.840 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:15.831+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:16.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:16.014+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:16.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:16.076+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:16.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:16.081+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:16.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:16.293+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:16.329 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:16.321+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:16.761 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:16.750+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:16.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:16.877+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:17.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:17.056+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:17.066 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:17.059+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:17.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:17.084+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:17.306 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:17.298+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:17.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:17.358+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:17.738 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:17.731+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:17.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:17.915+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:18.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:18.057+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:18.089 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:18.081+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:18.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:18.103+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:18.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:18.334+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:18.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:18.361+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:18.710 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:18.703+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:18.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:18.890+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:19.107 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:19.099+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:19.114 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:19.106+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:19.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:19.141+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:19.316 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:19.309+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:19.408 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:19.399+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:19.721 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:19.714+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:19.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:19.887+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:20.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:20.079+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:20.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:20.089+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:20.174 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:20.166+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:20.318 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:20.311+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:20.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:20.375+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:20.720 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:20.712+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:20.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:20.887+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:21.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:21.036+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:21.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:21.096+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:21.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:21.192+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:21.281 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:21.273+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:21.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:21.408+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:21.702 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:21.695+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:21.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:21.923+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:22.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:22.014+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:22.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:22.098+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:22.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:22.227+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:22.306 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:22.300+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:22.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:22.405+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:22.672 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:22.663+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:22.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:22.963+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:23.041 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:23.025+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:23.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:23.086+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:23.238 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:23.231+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:23.315 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:23.307+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:23.398 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:23.389+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:23.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:23.684+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:23.957 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:23.948+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:23.997 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:23.988+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:24.134 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:24.127+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:24.236 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:24.229+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:24.342 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:24.332+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:24.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:24.371+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:24.743 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:24.735+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:24.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:24.930+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:24.956 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:24.949+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:25.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:25.133+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:25.271 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:25.264+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:25.307 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:25.299+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:25.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:25.365+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:25.768 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:25.762+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:25.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:25.942+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:25.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:25.982+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:26.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:26.166+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:26.301 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:26.293+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:26.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:26.297+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:26.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:26.345+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:26.774 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:26.766+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:26.917 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:26.906+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:26.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:26.950+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:27.219 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:27.212+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:27.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:27.278+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:27.305 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:27.296+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:27.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:27.361+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:27.764 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:27.756+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:27.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:27.950+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:27.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:27.982+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:28.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:28.186+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:28.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:28.279+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:28.348 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:28.341+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:28.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:28.414+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:28.801 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:28.793+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:28.990 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:28.982+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:29.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:28.995+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:29.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:29.189+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:29.254 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:29.244+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:29.386 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:29.378+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:29.387 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:29.378+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:29.830 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:29.820+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:29.981 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:29.967+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:30.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:29.990+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:30.210 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:30.201+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:30.240 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:30.231+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:30.342 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:30.333+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:30.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:30.400+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:30.864 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:30.856+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:30.968 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:30.959+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:31.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:31.040+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:31.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:31.211+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:31.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:31.215+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:31.343 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:31.334+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:31.384 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:31.375+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:31.863 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:31.856+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:31.994 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:31.985+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:32.085 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:32.075+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:32.223 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:32.215+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:32.225 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:32.217+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:32.311 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:32.301+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:32.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:32.362+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:32.876 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:32.870+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:33.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:33.024+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:33.131 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:33.124+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:33.186 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:33.177+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:33.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:33.238+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:33.325 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:33.318+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:33.362 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:33.353+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:33.882 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:33.874+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:33.987 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:33.978+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:34.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:34.172+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:34.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:34.175+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:34.295 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:34.285+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:34.307 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:34.299+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:34.396 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:34.387+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:34.872 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:34.865+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:35.035 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:35.026+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:35.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:35.176+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:35.185 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:35.176+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:35.294 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:35.282+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:35.357 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:35.349+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:35.408 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:35.399+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:35.871 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:35.864+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:36.051 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:36.042+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:36.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:36.193+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:36.208 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:36.201+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:36.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:36.266+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:36.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:36.328+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:36.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:36.434+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:36.911 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:36.904+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:37.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:37.082+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:37.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:37.155+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:37.240 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:37.231+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:37.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:37.235+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:37.347 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:37.339+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:37.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:37.415+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:37.927 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:37.917+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:38.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:38.136+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:38.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:38.139+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:38.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:38.220+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:38.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:38.260+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:38.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:38.355+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:38.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:38.406+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:38.978 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:38.970+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:39.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:39.151+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:39.178 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:45:39.170+0000 1694c700 -1 osd.5 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.522531+0000 front 2019-11-29T17:44:21.521420+0000 (oldest deadline 2019-11-29T17:45:06.765290+0000) 2019-11-29T17:45:39.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:39.216+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:39.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:45:39.258+0000 1694c700 -1 osd.6 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.410279+0000 front 2019-11-29T17:44:23.420721+0000 (oldest deadline 2019-11-29T17:45:08.635724+0000) 2019-11-29T17:45:39.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:45:39.362+0000 1694c700 -1 osd.2 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.541145+0000 front 2019-11-29T17:44:25.512252+0000 (oldest deadline 2019-11-29T17:45:11.223858+0000) 2019-11-29T17:45:39.374 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:39.367+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:45:39.951 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:45:39.944+0000 1694c700 -1 osd.3 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:23.519652+0000 front 2019-11-29T17:44:23.475880+0000 (oldest deadline 2019-11-29T17:45:06.346406+0000) 2019-11-29T17:45:40.048 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:45:40.037+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e421 v421) 2019-11-29T17:45:40.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:45:40.158+0000 1694c700 -1 osd.1 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:25.618204+0000 front 2019-11-29T17:44:25.629180+0000 (oldest deadline 2019-11-29T17:45:10.863544+0000) 2019-11-29T17:45:40.261 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:45:40.253+0000 1694c700 -1 osd.4 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:24.583927+0000 front 2019-11-29T17:44:24.649968+0000 (oldest deadline 2019-11-29T17:45:07.453772+0000) 2019-11-29T17:45:40.353 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:45:40.344+0000 1694c700 -1 osd.7 421 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:44:21.500479+0000 front 2019-11-29T17:44:20.819742+0000 (oldest deadline 2019-11-29T17:45:06.720123+0000) 2019-11-29T17:46:36.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:36.882+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:37.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:37.886+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:37.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:37.944+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:38.344 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:38.333+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:38.671 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:38.664+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:38.924 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:38.913+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:38.958 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:38.950+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:39.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:39.323+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:39.396 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:39.387+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:39.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:39.700+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:39.890 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:39.882+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:39.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:39.952+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:40.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:40.335+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:40.403 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:40.395+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:40.709 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:40.702+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:40.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:40.887+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:40.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:40.919+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:41.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:41.382+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:41.403 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:41.395+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:41.481 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:41.473+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:41.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:41.663+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:41.929 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:41.922+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:41.955 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:41.947+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:42.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:42.412+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:42.435 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:42.428+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:42.519 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:42.510+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:42.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:42.713+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:42.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:42.913+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:42.965 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:42.950+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:43.431 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:43.423+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:43.452 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:43.442+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:43.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:43.513+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:43.680 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:43.673+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:43.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:43.892+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:43.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:43.928+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:44.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:44.398+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:44.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:44.458+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:44.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:44.535+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:44.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:44.543+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:44.680 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:44.673+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:44.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:44.886+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:44.947 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:44.940+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:45.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:45.406+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:45.507 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:45.499+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:45.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:45.509+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:45.546 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:45.539+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:45.710 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:46:45.702+0000 1694c700 -1 osd.6 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:55.001954+0000 front 2019-11-29T17:45:54.362674+0000 (oldest deadline 2019-11-29T17:46:38.318550+0000) 2019-11-29T17:46:45.882 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:45.870+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:45.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:45.935+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:46.383 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:46.376+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:46.521 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:46.514+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:46.540 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:46.534+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:46.597 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:46.591+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:46.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:46.873+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:46.954 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:46.947+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:47.435 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:47.429+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:47.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:47.552+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:47.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:47.559+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:47.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:47.598+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:47.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:47.859+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:47.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:47.954+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:48.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:48.424+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:48.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:48.534+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:48.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:48.569+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:48.609 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:48.603+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:48.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:48.886+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:48.965 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:48.956+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:49.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:49.392+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:49.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:49.527+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:49.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:49.576+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:49.611 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:49.603+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:49.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:49.920+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:49.935 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:49.926+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:50.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:50.414+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:50.493 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:50.487+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:50.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:50.610+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:50.649 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:50.644+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:50.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:50.923+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:50.944 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:50.937+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:51.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:51.393+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:51.470 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:51.464+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:51.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:51.591+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:51.634 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:51.628+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:51.923 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:51.915+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:51.986 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:51.974+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:52.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:52.374+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:52.448 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:52.441+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:52.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:52.552+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:52.663 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:52.656+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:52.676 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:52.658+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:52.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:52.899+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:52.974 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:52.967+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:53.353 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:53.338+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:53.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:53.449+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:53.602 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:53.594+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:53.708 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:53.699+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:53.708 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:53.701+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:53.875 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:53.868+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:53.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:53.934+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:54.338 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:54.327+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:54.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:54.407+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:54.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:54.619+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:54.701 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:54.692+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:54.703 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:54.695+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:54.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:54.906+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:54.924 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:54.916+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:55.370 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:55.363+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:55.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:55.384+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:55.659 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:55.651+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:55.693 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:55.687+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:55.696 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:55.690+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:55.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:55.919+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:55.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:55.947+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:56.351 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:56.344+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:56.382 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:56.372+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:56.657 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:56.651+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:56.665 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:56.657+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:56.666 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:56.659+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:56.956 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:56.947+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:57.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:57.001+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:57.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:57.353+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:57.386 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:57.378+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:57.677 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:57.668+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:57.678 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:57.670+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:57.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:57.676+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:57.960 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:57.952+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:57.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:57.965+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:58.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:58.337+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:58.386 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:58.378+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:58.645 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:58.638+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:58.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:58.640+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:58.653 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:58.645+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:58.935 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:58.927+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:59.001 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:58.985+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:46:59.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:46:59.298+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:46:59.368 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:46:59.362+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:46:59.632 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:46:59.624+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:46:59.648 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:59.642+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:46:59.649 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:46:59.643+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:46:59.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:46:59.897+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:46:59.983 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:46:59.975+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:00.287 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:00.279+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:00.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:00.362+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:00.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:00.611+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:00.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:00.614+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:00.689 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:00.680+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:00.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:00.898+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:00.962 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:00.954+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:01.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:01.290+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:01.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:01.412+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:01.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:01.566+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:01.574 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:01.567+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:01.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:01.668+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:01.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:01.884+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:01.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:01.945+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:02.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:02.324+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:02.377 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:02.370+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:02.590 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:02.584+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:02.591 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:02.586+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:02.676 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:02.668+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:02.887 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:02.880+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:02.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:02.928+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:03.353 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:03.345+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:03.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:03.351+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:03.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:03.554+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:03.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:03.559+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:03.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:03.674+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:03.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:03.877+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:03.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:03.894+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:04.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:04.319+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:04.367 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:04.361+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:04.547 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:04.540+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:04.547 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:04.541+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:04.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:04.718+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:04.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:04.867+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:04.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:04.945+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:05.372 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:05.364+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:05.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:05.393+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:05.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:05.502+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:05.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:05.503+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:05.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:05.737+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:05.882 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:05.873+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:05.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:05.986+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:06.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:06.375+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:06.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:06.423+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:06.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:06.466+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:06.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:06.471+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:06.718 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:06.703+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:06.922 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:06.913+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:06.996 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:06.990+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:07.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:07.423+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:07.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:07.438+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:07.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:07.440+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:07.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:07.477+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:07.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:07.733+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:07.950 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:07.944+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:08.012 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:08.006+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:08.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:08.399+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:08.443 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:08.437+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:08.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:08.439+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:08.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:08.503+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:08.773 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:08.766+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:08.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:08.934+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:09.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:09.055+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:09.403 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:09.396+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:09.480 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:09.472+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:09.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:09.475+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:09.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:09.501+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:09.802 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:09.795+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:09.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:09.911+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:10.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:10.044+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:10.322 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:47:10.315+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e428 v428) 2019-11-29T17:47:10.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:10.377+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:10.503 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:10.496+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:10.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:10.524+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:10.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:10.525+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:10.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:10.780+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:10.967 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:10.960+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:11.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:11.067+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:11.403 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:11.395+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:11.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:11.468+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:11.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:11.572+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:11.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:11.574+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:11.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:11.812+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:12.000 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:11.993+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:12.071 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:12.064+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:12.448 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:12.440+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:12.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:12.493+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:12.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:12.588+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:12.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:12.589+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:12.842 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:12.835+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:12.996 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:12.988+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:13.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:13.062+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:13.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:13.425+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:13.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:13.468+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:13.562 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:13.555+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:13.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:13.557+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:13.815 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:13.808+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:14.030 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:14.023+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:14.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:14.096+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:14.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:14.429+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:14.450 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:14.443+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:14.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:14.570+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:14.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:14.574+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:14.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:14.799+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:15.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:15.034+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:15.063 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:15.057+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:15.340 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:47:15.333+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e428 v428) 2019-11-29T17:47:15.396 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:15.389+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:15.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:15.470+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:15.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:15.608+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:15.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:15.609+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:15.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:15.829+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:16.028 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:16.020+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:16.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:16.103+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:16.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:16.351+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:16.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:16.501+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:16.666 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:16.659+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:16.668 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:16.662+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:16.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:16.879+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:17.080 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:17.073+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:17.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:17.085+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:17.400 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:17.392+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:17.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:17.527+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:17.661 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:17.644+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:17.661 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:17.646+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:17.899 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:17.892+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:18.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:18.059+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:18.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:18.065+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:18.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:18.403+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:18.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:18.527+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:18.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:18.612+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:18.622 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:18.615+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:18.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:18.869+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:19.049 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:19.044+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:19.069 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:19.061+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:19.425 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:19.417+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:19.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:19.518+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:19.658 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:19.651+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:19.661 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:19.655+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:19.926 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:19.920+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:20.027 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:20.020+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:20.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:20.088+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:20.358 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:47:20.352+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e428 v428) 2019-11-29T17:47:20.424 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:20.417+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:20.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:20.547+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:20.643 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:20.636+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:20.644 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:20.638+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:20.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:20.890+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:21.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:21.024+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:21.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:21.090+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:21.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:21.407+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:21.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:21.504+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:21.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:21.621+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:21.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:21.622+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:21.940 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:21.932+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:22.056 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:22.049+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:22.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:22.053+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:22.438 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:22.430+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:22.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:22.534+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:22.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:22.578+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:22.586 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:22.579+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:22.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:22.976+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:23.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:23.025+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:23.050 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:23.043+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:23.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:23.396+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:23.503 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:23.495+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:23.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:23.611+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:23.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:23.613+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:23.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:23.945+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:24.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:24.002+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:24.023 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:24.014+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:24.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:24.411+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:24.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:24.513+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:24.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:24.566+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:24.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:24.569+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:24.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:47:24.930+0000 1694c700 -1 osd.5 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.879467+0000 front 2019-11-29T17:45:57.063453+0000 (oldest deadline 2019-11-29T17:46:37.493267+0000) 2019-11-29T17:47:24.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:47:24.980+0000 1694c700 -1 osd.2 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:50.925202+0000 front 2019-11-29T17:45:50.947470+0000 (oldest deadline 2019-11-29T17:46:36.798435+0000) 2019-11-29T17:47:25.023 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:47:25.016+0000 1694c700 -1 osd.4 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:51.204972+0000 front 2019-11-29T17:45:51.216068+0000 (oldest deadline 2019-11-29T17:46:37.089738+0000) 2019-11-29T17:47:25.451 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:47:25.431+0000 1694c700 -1 osd.7 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:56.836657+0000 front 2019-11-29T17:45:57.063554+0000 (oldest deadline 2019-11-29T17:46:40.568127+0000) 2019-11-29T17:47:25.451 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:47:25.435+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e428 v428) 2019-11-29T17:47:25.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:47:25.502+0000 1694c700 -1 osd.1 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:45:54.273046+0000 front 2019-11-29T17:45:54.996334+0000 (oldest deadline 2019-11-29T17:46:39.282066+0000) 2019-11-29T17:47:25.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:25.558+0000 1694c700 -1 osd.0 428 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:46:11.750924+0000 (oldest deadline 2019-11-29T17:46:51.750924+0000) 2019-11-29T17:47:25.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:47:25.558+0000 1694c700 -1 osd.0 428 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e426) 2019-11-29T17:47:46.139 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:47:46.116+0000 38791700 -1 osd.3 428 build_incremental_map_msg missing incremental map 426 2019-11-29T17:48:00.136 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:32:08.270 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.158 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:32:08.339 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.159 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:32:08.293 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.161 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:32:08.341 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.166 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:32:08.346 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.168 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:32:08.348 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.392 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:32:08.571 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.393 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:32:08.573 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:00.478 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:32:08.612 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:48:39.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:39.663+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:40.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:40.685+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:41.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:41.673+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:42.715 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:42.709+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:43.712 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:43.705+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:44.718 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:44.712+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:45.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:45.719+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:46.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:46.737+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:47.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:47.764+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:48.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:48.726+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:49.745 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:49.740+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:50.682 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:50.674+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:50.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:50.792+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:51.702 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:51.690+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:51.755 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:51.749+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:52.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:52.331+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:52.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:52.656+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:52.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:52.740+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:52.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:52.765+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:52.843 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:52.835+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:53.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:53.373+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:53.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:53.704+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:53.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:53.724+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:53.758 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:53.751+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:53.840 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:53.832+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:54.343 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:54.335+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:54.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:54.682+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:54.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:54.701+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:54.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:54.724+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:54.832 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:54.824+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:55.348 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:55.341+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:55.514 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:48:55.505+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:48:55.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:55.678+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:55.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:55.747+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:55.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:55.758+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:55.845 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:55.838+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:56.329 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:56.320+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:56.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:48:56.517+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:48:56.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:56.661+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:56.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:56.739+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:56.779 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:56.773+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:56.860 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:56.853+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:57.373 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:57.366+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:57.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:48:57.523+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:48:57.701 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:57.693+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:57.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:57.703+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:57.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:57.792+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:57.873 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:57.866+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:58.426 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:58.420+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:58.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:48:58.514+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:48:58.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:58.743+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:58.753 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:58.746+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:58.763 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:58.752+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:58.877 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:58.869+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:48:59.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:48:59.430+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:48:59.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:48:59.500+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:48:59.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:48:59.700+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:48:59.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:48:59.799+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:48:59.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:48:59.799+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:48:59.860 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:48:59.852+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:00.418 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:00.411+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:00.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:00.472+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:00.707 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:00.699+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:00.812 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:00.805+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:00.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:00.812+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:00.883 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:00.876+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:01.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:01.387+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:01.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:01.482+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:01.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:01.652+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:01.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:01.782+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:01.842 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:01.833+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:01.850 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:01.842+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:02.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:02.427+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:02.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:02.528+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:02.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:02.642+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:02.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:02.765+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:02.815 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:02.809+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:02.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:02.870+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:03.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:03.387+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:03.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:03.552+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:03.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:03.656+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:03.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:03.733+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:03.781 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:03.774+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:03.927 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:03.919+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:04.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:04.410+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:04.564 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:04.556+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:04.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:04.569+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:04.692 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:04.684+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:04.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:04.715+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:04.807 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:04.798+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:04.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:04.941+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:05.439 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:05.431+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:05.539 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:05.530+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:05.565 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:05.559+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:05.743 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:05.735+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:05.762 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:05.747+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:05.834 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:05.817+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:05.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:05.899+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:06.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:06.406+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:06.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:06.494+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:06.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:06.530+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:06.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:06.710+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:06.767 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:06.761+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:06.784 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:06.777+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:06.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:06.931+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:07.377 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:07.368+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:07.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:07.463+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:07.537 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:07.529+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:07.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:07.700+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:07.761 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:07.755+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:07.836 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:07.827+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:07.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:07.893+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:08.379 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:08.371+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:08.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:08.504+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:08.581 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:08.574+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:08.707 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:08.698+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:08.763 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:08.756+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:08.804 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:08.796+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:08.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:08.890+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:09.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:09.393+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:09.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:09.494+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:09.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:09.538+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:09.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:09.716+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:09.778 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:09.769+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:09.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:09.775+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:09.815 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:09.807+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:09.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:09.933+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:10.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:10.372+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:10.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:10.463+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:10.589 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:10.582+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:10.759 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:10.752+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:10.810 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:10.800+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:10.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:10.804+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:10.829 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:10.821+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:10.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:10.924+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:11.374 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:11.366+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:11.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:49:11.477+0000 1694c700 -1 osd.4 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.938063+0000 front 2019-11-29T17:48:08.934573+0000 (oldest deadline 2019-11-29T17:48:54.780523+0000) 2019-11-29T17:49:11.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:11.548+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:11.803 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:11.795+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:11.858 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:11.851+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:11.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:11.855+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:11.863 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:11.857+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:11.959 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:11.951+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:12.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:12.414+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:12.589 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:12.583+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:12.819 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:12.812+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:12.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:12.834+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:12.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:12.839+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:12.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:12.841+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:12.931 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:12.922+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:13.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:13.444+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:13.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:13.633+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:13.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:13.814+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:13.827 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:13.821+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:13.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:13.888+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:13.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:13.889+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:13.909 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:13.902+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:14.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:14.414+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:14.676 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:14.669+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:14.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:14.844+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:14.870 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:14.863+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:14.889 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:14.881+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:14.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:14.886+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:14.915 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:14.906+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:15.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:15.446+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:15.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:15.675+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:15.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:15.851+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:15.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:15.854+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:15.883 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:15.870+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:15.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:15.883+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:15.895 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:15.887+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:16.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:16.415+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:16.696 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:16.688+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:16.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:16.851+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:16.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:16.854+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:16.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:16.893+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:16.925 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:16.918+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:16.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:16.938+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:17.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:17.389+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:17.727 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:17.718+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:17.852 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:17.842+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:17.855 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:17.845+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:17.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:17.900+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:17.922 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:17.913+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:17.938 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:17.931+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:18.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:18.353+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:18.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:18.676+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:18.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:18.874+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:18.885 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:18.871+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:18.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:18.879+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:18.892 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:18.883+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:18.928 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:18.920+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:19.351 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:19.344+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:19.712 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:19.705+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:19.851 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:19.842+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:19.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:19.842+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:19.856 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:19.847+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:19.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:19.886+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:19.913 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:19.905+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:20.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:20.356+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:20.699 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:20.691+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:20.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:20.828+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:20.872 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:20.863+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:20.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:20.891+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:20.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:20.896+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:20.955 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:20.947+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:21.344 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:21.336+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:21.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:21.713+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:21.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:21.844+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:21.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:21.843+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:21.925 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:21.917+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:21.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:21.937+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:21.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:21.940+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:22.304 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:22.297+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:22.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:22.716+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:22.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:22.825+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:22.868 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:22.860+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:22.909 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:22.901+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:22.912 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:22.906+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:22.959 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:22.952+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:23.301 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:23.293+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:23.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:23.685+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:23.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:23.844+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:23.856 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:23.848+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:23.913 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:23.907+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:23.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:23.930+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:23.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:23.932+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:24.322 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:24.315+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:24.733 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:24.724+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:24.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:24.836+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:24.890 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:24.881+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:24.914 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:24.906+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:24.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:24.974+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:24.983 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:24.977+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:25.282 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:25.273+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:25.740 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:49:25.732+0000 1694c700 -1 osd.2 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.800781+0000 front 2019-11-29T17:48:05.794309+0000 (oldest deadline 2019-11-29T17:49:03.834969+0000) 2019-11-29T17:49:25.872 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:49:25.865+0000 1694c700 -1 osd.5 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:05.888160+0000 front 2019-11-29T17:48:05.793557+0000 (oldest deadline 2019-11-29T17:48:50.487740+0000) 2019-11-29T17:49:25.881 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:49:25.873+0000 1694c700 -1 osd.7 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:06.909559+0000 front 2019-11-29T17:48:06.358012+0000 (oldest deadline 2019-11-29T17:48:52.223297+0000) 2019-11-29T17:49:25.963 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:49:25.955+0000 1694c700 -1 osd.3 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:07.080232+0000 front 2019-11-29T17:48:08.191404+0000 (oldest deadline 2019-11-29T17:48:52.362886+0000) 2019-11-29T17:49:25.970 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:25.962+0000 1694c700 -1 osd.6 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.910142+0000 front 2019-11-29T17:48:08.893771+0000 (oldest deadline 2019-11-29T17:49:09.406080+0000) 2019-11-29T17:49:25.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:25.967+0000 1694c700 -1 osd.6 433 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:49:26.248 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:49:26.230+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e433 v433) 2019-11-29T17:49:26.305 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:49:26.298+0000 1694c700 -1 osd.1 433 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:48:08.348151+0000 front 2019-11-29T17:48:08.556221+0000 (oldest deadline 2019-11-29T17:48:51.612107+0000) 2019-11-29T17:49:26.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:49:26.983+0000 1694c700 -1 osd.6 434 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81097 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e433) 2019-11-29T17:50:11.695 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:19.829 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.700 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:19.835 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.735 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:19.915 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.743 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:19.923 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.749 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:19.930 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.752 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:19.932 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.870 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:20.050 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:20.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:11.900 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:20.034 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:24.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:24.968+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:25.947 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:25.938+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:26.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:26.904+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:27.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:27.324+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:27.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:27.864+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:28.308 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:28.301+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:28.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:28.574+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:28.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:28.897+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:28.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:28.904+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:29.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:29.027+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:29.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:29.256+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:29.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:29.616+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:29.878 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:29.871+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:29.919 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:29.911+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:30.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:30.006+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:30.311 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:30.303+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:30.648 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:30.641+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:30.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:30.871+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:30.954 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:30.946+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:31.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:31.038+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:31.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:31.265+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:31.697 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:31.691+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:31.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:31.883+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:31.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:31.965+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:31.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:31.983+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:32.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:32.015+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:32.288 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:32.280+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:32.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:32.669+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:32.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:32.915+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:32.947 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:32.940+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:33.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:33.014+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:33.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:33.067+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:33.298 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:33.291+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:33.656 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:33.649+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:33.962 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:33.955+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:33.997 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:33.988+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:34.040 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:34.033+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:34.045 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:34.038+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:34.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:34.278+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:34.621 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:34.614+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:34.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:34.923+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:35.036 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:35.028+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:35.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:35.029+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:35.092 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:35.084+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:35.323 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:35.316+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:35.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:35.582+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:35.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:35.938+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:36.010 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:36.003+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:36.043 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:36.035+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:36.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:36.055+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:36.359 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:36.349+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:36.613 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:36.605+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:36.991 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:45.125 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:36.994 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:45.128 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:36.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:36.989+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:37.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:36.998+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:37.044 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:37.037+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:37.071 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:45.250 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.071 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:34:45.205 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.076 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:45.256 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.084 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:45.264 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.088 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:45.268 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:37.093+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:37.124 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:34:45.304 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.135 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:34:45.315 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:50:37.338 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:37.332+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:37.644 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:37.637+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:37.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:37.992+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:37.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:37.993+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:38.012 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:38.005+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:38.089 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:38.082+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:38.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:38.113+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:38.316 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:38.309+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:38.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:38.684+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:38.986 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:38.980+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:39.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:39.016+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:39.025 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:39.019+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:39.102 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:39.095+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:39.128 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:39.120+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:39.279 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:39.271+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:39.724 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:39.716+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:39.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:39.984+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:40.052 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:40.043+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:40.053 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:40.046+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:40.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:40.057+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:40.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:40.087+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:40.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:40.265+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:40.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:40.677+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:40.957 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:40.949+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:41.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:41.016+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:41.025 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:41.019+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:41.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:41.020+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:41.053 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:41.046+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:41.242 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:41.235+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:41.702 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:41.694+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:41.947 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:41.940+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:42.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:42.032+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:42.052 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:42.044+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:42.061 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:42.051+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:42.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:42.053+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:42.293 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:42.277+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:42.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:42.698+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:42.974 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:42.967+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:43.004 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:42.996+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:43.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:43.012+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:43.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:43.030+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:43.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:43.032+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:43.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:43.295+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:43.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:43.723+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:43.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:43.974+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:44.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:44.014+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:44.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:44.034+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:44.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:44.081+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:44.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:44.083+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:44.316 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:44.308+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:44.705 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:44.696+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:45.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:45.025+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:45.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:45.052+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:45.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:45.053+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:45.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:45.054+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:45.062 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:45.053+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:45.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:45.281+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:45.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:45.655+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:46.043 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:46.034+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:46.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:46.048+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:46.099 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:46.090+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:46.112 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:46.105+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:46.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:46.106+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:46.318 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:46.309+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:46.645 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:46.637+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:47.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:47.033+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:47.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:47.042+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:47.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:47.075+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:47.147 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:47.140+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:47.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:47.142+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:47.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:47.356+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:47.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:47.641+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:48.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:48.062+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:48.090 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:48.082+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:48.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:48.096+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:48.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:48.181+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:48.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:48.183+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:48.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:48.356+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:48.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:48.666+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:49.032 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:49.026+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:49.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:49.113+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:49.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:49.136+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:49.163 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:49.157+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:49.167 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:49.161+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:49.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:49.384+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:49.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:49.708+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:50.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:50.042+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:50.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:50.090+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:50.112 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:50.105+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:50.173 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:50.167+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:50.175 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:50.169+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:50.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:50.385+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:50.753 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:50.745+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:51.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:51.096+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:51.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:51.101+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:51.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:51.129+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:51.182 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:51.175+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:51.183 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:51.177+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:51.260 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:51.254+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:51.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:51.429+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:51.710 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:51.701+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:52.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:52.110+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:52.118 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:52.112+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:52.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:52.146+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:52.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:52.169+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:52.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:52.171+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:52.255 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:52.247+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:52.400 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:52.392+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:52.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:52.678+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:53.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:53.075+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:53.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:53.092+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:53.203 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:53.196+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:53.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:53.208+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:53.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:53.210+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:53.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:53.223+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:53.457 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:53.448+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:53.713 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:53.706+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:54.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:54.061+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:54.128 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:54.120+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:54.175 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:54.167+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:54.178 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:54.171+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:54.179 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:54.173+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:54.274 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:54.266+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:54.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:54.482+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:54.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:54.725+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:55.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:55.114+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:55.151 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:55.144+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:55.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:55.149+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:55.182 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:55.175+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:55.183 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:55.178+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:55.272 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:55.265+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:55.491 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:55.483+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:55.720 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:55.709+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:56.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:56.126+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:56.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:56.170+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:56.193 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:56.187+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:56.214 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:56.207+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:56.215 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:56.208+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:56.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:56.224+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:56.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:56.517+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:56.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:56.756+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:57.032 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:50:57.024+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e438 v438) 2019-11-29T17:50:57.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:57.134+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:57.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:57.167+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:57.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:57.168+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:57.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:57.181+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:57.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:57.188+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:57.226 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:57.220+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:57.507 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:57.499+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:57.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:57.808+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:58.148 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:58.141+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:58.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:58.143+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:58.152 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:58.145+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:58.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:58.169+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:58.207 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:58.200+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:58.221 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:58.215+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:58.532 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:58.524+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:58.825 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:58.817+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:50:59.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:50:59.121+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:50:59.160 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:59.152+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:50:59.161 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:50:59.154+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:50:59.172 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:50:59.165+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:50:59.207 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:50:59.200+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:50:59.215 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:50:59.207+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:50:59.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:50:59.510+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:50:59.864 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:50:59.856+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:00.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:00.091+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:00.135 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:00.129+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:00.197 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:00.189+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:00.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:00.205+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:00.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:00.206+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:00.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:00.240+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:00.557 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:00.549+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:00.828 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:00.821+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:01.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:01.143+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:01.153 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:01.146+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:01.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:01.180+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:01.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:01.200+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:01.215 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:01.208+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:01.215 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:01.209+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:01.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:01.551+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:01.796 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:01.789+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:02.052 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:51:02.044+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e438 v438) 2019-11-29T17:51:02.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:02.120+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:02.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:02.173+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:02.188 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:02.180+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:02.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:02.206+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:02.251 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:02.243+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:02.252 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:02.245+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:02.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:02.546+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:02.834 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:02.828+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:03.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:03.126+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:03.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:03.175+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:03.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:03.193+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:03.253 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:03.246+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:03.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:03.288+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:03.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:03.296+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:03.603 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:03.595+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:03.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:03.810+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:04.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:04.094+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:04.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:04.168+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:04.206 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:04.199+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:04.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:04.297+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:04.305 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:04.299+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:04.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:04.300+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:04.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:04.642+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:04.803 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:04.795+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:05.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:05.140+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:05.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:05.176+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:05.216 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:05.208+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:05.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:05.278+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:05.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:05.290+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:05.302 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:05.293+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:05.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:05.636+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:05.799 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:05.791+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:06.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:06.145+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:06.220 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:06.212+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:06.271 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:06.250+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:06.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:06.250+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:06.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:06.328+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:06.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:06.329+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:06.693 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:51:06.685+0000 1694c700 -1 osd.5 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.037184+0000 front 2019-11-29T17:49:42.080750+0000 (oldest deadline 2019-11-29T17:50:27.300477+0000) 2019-11-29T17:51:06.829 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:51:06.822+0000 1694c700 -1 osd.7 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.566035+0000 front 2019-11-29T17:49:42.555524+0000 (oldest deadline 2019-11-29T17:50:28.429482+0000) 2019-11-29T17:51:07.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:51:07.122+0000 1694c700 -1 osd.2 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:40.005719+0000 front 2019-11-29T17:49:40.013480+0000 (oldest deadline 2019-11-29T17:50:24.688381+0000) 2019-11-29T17:51:07.133 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:51:07.125+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e438 v438) 2019-11-29T17:51:07.186 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:51:07.177+0000 1694c700 -1 osd.6 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.978036+0000 front 2019-11-29T17:49:43.761681+0000 (oldest deadline 2019-11-29T17:50:28.421741+0000) 2019-11-29T17:51:07.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:07.268+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:07.299 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:51:07.283+0000 1694c700 -1 osd.1 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:42.401196+0000 front 2019-11-29T17:49:42.404444+0000 (oldest deadline 2019-11-29T17:50:50.922980+0000) 2019-11-29T17:51:07.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:07.352+0000 1694c700 -1 osd.0 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:49:57.985837+0000 (oldest deadline 2019-11-29T17:50:37.985837+0000) 2019-11-29T17:51:07.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:07.354+0000 1694c700 -1 osd.0 438 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:08.302 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:51:08.295+0000 1694c700 -1 osd.4 438 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:49:43.216604+0000 front 2019-11-29T17:49:43.268830+0000 (oldest deadline 2019-11-29T17:50:28.476048+0000) 2019-11-29T17:51:08.682 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:51:08.522+0000 1694c700 -1 osd.0 439 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:110990 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e437) 2019-11-29T17:51:46.377 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:35:54.511 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.387 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:35:54.521 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.389 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:35:54.569 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.390 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:35:54.569 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.411 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:35:54.575 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.411 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:35:54.575 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.491 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:35:54.671 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.503 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:35:54.633 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:51:46.503 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:35:54.675 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:52:38.664 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:38.657+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:39.637 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:39.630+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:40.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:40.076+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:40.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:40.158+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:40.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:40.682+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:40.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:40.785+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:41.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:41.034+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:41.147 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:41.138+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:41.380 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:41.372+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:41.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:41.547+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:41.734 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:41.727+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:41.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:41.791+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:42.000 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:41.994+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:42.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:42.154+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:42.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:42.328+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:42.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:42.510+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:42.773 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:42.765+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:42.802 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:42.794+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:43.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:43.009+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:43.109 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:43.100+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:43.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:43.120+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:43.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:43.309+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:43.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:43.531+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:43.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:43.751+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:43.763 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:43.756+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:44.000 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:43.993+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:44.092 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:44.084+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:44.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:44.100+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:44.286 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:44.278+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:44.513 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:44.502+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:44.743 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:44.735+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:44.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:44.747+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:45.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:45.043+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:45.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:45.137+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:45.147 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:45.139+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:45.276 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:45.268+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:45.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:45.545+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:45.714 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:45.705+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:45.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:45.714+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:46.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:45.997+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:46.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:46.113+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:46.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:46.176+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:46.294 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:46.286+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:46.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:46.518+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:46.682 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:46.675+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:46.732 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:46.723+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:47.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:46.996+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:47.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:47.151+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:47.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:47.181+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:47.252 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:47.243+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:47.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:47.506+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:47.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:47.706+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:47.725 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:47.718+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:48.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:48.019+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:48.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:48.171+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:48.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:48.191+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:48.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:48.272+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:48.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:48.536+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:48.709 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:48.701+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:48.755 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:48.748+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:49.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:49.051+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:49.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:49.175+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:49.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:49.185+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:49.268 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:49.259+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:49.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:49.585+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:49.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:49.721+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:49.747 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:49.740+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:50.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:50.091+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:50.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:50.167+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:50.223 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:50.214+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:50.246 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:50.237+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:50.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:50.582+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:50.774 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:50.766+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:50.790 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:50.783+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:51.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:51.084+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:51.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:51.153+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:51.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:51.207+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:51.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:51.231+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:51.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:51.582+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:51.812 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:51.804+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:51.813 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:51.805+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:52.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:52.126+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:52.146 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:52.139+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:52.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:52.198+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:52.269 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:52.262+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:52.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:52.564+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:52.796 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:52.789+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:52.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:52.794+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:53.156 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:53.147+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:53.172 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:53.165+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:53.173 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:53.164+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:53.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:53.236+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:53.560 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:53.552+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:53.776 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:53.768+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:53.787 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:53.778+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:54.138 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:54.129+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:54.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:54.181+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:54.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:54.192+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:54.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:54.194+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:54.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:54.572+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:54.808 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:54.795+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:54.815 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:54.807+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:55.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:55.166+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:55.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:55.179+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:55.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:55.218+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:55.243 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:55.235+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:55.555 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:55.546+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:55.762 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:55.754+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:55.795 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:55.788+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:56.194 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:56.186+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:56.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:56.197+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:56.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:56.218+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:56.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:56.238+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:56.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:56.515+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:56.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:56.752+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:56.792 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:56.784+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:57.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:57.197+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:57.225 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:57.216+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:57.257 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:57.248+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:57.299 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:57.290+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:57.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:57.501+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:57.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:57.736+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:57.843 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:57.835+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:58.210 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:58.203+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:58.216 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:58.207+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:58.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:58.261+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:58.334 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:58.321+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:58.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:58.521+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:58.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:58.764+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:52:58.810 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:58.804+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:59.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:52:59.180+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:52:59.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:52:59.237+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:52:59.259 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:52:59.249+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:52:59.382 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:52:59.373+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:52:59.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:52:59.534+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:52:59.772 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:52:59.765+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:52:59.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:52:59.774+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:00.170 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:00.156+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:00.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:00.238+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:00.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:00.239+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:00.345 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:00.336+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:00.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:00.518+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:00.776 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:00.769+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:00.806 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:00.798+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:01.191 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:01.181+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:01.204 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:01.195+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:01.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:01.240+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:01.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:01.349+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:01.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:01.519+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:01.731 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:01.724+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:01.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:01.788+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:02.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:02.205+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:02.219 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:02.210+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:02.278 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:02.270+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:02.373 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:02.363+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:02.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:02.547+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:02.705 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:02.698+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:02.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:02.782+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:03.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:03.168+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:03.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:03.200+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:03.313 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:03.304+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:03.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:03.367+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:03.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:03.592+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:03.753 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:03.747+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:03.834 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:03.825+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:04.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:04.198+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:04.223 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:04.214+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:04.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:04.355+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:04.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:04.366+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:04.598 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:04.590+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:04.748 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:04.740+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:04.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:04.867+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:05.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:05.167+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:05.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:05.246+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:05.338 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:05.330+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:05.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:05.350+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:05.627 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:05.618+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:05.780 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:05.774+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:05.870 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:05.861+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:06.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:06.155+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:06.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:06.230+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:06.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:06.316+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:06.334 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:06.326+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:06.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:06.613+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:06.801 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:06.794+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:06.858 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:06.850+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:07.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:07.114+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:07.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:07.192+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:07.315 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:07.308+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:07.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:07.325+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:07.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:07.583+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:07.798 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:07.790+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:07.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:07.812+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:08.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:08.162+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:08.174 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:08.166+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:08.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:08.268+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:08.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:08.296+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:08.627 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:08.619+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:08.772 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:08.764+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:08.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:08.794+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:09.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:09.133+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:09.194 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:09.186+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:09.273 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:09.264+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:09.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:09.315+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:09.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:09.648+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:09.767 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:09.760+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:09.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:09.814+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:10.195 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:10.188+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:10.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:10.204+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:10.272 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:10.263+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:10.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:10.358+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:10.664 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:10.656+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:10.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:10.804+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:10.813 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:10.805+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:11.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:11.204+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:11.232 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:11.225+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:11.239 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:11.232+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:11.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:11.398+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:11.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:11.700+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:11.790 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:11.782+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:11.842 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:11.834+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:12.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:12.197+0000 1694c700 -1 osd.6 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.106287+0000 front 2019-11-29T17:51:55.194531+0000 (oldest deadline 2019-11-29T17:52:40.980558+0000) 2019-11-29T17:53:12.236 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:53:12.227+0000 1694c700 -1 osd.7 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.142532+0000 front 2019-11-29T17:51:57.145435+0000 (oldest deadline 2019-11-29T17:52:39.990254+0000) 2019-11-29T17:53:12.288 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:12.280+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:12.400 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:53:12.393+0000 1694c700 -1 osd.5 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.613476+0000 front 2019-11-29T17:51:58.137697+0000 (oldest deadline 2019-11-29T17:52:42.163928+0000) 2019-11-29T17:53:12.743 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:53:12.734+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e446 v446) 2019-11-29T17:53:12.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:53:12.737+0000 1694c700 -1 osd.1 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:54.918021+0000 front 2019-11-29T17:51:55.819034+0000 (oldest deadline 2019-11-29T17:52:40.751687+0000) 2019-11-29T17:53:12.755 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:53:12.748+0000 1694c700 -1 osd.3 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.822962+0000 front 2019-11-29T17:51:55.724527+0000 (oldest deadline 2019-11-29T17:52:38.558922+0000) 2019-11-29T17:53:12.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:53:12.792+0000 1694c700 -1 osd.4 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:57.658474+0000 front 2019-11-29T17:51:57.835140+0000 (oldest deadline 2019-11-29T17:52:40.502611+0000) 2019-11-29T17:53:13.303 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:53:13.294+0000 1694c700 -1 osd.2 446 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:51:55.709382+0000 front 2019-11-29T17:51:55.653819+0000 (oldest deadline 2019-11-29T17:52:39.697063+0000) 2019-11-29T17:53:51.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:53:51.857+0000 31783700 -1 osd.0 451 build_incremental_map_msg missing incremental map 451 2019-11-29T17:53:51.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:53:51.940+0000 33787700 -1 osd.0 451 build_incremental_map_msg missing incremental map 451 2019-11-29T17:53:52.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:52.118+0000 11cac700 -1 osd.6 450 build_incremental_map_msg missing incremental map 450 2019-11-29T17:53:53.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:53:53.285+0000 33f88700 -1 osd.0 451 build_incremental_map_msg missing incremental map 451 2019-11-29T17:53:54.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:53:54.009+0000 11cac700 -1 osd.6 452 build_incremental_map_msg missing incremental map 450 2019-11-29T17:54:12.020 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:12.012+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:12.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:12.056+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:12.627 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:12.620+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:12.978 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:12.969+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:13.037 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:13.029+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:13.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:13.489+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:13.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:13.637+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:13.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:13.747+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:13.942 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:13.934+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:14.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:14.004+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:14.030 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:14.020+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:14.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:14.470+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:14.623 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:14.616+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:14.780 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:14.773+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:14.978 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:14.971+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:14.996 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:14.989+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:15.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:14.997+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:15.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:15.489+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:15.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:15.646+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:15.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:15.807+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:15.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:15.990+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:16.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:15.997+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:16.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:16.018+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:16.483 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:16.475+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:16.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:16.611+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:16.830 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:16.818+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:17.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:17.002+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:17.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:17.032+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:17.056 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:17.049+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:17.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:17.442+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:17.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:17.653+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:17.875 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:17.867+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:17.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:17.976+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:18.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:18.023+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:18.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:18.054+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:18.459 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:18.452+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:18.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:18.704+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:18.850 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:18.842+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:18.998 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:18.991+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:19.003 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:18.996+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:19.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:19.089+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:19.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:19.454+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:19.682 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:19.674+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:19.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:19.888+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:19.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:19.968+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:20.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:20.006+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:20.068 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:20.060+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:20.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:20.461+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:20.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:20.723+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:20.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:20.854+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:20.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:20.974+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:21.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:21.005+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:21.038 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:21.031+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:21.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:21.510+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:21.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:21.762+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:21.853 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:21.834+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:21.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:21.943+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:22.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:22.001+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:22.039 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:22.032+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:22.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:22.524+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:22.593 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:22.587+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:22.809 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:22.802+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:22.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:22.871+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:22.996 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:22.989+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:23.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:23.043+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:23.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:23.048+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:23.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:23.518+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:23.616 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:23.610+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:23.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:23.830+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:23.840 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:23.833+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:24.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:24.017+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:24.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:24.066+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:24.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:24.065+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:24.555 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:24.548+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:24.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:24.582+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:24.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:24.809+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:24.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:24.851+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:25.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:25.046+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:25.079 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:25.071+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:25.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:25.087+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:25.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:25.502+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:25.611 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:25.603+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:25.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:25.605+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:25.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:25.842+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:25.858 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:25.850+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:26.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:26.028+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:26.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:26.034+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:26.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:26.046+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:26.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:26.494+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:26.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:26.612+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:26.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:26.615+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:26.884 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:26.876+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:26.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:26.893+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:27.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:27.037+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:27.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:27.071+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:27.088 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:27.078+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:27.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:27.539+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:27.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:27.612+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:27.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:27.614+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:27.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:27.852+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:27.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:27.905+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:28.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:28.052+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:28.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:28.053+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:28.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:28.119+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:28.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:28.532+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:28.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:28.581+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:28.590 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:28.583+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:28.899 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:28.890+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:28.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:28.892+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:29.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:29.015+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:29.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:29.017+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:29.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:29.161+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:29.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:29.505+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:29.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:29.596+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:29.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:29.598+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:29.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:29.886+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:29.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:29.945+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:29.995 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:29.987+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:30.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:30.037+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:30.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:30.144+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:30.504 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:30.497+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:30.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:30.572+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:30.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:30.574+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:30.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:30.924+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:30.944 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:30.936+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:30.992 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:30.978+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:31.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:31.087+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:31.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:31.127+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:31.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:31.529+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:31.606 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:31.598+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:31.607 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:31.600+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:31.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:31.913+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:31.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:31.914+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:32.018 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:32.009+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:32.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:32.085+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:32.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:32.119+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:32.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:32.511+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:32.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:32.574+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:32.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:32.575+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:32.940 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:32.932+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:32.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:32.955+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:33.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:33.017+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:33.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:33.059+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:33.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:33.088+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:33.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:33.551+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:33.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:33.624+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:33.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:33.625+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:33.925 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:33.917+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:33.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:33.924+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:34.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:34.000+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:34.098 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:34.089+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:34.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:34.094+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:34.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:34.573+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:34.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:34.634+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:34.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:34.635+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:34.967 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:34.958+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:34.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:34.961+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:34.971 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:34.961+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:35.067 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:35.058+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:35.116 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:35.109+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:35.587 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:35.579+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:35.640 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:35.632+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:35.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:35.634+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:35.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:35.931+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:35.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:35.955+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:35.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:35.968+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:36.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:36.095+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:36.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:36.112+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:36.612 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:36.603+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:36.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:36.617+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:36.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:36.619+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:36.917 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:36.906+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:36.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:36.937+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:36.998 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:36.990+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:37.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:37.050+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:37.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:37.133+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:37.592 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:37.584+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:37.653 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:37.644+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:37.654 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:37.647+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:37.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:37.909+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:37.949 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:37.942+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:38.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:38.004+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:38.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:38.029+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:38.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:38.181+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:38.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:38.562+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:38.686 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:38.678+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:38.689 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:38.683+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:38.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:38.876+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:38.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:38.947+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:39.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:39.026+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:39.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:39.048+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:39.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:39.175+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:39.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:39.526+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:39.728 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:39.721+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:39.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:39.723+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:39.943 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:39.935+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:39.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:39.980+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:40.078 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:40.071+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:40.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:40.100+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:40.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:40.127+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:40.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:40.545+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:40.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:40.736+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:40.744 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:40.738+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:40.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:40.940+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:40.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:40.983+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:41.096 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:41.088+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:41.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:41.103+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:41.150 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:41.143+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:41.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:41.518+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:41.749 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:41.741+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:41.750 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:41.743+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:41.945 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:41.938+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:41.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:41.985+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:42.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:42.075+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:42.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:42.076+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:42.120 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:42.111+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:42.482 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:42.475+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:42.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:42.768+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:42.778 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:42.772+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:42.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:42.950+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:43.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:43.024+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:43.085 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:43.073+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:43.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:43.086+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:43.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:43.149+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:43.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:43.492+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:43.825 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:43.818+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:43.828 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:43.822+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:43.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:43.928+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:44.028 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:44.021+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:44.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:44.053+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:44.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:44.066+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:44.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:44.161+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:44.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:44.534+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:44.854 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:44.845+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:44.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:44.848+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:44.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:44.895+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:45.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:45.016+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:45.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:45.051+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:45.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:45.080+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:45.131 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:45.124+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:45.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:45.503+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:45.839 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:45.832+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:45.839 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:45.833+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:45.875 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:45.866+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:46.004 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:45.996+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:46.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:46.048+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:46.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:46.049+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:46.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:46.108+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:46.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:46.464+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:46.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:46.790+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:46.800 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:46.793+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:46.845 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:46.825+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:46.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:46.965+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:47.029 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:47.021+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:47.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:47.084+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:47.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:47.105+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:47.474 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:47.467+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:47.820 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:47.812+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:47.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:47.838+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:47.847 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:47.839+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:47.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:47.928+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:47.998 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:47.991+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:48.090 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:48.083+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:48.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:48.092+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:48.102 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:54:48.095+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e454 v454) 2019-11-29T17:54:48.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:48.447+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:48.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:48.795+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:48.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:48.797+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:48.814 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:48.807+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:48.913 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:48.905+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:48.959 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:48.952+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:49.068 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:49.061+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:49.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:49.105+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:49.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:49.403+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:49.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:49.761+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:49.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:49.763+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:49.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:49.811+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:49.957 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:49.948+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:49.957 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:49.951+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:50.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:50.093+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:50.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:50.153+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:50.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:50.369+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:50.781 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:50.775+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:50.782 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:50.776+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:50.791 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:50.783+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:50.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:50.904+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:50.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:50.941+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:51.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:51.125+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:51.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:51.216+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:51.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:51.358+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:51.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:51.763+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:51.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:51.764+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:51.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:51.826+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:51.872 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:51.864+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:51.999 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:51.991+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:52.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:52.092+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:52.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:52.195+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:52.389 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:52.380+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:52.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:52.745+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:52.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:52.746+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:52.825 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:52.817+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:52.917 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:52.909+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:53.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:53.037+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:53.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:53.062+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:53.123 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:54:53.114+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e454 v454) 2019-11-29T17:54:53.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:53.195+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:53.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:53.400+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:53.786 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:53.779+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:53.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:53.780+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:53.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:53.864+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:53.914 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:53.906+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:54.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:54.017+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:54.097 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:54.089+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:54.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:54.172+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:54.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:54.448+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:54.833 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:54.824+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:54.833 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:54.825+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:54.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:54.857+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:54.888 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:54.880+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:54.984 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:54.976+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:55.108 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:55.100+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:55.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:55.180+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:55.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:55.402+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:55.800 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:55.792+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:55.805 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:55.794+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:55.862 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:55.854+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:55.881 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:55.869+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:55.947 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:55.938+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:56.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:56.082+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:56.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:56.149+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:56.378 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:56.357+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:56.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:56.762+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:56.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:56.763+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:56.900 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:56.891+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:56.901 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:56.894+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:56.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:56.951+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:57.061 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:57.053+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:57.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:57.112+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:57.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:54:57.385+0000 1694c700 -1 osd.1 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.649878+0000 front 2019-11-29T17:53:28.593496+0000 (oldest deadline 2019-11-29T17:54:13.261400+0000) 2019-11-29T17:54:57.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:57.790+0000 1694c700 -1 osd.0 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:53:44.906492+0000 (oldest deadline 2019-11-29T17:54:24.906492+0000) 2019-11-29T17:54:57.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:57.792+0000 1694c700 -1 osd.0 454 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e450) 2019-11-29T17:54:57.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:54:57.881+0000 1694c700 -1 osd.5 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.001488+0000 front 2019-11-29T17:53:27.998380+0000 (oldest deadline 2019-11-29T17:54:13.838850+0000) 2019-11-29T17:54:57.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:54:57.921+0000 1694c700 -1 osd.4 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.762702+0000 front 2019-11-29T17:53:28.755494+0000 (oldest deadline 2019-11-29T17:54:12.718707+0000) 2019-11-29T17:54:57.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:54:57.933+0000 1694c700 -1 osd.2 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:26.189973+0000 front 2019-11-29T17:53:26.164511+0000 (oldest deadline 2019-11-29T17:54:11.220644+0000) 2019-11-29T17:54:58.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:54:58.024+0000 1694c700 -1 osd.7 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.650251+0000 front 2019-11-29T17:53:28.642905+0000 (oldest deadline 2019-11-29T17:54:11.472038+0000) 2019-11-29T17:54:58.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:54:58.085+0000 1694c700 -1 osd.6 454 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:53:28.002263+0000 front 2019-11-29T17:53:28.076203+0000 (oldest deadline 2019-11-29T17:54:12.607486+0000) 2019-11-29T17:54:58.190 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:54:58.179+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e454 v454) 2019-11-29T17:54:58.905 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:54:58.887+0000 38f92700 -1 osd.0 455 build_incremental_map_msg missing incremental map 451 2019-11-29T17:55:44.541 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:39:52.674 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.549 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:39:52.683 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.558 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:39:52.737 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.562 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:39:52.741 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.562 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:39:52.742 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.565 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:39:52.744 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.796 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:39:52.975 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.813 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:39:52.993 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:44.855 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:39:52.985 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:55:54.305 INFO:teuthology.orchestra.run.smithi182.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-11-29T17:56:24.641 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:24.633+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:25.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:25.636+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:25.662 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:25.653+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:25.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:25.695+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:25.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:25.792+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:26.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:26.358+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:26.623 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:26.615+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:26.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:26.652+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:26.670 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:26.661+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:26.685 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:26.676+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:26.842 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:26.835+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:27.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:27.361+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:27.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:27.590+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:27.631 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:27.623+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:27.692 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:27.683+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:27.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:27.703+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:27.834 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:27.825+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:28.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:28.225+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:28.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:28.382+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:28.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:28.563+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:28.655 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:28.647+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:28.700 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:28.693+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:28.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:28.719+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:28.808 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:28.799+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:29.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:29.211+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:29.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:29.420+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:29.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:29.590+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:29.629 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:29.622+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:29.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:29.717+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:29.758 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:29.750+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:29.810 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:29.801+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:30.230 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:30.222+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:30.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:30.385+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:30.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:30.595+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:30.664 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:30.657+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:30.722 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:30.714+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:30.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:30.782+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:30.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:30.781+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:31.278 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:31.270+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:31.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:31.404+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:31.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:31.627+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:31.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:31.678+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:31.694 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:31.686+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:31.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:31.736+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:31.816 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:31.809+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:32.323 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:32.315+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:32.389 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:32.381+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:32.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:32.612+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:32.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:32.677+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:32.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:32.723+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:32.741 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:32.734+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:32.801 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:32.792+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:33.348 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:33.340+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:33.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:33.403+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:33.649 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:33.641+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:33.663 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:33.655+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:33.719 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:33.711+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:33.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:33.742+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:33.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:33.767+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:34.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:34.359+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:34.459 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:34.450+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:34.676 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:34.668+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:34.703 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:34.695+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:34.720 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:34.711+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:34.756 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:34.750+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:34.816 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:34.808+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:35.345 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:35.338+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:35.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:35.470+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:35.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:35.639+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:35.726 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:35.718+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:35.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:35.721+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:35.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:35.734+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:35.781 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:35.773+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:36.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:36.390+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:36.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:36.467+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:36.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:36.602+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:36.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:36.687+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:36.736 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:36.729+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:36.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:36.734+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:36.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:36.734+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:37.451 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:37.441+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:37.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:37.481+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:37.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:37.569+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:37.692 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:37.684+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:37.695 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:37.688+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:37.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:37.696+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:37.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:37.784+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:38.489 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:38.482+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:38.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:38.522+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:38.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:38.579+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:38.663 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:38.656+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:38.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:38.722+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:38.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:38.743+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:38.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:38.750+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:39.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:39.508+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:39.531 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:39.523+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:39.600 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:39.583+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:39.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:39.683+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:39.726 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:39.715+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:39.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:39.733+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:39.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:39.752+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:40.514 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:40.506+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:40.519 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:40.510+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:40.588 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:40.579+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:40.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:40.706+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:40.744 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:40.736+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:40.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:40.743+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:40.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:40.751+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:41.479 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:41.472+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:41.502 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:41.493+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:41.636 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:41.627+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:41.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:41.691+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:41.737 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:41.727+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:41.748 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:41.739+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:41.800 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:41.792+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:42.445 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:42.437+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:42.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:42.498+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:42.661 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:42.651+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:42.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:42.700+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:42.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:42.731+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:42.748 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:42.741+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:42.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:42.768+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:43.466 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:43.458+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:43.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:43.458+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:43.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:43.689+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:43.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:43.703+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:43.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:43.732+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:43.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:43.753+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:43.789 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:43.777+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:44.446 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:44.439+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:44.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:44.492+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:44.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:44.671+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:44.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:44.696+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:44.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:44.738+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:44.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:44.762+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:44.799 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:44.791+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:45.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:45.492+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:45.546 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:45.529+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:45.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:45.641+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:45.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:45.725+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:45.798 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:45.789+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:45.815 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:45.806+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:45.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:45.809+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:46.553 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:46.541+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:46.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:46.574+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:46.659 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:46.650+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:46.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:46.741+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:46.806 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:46.797+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:46.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:46.835+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:46.847 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:46.839+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:47.522 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:47.512+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:47.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:47.541+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:47.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:47.645+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:47.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:47.754+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:47.770 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:47.763+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:47.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:47.794+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:47.869 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:47.861+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:48.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:48.486+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:48.537 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:48.527+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:48.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:48.679+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:48.726 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:48.717+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:48.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:48.746+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:48.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:48.775+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:48.898 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:48.891+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:49.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:49.526+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:49.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:49.574+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:49.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:49.730+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:49.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:49.735+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:49.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:49.736+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:49.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:49.816+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:49.933 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:49.925+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:50.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:50.536+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:50.569 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:50.561+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:50.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:50.695+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:50.741 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:50.731+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:50.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:50.737+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:50.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:50.855+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:50.950 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:50.942+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:51.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:51.538+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:51.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:51.592+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:51.661 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:51.650+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:51.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:51.716+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:51.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:51.727+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:51.877 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:51.869+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:51.993 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:51.985+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:52.512 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:52.504+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:52.580 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:52.571+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:52.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:52.692+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:52.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:52.693+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:52.717 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:52.710+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:52.868 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:52.860+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:52.972 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:52.962+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:53.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:53.518+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:53.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:53.589+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:53.671 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:53.662+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:53.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:53.669+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:53.723 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:53.715+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:53.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:53.820+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:53.942 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:53.933+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:54.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:54.528+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:54.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:54.627+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:54.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:54.657+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:54.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:54.679+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:54.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:54.763+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:54.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:54.809+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:54.927 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:54.919+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:55.561 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:55.553+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:55.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:55.597+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:55.672 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:55.664+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:55.707 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:55.698+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:55.723 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:55.716+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:55.843 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:55.834+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:55.933 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:55.924+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:56.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:56.547+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:56.652 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:56.644+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:56.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:56.683+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:56.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:56.727+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:56.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:56.731+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:56.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:56.842+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:56.934 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:56.927+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:57.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:57.533+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:57.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:57.647+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:57.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:57.666+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:57.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:57.746+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:57.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:57.775+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:57.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:56:57.883+0000 1694c700 -1 osd.5 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.456121+0000 front 2019-11-29T17:55:41.454182+0000 (oldest deadline 2019-11-29T17:56:25.695262+0000) 2019-11-29T17:56:57.947 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:57.939+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:56:58.585 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:56:58.578+0000 1694c700 -1 osd.2 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.713078+0000 front 2019-11-29T17:55:42.802864+0000 (oldest deadline 2019-11-29T17:56:27.361018+0000) 2019-11-29T17:56:58.676 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:56:58.669+0000 1694c700 -1 osd.7 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:42.756310+0000 front 2019-11-29T17:55:42.803672+0000 (oldest deadline 2019-11-29T17:56:25.635690+0000) 2019-11-29T17:56:58.681 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:56:58.673+0000 1694c700 -1 osd.6 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:40.420644+0000 front 2019-11-29T17:55:40.620149+0000 (oldest deadline 2019-11-29T17:56:24.614456+0000) 2019-11-29T17:56:58.708 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:56:58.694+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e460 v460) 2019-11-29T17:56:58.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:56:58.759+0000 1694c700 -1 osd.1 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.688292+0000 front 2019-11-29T17:55:39.939574+0000 (oldest deadline 2019-11-29T17:56:25.497916+0000) 2019-11-29T17:56:58.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:56:58.815+0000 1694c700 -1 osd.4 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:39.741060+0000 front 2019-11-29T17:55:39.940199+0000 (oldest deadline 2019-11-29T17:56:25.508939+0000) 2019-11-29T17:56:58.928 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:56:58.901+0000 1694c700 -1 osd.3 460 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:55:41.906153+0000 front 2019-11-29T17:55:41.907363+0000 (oldest deadline 2019-11-29T17:56:26.355868+0000) 2019-11-29T17:57:30.247 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:57:30.238+0000 30f82700 -1 osd.6 464 build_incremental_map_msg missing incremental map 464 2019-11-29T17:57:30.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:57:30.409+0000 35f8c700 -1 osd.1 464 build_incremental_map_msg missing incremental map 464 2019-11-29T17:57:32.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:57:32.008+0000 11cac700 -1 osd.1 465 build_incremental_map_msg missing incremental map 464 2019-11-29T17:57:32.191 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:57:32.183+0000 114ab700 -1 osd.6 465 build_incremental_map_msg missing incremental map 464 2019-11-29T17:57:57.588 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:57:57.580+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:57:58.251 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:57:58.244+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:57:58.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:57:58.408+0000 1694c700 -1 osd.4 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:12.813205+0000 front 2019-11-29T17:57:12.814682+0000 (oldest deadline 2019-11-29T17:57:57.488296+0000) 2019-11-29T17:57:58.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:57:58.549+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:57:58.783 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:57:58.774+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:57:59.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:57:59.239+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:57:59.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:57:59.455+0000 1694c700 -1 osd.4 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:12.813205+0000 front 2019-11-29T17:57:12.814682+0000 (oldest deadline 2019-11-29T17:57:57.488296+0000) 2019-11-29T17:57:59.594 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:57:59.586+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:57:59.697 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:57:59.689+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:57:59.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:57:59.757+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:00.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:00.241+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:00.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T17:58:00.508+0000 1694c700 -1 osd.4 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:12.813205+0000 front 2019-11-29T17:57:12.814682+0000 (oldest deadline 2019-11-29T17:57:57.488296+0000) 2019-11-29T17:58:00.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:00.559+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:00.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:00.615+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:00.729 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:00.721+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:00.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:00.798+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:01.242 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:01.235+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:01.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:01.545+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:01.655 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:01.648+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:01.683 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:01.677+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:01.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:01.702+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:01.818 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:01.810+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:02.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:02.232+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:02.583 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:02.574+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:02.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:02.629+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:02.645 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:02.639+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:02.723 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:02.715+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:02.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:02.815+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:03.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:03.205+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:03.587 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:03.578+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:03.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:03.615+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:03.651 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:03.641+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:03.776 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:03.768+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:03.881 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:03.871+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:04.187 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:04.180+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:04.585 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:04.575+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:04.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:04.602+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:04.638 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:04.632+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:04.821 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:04.814+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:04.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:04.929+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:05.164 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:05.157+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:05.607 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:05.599+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:05.622 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:05.613+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:05.663 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:05.657+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:05.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:05.845+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:05.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:05.921+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:06.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:06.119+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:06.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:06.564+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:06.589 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:06.581+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:06.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:06.653+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:06.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:06.859+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:06.972 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:06.965+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:07.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:07.093+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:07.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:07.538+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:07.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:07.560+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:07.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:07.633+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:07.643 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:07.635+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:07.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:07.817+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:07.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:07.947+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:08.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:08.090+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:08.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:08.552+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:08.594 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:08.586+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:08.611 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:08.603+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:08.612 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:08.605+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:08.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:08.848+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:08.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:08.958+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:09.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:09.097+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:09.548 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:09.540+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:09.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:09.590+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:09.625 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:09.616+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:09.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:09.618+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:09.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:09.886+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:09.982 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:09.974+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:10.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:10.086+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:10.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:10.562+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:10.632 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:10.618+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:10.666 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:10.659+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:10.668 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:10.662+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:10.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:10.920+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:10.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:10.966+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:11.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:11.053+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:11.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:11.528+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:11.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:11.574+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:11.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:11.639+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:11.649 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:11.641+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:11.935 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:11.926+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:11.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:11.956+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:12.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:12.051+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:12.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:12.520+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:12.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:12.620+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:12.637 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:12.625+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:12.637 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:12.626+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:12.938 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:12.930+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:12.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:12.953+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:13.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:13.051+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:13.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:13.524+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:13.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:13.587+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:13.640 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:13.631+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:13.640 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:13.632+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:13.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:13.920+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:13.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:13.933+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:14.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:14.091+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:14.544 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:14.535+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:14.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:14.567+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:14.685 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:14.677+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:14.686 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:14.680+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:14.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:14.899+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:14.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:14.978+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:15.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:15.110+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:15.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:15.520+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:15.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:15.543+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:15.699 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:15.692+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:15.700 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:15.693+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:15.913 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:15.904+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:15.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:15.957+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:16.139 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:16.131+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:16.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:16.496+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:16.585 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:16.576+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:16.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:16.705+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:16.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:16.707+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:16.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:16.880+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:16.935 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:16.928+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:17.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:17.122+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:17.523 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:17.515+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:17.627 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:17.618+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:17.765 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:17.757+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:17.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:17.759+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:17.918 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:17.909+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:17.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:17.917+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:18.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:18.085+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:18.556 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:18.545+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:18.652 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:18.643+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:18.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:18.754+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:18.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:18.758+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:18.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:18.947+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:18.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:18.957+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:19.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:19.094+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:19.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:19.544+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:19.633 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:19.623+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:19.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:19.722+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:19.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:19.723+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:19.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:19.931+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:20.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:20.013+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:20.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:20.147+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:20.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:20.527+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:20.594 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:20.587+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:20.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:20.748+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:20.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:20.749+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:20.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:20.954+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:21.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:21.050+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:21.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:21.123+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:21.519 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:21.510+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:21.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:21.543+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:21.718 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:21.709+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:21.719 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:21.711+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:21.986 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:21.978+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:22.080 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:22.072+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:22.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:22.089+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:22.561 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:22.550+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:22.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:22.560+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:22.680 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:22.673+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:22.681 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:22.675+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:23.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:23.029+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:23.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:23.092+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:23.105 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:23.097+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:23.561 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:23.554+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:23.597 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:23.589+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:23.678 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:23.670+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:23.679 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:23.672+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:24.015 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:24.006+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:24.090 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:24.083+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:24.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:24.087+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:24.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:24.556+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:24.587 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:24.580+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:24.723 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:24.714+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:24.723 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:24.715+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:25.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:25.009+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:25.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:25.084+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:25.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:25.106+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:25.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:25.551+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:25.580 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:25.572+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:25.766 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:25.759+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:25.768 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:25.760+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:25.980 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:25.972+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:26.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:26.117+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:26.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:26.144+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:26.511 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:26.505+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:26.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:26.610+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:26.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:26.773+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:26.783 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:26.775+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:27.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:26.996+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:27.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:27.098+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:27.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:27.159+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:27.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:27.511+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:27.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:27.578+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:27.801 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:27.793+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:27.802 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:27.795+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:27.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:27.983+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:28.128 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:28.119+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:28.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:28.154+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:28.503 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:28.494+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:28.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:28.609+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:28.856 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:28.844+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:28.856 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:28.848+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:29.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:29.014+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:29.085 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:29.076+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:29.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:29.202+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:29.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:29.457+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:29.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:29.641+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:29.868 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:29.858+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:29.870 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:29.861+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:30.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:30.044+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:30.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:30.069+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:30.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:30.242+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:30.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:30.429+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:30.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:30.693+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:30.839 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:30.831+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:30.842 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:30.836+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:31.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:31.043+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:31.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:31.094+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:31.293 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:31.286+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:31.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:31.462+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:31.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:31.703+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:31.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:31.879+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:31.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:31.881+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:32.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:32.037+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:32.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:32.086+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:32.296 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:32.289+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:32.429 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:32.422+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:32.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:32.710+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:32.909 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:32.900+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:32.910 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:32.902+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:33.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:33.025+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:33.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:33.133+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:33.347 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:33.338+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:33.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:33.459+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:33.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:33.708+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:33.905 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:33.897+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:33.906 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:33.898+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:34.087 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:34.079+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:34.180 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:34.170+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:34.193 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:58:34.182+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 49sec e466 v466) 2019-11-29T17:58:34.326 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:42:42.459 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.334 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:42:42.467 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.355 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:42:42.534 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.357 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:42:42.536 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.371 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:42:42.551 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.387 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:42:42.567 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:34.386+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:34.511 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:34.504+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:34.520 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:42:42.700 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.588 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:42:42.765 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.609 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:42:42.742 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:58:34.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:34.691+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:34.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:34.871+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:34.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:34.872+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:35.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:35.122+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:35.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:35.176+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:35.395 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:35.388+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:35.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:35.468+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:35.744 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:35.736+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:35.909 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:35.901+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:35.909 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:35.903+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:36.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:36.130+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:36.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:36.200+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:36.351 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:36.343+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:36.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:36.474+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:36.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:36.740+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:36.875 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:36.867+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:36.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:36.871+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:37.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:37.179+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:37.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:37.231+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:37.398 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:37.387+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:37.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:37.447+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:37.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:37.722+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:37.887 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:37.879+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:37.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:37.881+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:38.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:38.185+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:38.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:38.227+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:38.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:38.423+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:58:38.477 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:38.469+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:38.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T17:58:38.696+0000 1694c700 -1 osd.5 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:15.775190+0000 front 2019-11-29T17:57:15.758787+0000 (oldest deadline 2019-11-29T17:58:00.177536+0000) 2019-11-29T17:58:38.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:38.889+0000 1694c700 -1 osd.0 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T17:57:27.607838+0000 (oldest deadline 2019-11-29T17:58:07.607838+0000) 2019-11-29T17:58:38.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T17:58:38.891+0000 1694c700 -1 osd.0 466 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112166 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e464) 2019-11-29T17:58:39.166 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T17:58:39.158+0000 1694c700 -1 osd.1 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.309392+0000 front 2019-11-29T17:57:14.617203+0000 (oldest deadline 2019-11-29T17:57:59.445838+0000) 2019-11-29T17:58:39.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T17:58:39.239+0000 1694c700 -1 osd.2 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:10.471362+0000 front 2019-11-29T17:57:10.472866+0000 (oldest deadline 2019-11-29T17:57:58.191231+0000) 2019-11-29T17:58:39.284 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T17:58:39.264+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 49sec e466 v466) 2019-11-29T17:58:39.454 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T17:58:39.445+0000 1694c700 -1 osd.6 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:11.847351+0000 front 2019-11-29T17:57:11.796663+0000 (oldest deadline 2019-11-29T17:57:57.082312+0000) 2019-11-29T17:58:39.469 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T17:58:39.462+0000 1694c700 -1 osd.7 466 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T17:57:14.047354+0000 front 2019-11-29T17:57:14.353171+0000 (oldest deadline 2019-11-29T17:57:58.687167+0000) 2019-11-29T17:59:14.658 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T17:59:14.646+0000 34f8a700 -1 osd.3 472 build_incremental_map_msg missing incremental map 471 2019-11-29T17:59:38.642 INFO:teuthology.orchestra.run.smithi182.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-11-29T17:59:44.680 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:43:52.814 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.694 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:43:52.828 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.714 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:43:52.893 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.716 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:43:52.896 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.755 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:43:52.935 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.760 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:43:52.940 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.812 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:43:52.991 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.855 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:43:52.989 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T17:59:44.877 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:43:53.056 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:00:12.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:12.750+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:13.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:13.435+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:13.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:13.705+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:13.772 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:13.765+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:14.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:14.421+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:14.739 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:14.732+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:14.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:14.738+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:14.877 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:14.868+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:15.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:15.051+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:15.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:15.392+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:15.596 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:15.589+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:15.705 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:15.698+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:15.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:15.775+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:15.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:15.843+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:16.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:16.050+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:16.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:16.403+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:16.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:16.544+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:16.717 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:16.706+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:16.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:16.775+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:16.888 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:16.876+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:16.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:16.943+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:17.072 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:17.064+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:17.457 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:17.449+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:17.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:17.547+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:17.741 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:17.734+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:17.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:17.751+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:17.911 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:17.901+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:17.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:17.905+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:18.111 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:18.104+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:18.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:18.455+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:18.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:18.577+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:18.729 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:18.722+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:18.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:18.799+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:18.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:18.924+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:18.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:18.933+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:19.160 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:19.152+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:19.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:19.454+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:19.615 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:19.607+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:19.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:19.765+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:19.779 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:19.772+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:19.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:19.938+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:19.968 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:19.960+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:20.120 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:20.113+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:20.452 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:20.443+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:20.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:20.601+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:20.809 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:20.802+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:20.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:20.809+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:20.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:20.906+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:21.002 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:20.994+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:21.137 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:21.128+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:21.497 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:21.489+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:21.646 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:21.638+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:21.770 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:21.763+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:21.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:21.830+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:21.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:21.951+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:21.983 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:21.969+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:22.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:22.085+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:22.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:22.505+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:22.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:22.593+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:22.778 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:22.772+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:22.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:22.828+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:22.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:22.918+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:22.977 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:22.967+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:23.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:23.057+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:23.483 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:23.475+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:23.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:23.642+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:23.752 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:23.744+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:23.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:23.804+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:23.910 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:23.902+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:24.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:24.003+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:24.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:24.106+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:24.438 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:24.429+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:24.635 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:24.627+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:24.777 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:24.771+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:24.802 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:24.794+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:24.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:24.906+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:25.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:25.054+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:25.093 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:25.085+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:25.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:25.412+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:25.621 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:25.612+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:25.741 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:25.728+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:25.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:25.813+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:25.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:25.940+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:26.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:26.026+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:26.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:26.052+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:26.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:26.375+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:26.603 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:26.595+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:26.699 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:26.692+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:26.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:26.776+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:26.954 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:26.945+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:27.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:27.024+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:27.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:27.095+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:27.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:27.363+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:27.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:27.561+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:27.741 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:27.734+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:27.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:27.732+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:27.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:27.927+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:27.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:27.985+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:28.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:28.049+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:28.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:28.322+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:28.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:28.524+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:28.752 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:28.742+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:28.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:28.765+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:28.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:28.931+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:28.992 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:28.982+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:29.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:29.059+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:29.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:29.342+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:29.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:29.480+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:29.780 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:29.772+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:29.783 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:29.776+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:29.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:29.953+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:30.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:30.017+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:30.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:30.042+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:30.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:30.359+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:30.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:30.491+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:30.749 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:30.739+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:30.800 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:30.794+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:30.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:30.940+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:30.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:30.988+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:31.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:31.019+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:31.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:31.405+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:31.458 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:31.451+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:31.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:31.695+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:31.844 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:31.835+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:31.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:31.953+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:31.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:31.973+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:32.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:32.019+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:32.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:32.413+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:32.446 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:32.439+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:32.735 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:32.717+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:32.880 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:32.873+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:32.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:32.913+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:33.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:32.989+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:33.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:32.995+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:33.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:33.405+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:33.447 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:33.440+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:33.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:33.676+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:33.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:33.896+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:33.911 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:33.903+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:33.966 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:33.956+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:33.976 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:33.967+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:34.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:34.373+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:34.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:34.463+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:34.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:34.710+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:34.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:34.914+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:34.939 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:34.931+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:34.950 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:34.942+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:35.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:35.004+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:35.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:35.397+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:35.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:35.464+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:35.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:35.709+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:35.922 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:35.914+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:35.953 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:35.945+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:35.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:35.985+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:36.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:35.994+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:36.418 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:36.410+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:36.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:36.446+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:36.748 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:36.740+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:36.909 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:36.900+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:36.919 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:36.910+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:36.982 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:36.974+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:36.989 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:36.980+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:37.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:37.429+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:37.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:37.434+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:37.708 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:37.700+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:37.899 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:37.890+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:37.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:37.962+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:37.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:37.985+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:38.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:38.042+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:38.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:38.396+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:38.458 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:38.450+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:38.755 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:38.742+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:38.860 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:38.851+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:39.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:39.001+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:39.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:39.020+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:39.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:39.057+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:39.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:39.398+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:39.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:39.408+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:39.777 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:39.769+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:39.825 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:00:39.819+0000 1694c700 -1 osd.3 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.286457+0000 front 2019-11-29T17:59:28.383565+0000 (oldest deadline 2019-11-29T18:00:12.974409+0000) 2019-11-29T18:00:40.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:40.008+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:40.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:40.008+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:40.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:40.023+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:40.392 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:40.383+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:40.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:40.406+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:40.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:40.775+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:40.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:40.977+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:41.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:41.030+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:41.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:41.060+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:41.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:41.348+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:41.446 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:41.437+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:41.827 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:41.817+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:41.991 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:41.983+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:42.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:42.042+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:42.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:42.063+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:42.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:42.372+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:42.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:42.470+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:42.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:42.820+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:43.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:43.000+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:43.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:43.031+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:43.114 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:43.105+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:43.339 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:43.330+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:43.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:43.478+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:43.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:43.814+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:44.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:44.008+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:44.061 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:44.053+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:44.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:44.137+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:44.338 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:44.329+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:44.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:44.530+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:44.875 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:44.867+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:45.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:45.040+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:45.059 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:45.051+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:45.197 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:45.185+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:45.353 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:45.345+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:45.540 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:45.532+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:45.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:45.893+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:46.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:46.015+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:46.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:46.033+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:46.185 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:46.174+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:46.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:46.390+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:46.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:46.545+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:46.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:46.903+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:47.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:46.999+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:47.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:47.026+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:47.224 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:47.217+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:47.389 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:47.380+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:47.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:47.544+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:47.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:47.912+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:48.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:48.022+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:48.082 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:48.074+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:48.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:48.234+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:48.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:48.394+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:48.572 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:48.564+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:48.967 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:48.959+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:48.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:48.987+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:49.066 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:49.053+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:00:49.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:00:49.245+0000 1694c700 -1 osd.2 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:28.431127+0000 front 2019-11-29T17:59:28.633465+0000 (oldest deadline 2019-11-29T18:00:14.326325+0000) 2019-11-29T18:00:49.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:00:49.408+0000 1694c700 -1 osd.1 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.938869+0000 front 2019-11-29T17:59:30.001721+0000 (oldest deadline 2019-11-29T18:00:15.201317+0000) 2019-11-29T18:00:49.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:00:49.530+0000 1694c700 -1 osd.7 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.073230+0000 front 2019-11-29T17:59:26.903133+0000 (oldest deadline 2019-11-29T18:00:12.786950+0000) 2019-11-29T18:00:49.807 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:00:49.795+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e472 v472) 2019-11-29T18:00:49.968 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:00:49.960+0000 1694c700 -1 osd.4 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:27.076149+0000 front 2019-11-29T17:59:27.085740+0000 (oldest deadline 2019-11-29T18:00:12.332213+0000) 2019-11-29T18:00:50.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:00:50.009+0000 1694c700 -1 osd.6 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:31.978727+0000 front 2019-11-29T17:59:31.945003+0000 (oldest deadline 2019-11-29T18:00:16.602251+0000) 2019-11-29T18:00:50.113 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:00:50.102+0000 1694c700 -1 osd.5 472 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T17:59:29.298286+0000 front 2019-11-29T17:59:29.216356+0000 (oldest deadline 2019-11-29T18:00:13.890667+0000) 2019-11-29T18:01:21.603 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:21.498+0000 124ad700 -1 osd.0 478 build_incremental_map_msg missing incremental map 478 2019-11-29T18:01:22.055 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:21.988+0000 34f8a700 -1 osd.0 478 build_incremental_map_msg missing incremental map 478 2019-11-29T18:01:23.850 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:23.840+0000 36f8e700 -1 osd.0 479 build_incremental_map_msg missing incremental map 478 2019-11-29T18:01:48.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:48.558+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:49.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:49.031+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:49.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:49.059+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:49.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:49.179+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:49.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:49.562+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:49.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:49.991+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:50.106 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:50.098+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:50.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:50.173+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:50.301 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:50.288+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:50.541 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:50.532+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:50.906 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:50.898+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:51.001 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:50.991+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:51.084 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:51.076+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:51.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:51.130+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:51.296 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:51.289+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:51.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:51.461+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:51.546 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:51.539+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:51.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:51.922+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:51.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:51.979+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:52.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:52.082+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:52.095 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:52.086+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:52.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:52.254+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:52.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:52.510+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:52.597 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:52.591+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:52.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:52.939+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:53.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:52.996+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:53.134 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:53.126+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:53.138 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:53.130+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:53.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:53.253+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:53.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:53.472+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:53.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:53.630+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:53.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:53.907+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:54.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:54.020+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:54.141 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:54.132+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:54.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:54.177+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:54.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:54.269+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:54.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:54.522+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:54.609 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:54.602+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:54.888 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:54.880+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:55.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:55.067+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:55.163 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:55.154+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:55.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:55.172+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:55.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:55.278+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:55.539 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:55.526+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:55.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:55.571+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:55.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:55.906+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:56.053 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:56.043+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:56.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:56.144+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:56.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:56.207+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:56.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:56.298+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:56.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:56.567+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:56.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:56.568+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:56.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:56.894+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:57.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:57.060+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:57.170 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:57.161+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:57.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:57.231+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:57.313 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:57.303+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:57.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:57.533+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:57.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:57.580+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:57.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:57.910+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:58.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:58.050+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:58.167 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:58.159+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:58.235 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:58.226+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:58.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:58.294+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:58.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:58.571+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:01:58.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:58.572+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:58.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:58.572+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:58.938 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:58.930+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:01:59.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:01:59.108+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:01:59.201 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:01:59.193+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:01:59.231 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:01:59.223+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:01:59.316 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:01:59.308+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:01:59.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:01:59.572+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:01:59.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:59.604+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:01:59.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:01:59.607+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:01:59.954 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:01:59.947+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:00.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:00.116+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:00.166 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:00.156+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:00.188 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:00.178+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:00.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:00.350+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:00.565 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:00.557+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:00.636 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:00.627+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:00.636 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:00.630+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:00.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:00.964+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:01.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:01.090+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:01.150 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:01.142+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:01.234 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:01.226+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:01.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:01.372+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:01.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:01.602+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:01.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:01.610+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:01.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:01.612+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:01.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:01.930+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:02.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:02.121+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:02.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:02.125+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:02.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:02.266+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:02.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:02.410+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:02.586 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:02.579+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:02.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:02.582+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:02.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:02.649+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:02.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:02.936+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:03.143 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:03.135+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:03.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:03.172+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:03.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:03.267+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:03.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:03.422+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:03.582 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:03.573+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:03.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:03.575+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:03.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:03.624+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:03.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:03.963+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:04.143 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:04.136+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:04.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:04.153+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:04.283 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:04.275+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:04.427 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:04.420+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:04.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:04.561+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:04.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:04.563+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:04.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:04.660+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:05.020 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:05.012+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:05.125 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:05.118+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:05.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:05.173+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:05.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:05.270+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:05.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:05.398+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:05.566 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:05.559+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:05.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:05.562+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:05.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:05.646+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:06.035 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:06.027+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:06.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:06.165+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:06.219 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:06.212+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:06.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:06.265+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:06.418 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:06.411+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:06.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:06.517+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:06.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:06.518+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:06.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:06.612+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:07.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:07.027+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:07.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:07.198+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:07.210 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:07.202+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:07.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:07.266+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:07.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:07.458+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:07.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:07.513+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:07.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:07.518+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:07.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:07.583+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:08.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:08.008+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:08.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:08.244+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:08.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:08.252+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:08.267 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:08.258+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:08.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:08.470+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:08.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:08.550+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:08.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:08.558+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:08.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:08.560+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:09.049 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:09.040+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:09.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:09.242+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:09.283 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:09.275+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:09.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:09.294+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:09.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:09.500+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:09.585 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:09.578+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:09.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:09.596+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:09.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:09.599+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:10.046 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:10.038+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:10.257 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:10.250+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:10.268 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:10.261+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:10.293 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:10.286+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:10.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:10.538+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:10.582 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:10.574+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:10.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:10.633+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:10.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:10.635+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:11.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:11.054+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:11.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:11.242+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:11.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:11.275+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:11.312 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:11.304+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:11.557 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:11.549+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:11.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:11.602+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:11.669 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:11.661+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:11.670 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:11.662+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:12.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:12.082+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:12.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:12.244+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:12.300 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:12.292+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:12.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:12.294+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:12.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:12.561+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:12.584 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:12.576+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:12.653 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:12.645+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:12.654 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:12.648+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:13.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:13.083+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:13.253 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:13.235+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:13.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:13.298+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:13.339 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:13.330+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:13.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:13.540+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:13.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:02:13.545+0000 1694c700 -1 osd.7 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.628192+0000 front 2019-11-29T18:01:06.831699+0000 (oldest deadline 2019-11-29T18:01:49.341915+0000) 2019-11-29T18:02:13.662 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:13.655+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:13.664 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:13.658+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:14.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:14.108+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:14.277 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:14.270+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:14.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:14.288+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:14.368 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:14.359+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:14.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:14.510+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:14.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:14.622+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:14.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:14.623+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:15.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:15.122+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:15.236 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:15.229+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:15.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:15.246+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:15.378 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:15.371+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:15.487 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:15.479+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:15.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:15.589+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:15.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:15.591+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:16.180 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:16.173+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:16.254 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:16.245+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:16.260 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:16.253+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:16.362 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:16.355+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:16.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:16.450+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:16.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:16.576+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:16.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:16.578+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:17.165 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:17.158+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:17.247 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:17.239+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:17.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:17.239+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:17.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:17.382+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:17.476 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:17.467+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:17.566 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:17.557+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:17.567 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:17.560+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:18.144 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:18.136+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:18.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:18.197+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:18.246 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:18.239+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:18.408 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:18.385+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:18.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:18.441+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:18.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:18.557+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:18.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:18.558+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:19.107 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:19.100+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:19.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:19.208+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:19.279 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:19.271+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:19.416 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:19.409+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:19.463 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:19.456+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:19.586 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:19.579+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:19.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:19.583+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:20.133 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:20.126+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:20.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:20.210+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:20.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:20.298+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:20.457 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:20.450+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:20.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:20.482+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:20.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:20.609+0000 1694c700 -1 osd.0 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:01:17.693927+0000 (oldest deadline 2019-11-29T18:01:57.693927+0000) 2019-11-29T18:02:20.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:20.611+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:21.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:21.156+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:21.247 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:21.239+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:21.325 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:21.317+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:21.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:21.479+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:21.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:21.484+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:21.626 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:21.620+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:22.165 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:22.158+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:22.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:22.213+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:22.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:22.334+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:22.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:22.459+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:22.523 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:22.515+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:22.660 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:22.653+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:23.130 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:23.123+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:23.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:23.220+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:23.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:23.345+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:23.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:23.500+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:23.573 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:23.565+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:23.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:23.609+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:24.176 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:24.168+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:24.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:24.218+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:24.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:24.386+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:24.517 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:24.510+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:24.589 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:24.582+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:24.662 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:24.657+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:25.144 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:02:25.134+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e480 v480) 2019-11-29T18:02:25.175 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:25.169+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:25.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:25.198+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:25.435 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:25.427+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:25.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:25.545+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:25.561 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:25.551+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:25.676 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:25.670+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:26.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:26.216+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:26.249 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:26.241+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:26.413 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:26.402+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:26.538 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:26.531+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:26.558 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:26.552+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:26.677 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:26.671+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:27.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:27.182+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:27.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:27.252+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:27.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:27.369+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:27.531 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:27.523+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:27.552 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:27.545+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:27.672 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:27.666+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:28.219 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:28.211+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:28.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:28.234+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:28.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:28.337+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:28.540 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:28.532+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:28.573 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:28.566+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:28.707 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:28.700+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:29.194 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:29.185+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:29.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:29.250+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:29.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:29.339+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:29.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:29.540+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:29.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:29.573+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:29.735 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:29.729+0000 1694c700 -1 osd.0 480 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:02:30.188 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:02:30.178+0000 1694c700 -1 osd.4 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:04.660377+0000 front 2019-11-29T18:01:04.573135+0000 (oldest deadline 2019-11-29T18:01:48.411646+0000) 2019-11-29T18:02:30.225 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:02:30.219+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e480 v480) 2019-11-29T18:02:30.323 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:02:30.308+0000 1694c700 -1 osd.1 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:06.156887+0000 front 2019-11-29T18:01:06.220703+0000 (oldest deadline 2019-11-29T18:01:50.845760+0000) 2019-11-29T18:02:30.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:02:30.381+0000 1694c700 -1 osd.6 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.288530+0000 front 2019-11-29T18:01:05.414305+0000 (oldest deadline 2019-11-29T18:01:48.172614+0000) 2019-11-29T18:02:30.587 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:02:30.575+0000 1694c700 -1 osd.5 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:03.797597+0000 front 2019-11-29T18:01:03.860645+0000 (oldest deadline 2019-11-29T18:01:49.044085+0000) 2019-11-29T18:02:30.602 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:02:30.586+0000 1694c700 -1 osd.2 480 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:01:05.187343+0000 front 2019-11-29T18:01:05.185975+0000 (oldest deadline 2019-11-29T18:01:48.008634+0000) 2019-11-29T18:02:30.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:02:30.729+0000 1694c700 -1 osd.0 481 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e477) 2019-11-29T18:03:50.730 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:47:58.864 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.740 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:47:58.874 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.745 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:47:58.924 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.748 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:47:58.928 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.758 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:47:58.937 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.762 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:47:58.942 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:50.967 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:47:59.101 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:51.019 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:47:59.199 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:03:51.024 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:47:59.203 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:01.884 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:01.877+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:02.872 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:02.864+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:02.896 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:02.889+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:02.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:02.921+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:03.591 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:03.583+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:03.850 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:03.841+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:03.864 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:03.856+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:03.980 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:03.969+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:04.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:04.117+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:04.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:04.548+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:04.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:04.812+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:04.912 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:04.903+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:05.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:05.003+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:05.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:05.098+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:05.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:05.589+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:05.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:05.748+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:05.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:05.801+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:05.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:05.922+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:06.058 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:06.051+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:06.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:06.093+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:06.626 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:06.618+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:06.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:06.789+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:06.801 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:06.794+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:06.893 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:06.885+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:07.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:07.064+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:07.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:07.101+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:07.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:07.594+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:07.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:07.760+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:07.831 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:07.822+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:07.914 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:07.906+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:08.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:08.058+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:08.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:08.068+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:08.586 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:08.578+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:08.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:08.759+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:08.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:08.868+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:08.882 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:08.875+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:09.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:09.075+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:09.097 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:09.090+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:09.573 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:09.564+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:09.804 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:09.795+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:09.887 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:09.879+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:09.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:09.912+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:10.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:10.085+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:10.137 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:10.130+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:10.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:10.608+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:10.847 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:10.840+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:10.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:10.840+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:10.957 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:10.945+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:11.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:11.054+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:11.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:11.143+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:11.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:11.577+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:11.808 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:11.799+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:11.813 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:11.805+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:11.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:11.920+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:12.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:12.090+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:12.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:12.106+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:12.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:12.629+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:12.840 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:12.830+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:12.853 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:12.846+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:12.924 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:12.915+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:13.085 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:13.077+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:13.163 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:13.155+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:13.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:13.669+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:13.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:13.840+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:13.886 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:13.878+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:13.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:13.882+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:14.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:14.115+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:14.159 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:14.151+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:14.672 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:14.662+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:14.838 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:14.830+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:14.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:14.856+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:14.908 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:14.901+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:15.152 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:15.146+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:15.160 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:15.152+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:15.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:15.698+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:15.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:15.798+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:15.905 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:15.896+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:15.920 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:15.912+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:16.037 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:48:24.171 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.059 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:48:24.194 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.096 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:48:24.276 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.136 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:48:24.314 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.138 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:48:24.272 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.138 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:16.130+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:16.142 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:48:24.322 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.154 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:48:24.333 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.185 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:16.177+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:16.191 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:48:24.371 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.212 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:48:24.391 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:04:16.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:16.693+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:16.835 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:16.826+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:16.893 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:16.882+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:16.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:16.901+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:17.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:17.108+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:17.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:17.191+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:17.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:17.662+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:17.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:17.849+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:17.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:17.892+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:17.927 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:17.910+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:18.125 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:18.114+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:18.163 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:18.154+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:18.707 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:18.699+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:18.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:18.853+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:18.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:18.882+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:18.904 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:18.896+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:19.150 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:19.142+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:19.176 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:19.168+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:19.672 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:19.664+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:19.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:19.820+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:19.847 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:19.839+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:19.894 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:19.887+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:20.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:20.104+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:20.147 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:20.140+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:20.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:20.678+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:20.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:20.809+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:20.855 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:20.847+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:20.937 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:20.927+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:21.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:21.102+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:21.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:21.118+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:21.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:21.671+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:21.778 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:21.770+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:21.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:21.851+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:21.946 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:21.937+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:22.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:22.084+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:22.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:22.109+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:22.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:22.641+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:22.812 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:22.805+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:22.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:22.836+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:23.008 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:22.999+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:23.072 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:23.062+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:23.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:23.109+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:23.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:23.625+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:23.783 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:23.774+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:23.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:23.891+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:24.000 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:23.992+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:24.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:24.053+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:24.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:24.147+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:24.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:24.671+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:24.836 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:24.828+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:24.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:24.934+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:25.033 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:25.021+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:25.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:25.094+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:25.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:25.195+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:25.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:25.687+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:25.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:25.814+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:25.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:25.890+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:25.997 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:25.990+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:26.096 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:26.087+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:26.226 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:26.219+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:26.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:26.720+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:26.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:26.845+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:26.864 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:26.855+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:27.024 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:27.016+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:27.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:27.074+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:27.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:27.241+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:27.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:27.705+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:27.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:27.825+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:27.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:27.885+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:28.003 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:27.993+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:28.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:28.124+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:28.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:28.241+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:28.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:28.748+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:28.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:28.854+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:28.882 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:28.874+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:29.056 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:29.047+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:29.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:29.105+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:29.226 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:29.218+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:29.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:29.785+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:29.918 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:29.906+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:29.940 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:29.929+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:30.055 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:30.047+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:30.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:30.104+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:30.226 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:30.218+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:30.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:30.823+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:30.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:30.886+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:30.936 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:30.928+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:31.023 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:31.015+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:31.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:31.114+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:31.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:31.241+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:31.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:31.786+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:31.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:31.903+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:31.923 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:31.914+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:32.015 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:32.007+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:32.172 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:32.164+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:32.299 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:32.290+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:32.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:32.810+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:32.878 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:32.870+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:32.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:32.936+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:33.056 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:33.047+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:33.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:33.179+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:33.310 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:33.303+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:33.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:33.846+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:33.863 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:33.855+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:33.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:33.944+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:34.097 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:34.090+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:34.176 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:34.168+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:34.278 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:34.268+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:34.877 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:34.868+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:34.885 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:34.878+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:34.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:34.965+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:35.069 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:35.062+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:35.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:04:35.202+0000 1694c700 -1 osd.1 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:16.183533+0000 front 2019-11-29T18:03:16.353289+0000 (oldest deadline 2019-11-29T18:04:02.073279+0000) 2019-11-29T18:04:35.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:35.274+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:04:35.927 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:04:35.912+0000 1694c700 -1 osd.7 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.117907+0000 front 2019-11-29T18:03:17.222644+0000 (oldest deadline 2019-11-29T18:04:01.697472+0000) 2019-11-29T18:04:35.928 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:04:35.916+0000 1694c700 -1 osd.4 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:20.466294+0000 front 2019-11-29T18:03:20.464688+0000 (oldest deadline 2019-11-29T18:04:02.680863+0000) 2019-11-29T18:04:35.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:04:35.974+0000 1694c700 -1 osd.6 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:19.557393+0000 front 2019-11-29T18:03:19.506659+0000 (oldest deadline 2019-11-29T18:04:05.358657+0000) 2019-11-29T18:04:36.043 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:04:36.034+0000 1694c700 -1 osd.3 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:17.742361+0000 front 2019-11-29T18:03:17.790998+0000 (oldest deadline 2019-11-29T18:04:02.400876+0000) 2019-11-29T18:04:36.081 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:04:36.067+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e485 v485) 2019-11-29T18:04:36.251 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:04:36.233+0000 1694c700 -1 osd.2 485 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:03:18.958136+0000 front 2019-11-29T18:03:18.957252+0000 (oldest deadline 2019-11-29T18:04:03.898737+0000) 2019-11-29T18:05:34.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:34.825+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:35.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:35.170+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:35.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:35.800+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:35.891 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:35.883+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:36.089 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:36.080+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:36.210 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:36.203+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:36.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:36.514+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:36.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:36.826+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:36.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:36.851+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:37.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:37.067+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:37.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:37.255+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:37.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:37.293+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:37.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:37.490+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:37.800 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:37.792+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:37.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:37.846+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:38.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:38.063+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:38.288 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:38.280+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:38.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:38.316+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:38.463 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:38.456+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:38.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:38.776+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:38.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:38.860+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:39.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:39.026+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:39.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:39.053+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:39.287 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:39.279+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:39.309 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:39.300+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:39.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:39.465+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:39.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:39.735+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:39.886 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:39.877+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:40.045 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:40.039+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:40.086 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:40.078+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:40.272 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:40.263+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:40.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:40.289+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:40.432 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:40.425+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:40.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:40.756+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:40.847 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:40.839+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:41.076 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:41.070+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:41.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:41.074+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:41.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:41.250+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:41.305 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:41.298+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:41.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:41.388+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:41.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:41.796+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:41.812 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:41.802+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:42.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:42.114+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:42.123 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:42.116+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:42.222 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:42.213+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:42.298 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:42.291+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:42.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:42.345+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:42.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:42.812+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:42.835 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:42.827+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:43.131 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:43.125+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:43.172 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:43.163+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:43.190 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:43.182+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:43.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:43.320+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:43.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:43.372+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:43.790 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:43.781+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:43.840 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:43.831+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:44.135 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:44.129+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:44.136 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:44.127+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:44.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:44.190+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:44.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:44.365+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:44.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:44.374+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:44.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:44.766+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:44.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:44.826+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:45.103 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:45.097+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:45.106 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:45.100+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:45.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:45.099+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:45.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:45.241+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:45.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:45.342+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:45.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:45.397+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:45.739 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:45.731+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:45.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:45.851+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:46.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:46.140+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:46.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:46.139+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:46.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:46.142+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:46.262 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:46.254+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:46.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:46.371+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:46.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:46.389+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:46.761 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:46.740+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:46.889 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:46.881+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:47.127 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:47.120+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:47.128 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:47.122+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:47.129 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:47.121+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:47.233 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:47.225+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:47.389 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:47.382+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:47.436 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:47.427+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:47.801 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:47.793+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:47.908 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:47.900+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:48.123 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:48.102+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:48.142 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:48.133+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:48.142 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:48.135+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:48.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:48.223+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:48.402 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:48.395+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:48.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:48.474+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:48.801 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:48.793+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:48.928 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:48.921+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:49.115 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:49.107+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:49.184 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:49.176+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:49.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:49.180+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:49.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:49.255+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:49.387 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:49.379+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:49.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:49.477+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:49.767 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:49.760+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:49.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:49.972+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:50.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:50.161+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:50.213 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:50.206+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:50.214 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:50.208+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:50.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:50.244+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:50.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:50.381+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:50.454 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:50.446+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:50.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:50.800+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:51.019 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:51.011+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:51.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:51.159+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:51.175 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:51.166+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:51.176 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:51.169+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:51.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:51.263+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:51.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:51.354+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:51.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:51.430+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:51.805 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:51.798+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:51.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:51.984+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:52.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:52.115+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:52.138 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:52.127+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:52.139 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:52.132+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:52.229 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:52.221+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:52.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:52.342+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:52.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:52.482+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:52.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:52.801+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:52.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:52.968+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:53.085 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:53.078+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:53.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:53.105+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:53.114 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:53.107+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:53.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:53.219+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:53.319 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:53.312+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:53.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:53.481+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:53.811 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:53.804+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:53.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:53.939+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:54.070 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:54.064+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:54.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:54.066+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:54.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:54.124+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:54.186 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:54.176+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:54.309 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:54.300+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:54.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:54.464+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:54.808 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:54.800+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:54.958 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:54.951+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:55.050 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:55.029+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:55.050 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:55.034+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:55.179 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:55.171+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:55.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:55.191+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:55.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:55.338+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:55.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:55.499+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:55.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:55.847+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:56.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:55.998+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:56.052 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:56.044+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:56.054 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:56.046+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:56.223 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:56.214+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:56.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:56.231+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:56.326 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:56.319+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:56.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:56.518+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:56.844 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:56.837+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:56.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:56.990+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:57.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:57.064+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:57.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:57.066+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:57.207 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:57.199+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:57.267 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:57.257+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:57.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:57.357+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:57.492 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:57.486+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:57.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:57.809+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:57.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:57.971+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:58.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:58.085+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:58.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:58.089+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:58.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:58.231+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:58.241 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:58.233+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:58.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:58.363+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:58.503 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:58.495+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:58.819 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:58.813+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:58.949 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:58.942+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:05:59.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:59.083+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:05:59.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:05:59.084+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:05:59.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:05:59.258+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:05:59.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:05:59.280+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:05:59.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:05:59.361+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:05:59.535 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:05:59.528+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:05:59.847 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:05:59.839+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:05:59.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:05:59.933+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:00.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:00.122+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:00.130 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:00.124+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:00.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:00.249+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:00.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:00.256+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:00.386 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:00.379+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:00.588 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:00.581+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:00.852 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:00.845+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:00.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:00.979+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:01.125 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:01.116+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:01.125 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:01.119+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:01.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:01.262+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:01.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:01.271+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:01.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:01.334+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:01.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:01.615+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:01.847 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:01.839+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:01.984 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:01.977+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:02.152 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:02.144+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:02.152 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:02.146+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:02.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:02.251+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:02.286 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:02.278+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:02.391 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:02.384+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:02.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:02.610+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:02.816 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:02.809+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:02.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:02.946+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:03.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:03.181+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:03.190 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:03.184+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:03.246 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:03.237+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:03.274 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:03.267+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:03.386 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:03.377+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:03.660 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:03.652+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:03.803 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:03.795+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:03.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:03.930+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:04.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:04.180+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:04.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:04.183+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:04.294 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:04.286+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:04.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:04.299+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:04.349 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:04.339+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:04.701 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:04.693+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:04.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:04.766+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:04.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:04.955+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:05.205 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:05.198+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:05.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:05.202+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:05.258 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:05.250+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:05.307 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:05.299+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:05.366 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:05.359+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:05.720 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:05.696+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:05.778 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:05.770+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:05.967 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:05.957+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:06.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:06.169+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:06.178 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:06.171+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:06.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:06.276+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:06.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:06.294+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:06.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:06.369+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:06.714 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:06.706+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:06.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:06.805+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:06.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:06.968+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:07.188 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:07.179+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:07.188 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:07.182+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:07.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:07.252+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:07.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:07.262+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:07.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:07.369+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:07.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:07.732+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:07.798 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:07.790+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:07.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:07.991+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:08.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:08.231+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:08.238 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:08.233+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:08.252 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:08.245+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:08.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:08.277+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:08.336 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:08.328+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:08.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:08.782+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:08.794 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:08.783+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:08.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:08.946+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:09.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:09.247+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:09.255 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:09.249+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:09.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:09.258+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:09.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:09.262+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:09.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:09.303+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:09.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:09.780+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:09.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:09.837+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:09.928 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:09.921+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:10.227 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:10.219+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:10.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:10.260+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:10.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:10.262+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:10.303 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:10.292+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:10.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:10.357+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:10.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:10.768+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:10.818 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:10.810+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:10.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:10.958+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:11.239 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:11.232+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:11.300 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:11.292+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:11.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:11.294+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:11.347 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:11.339+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:11.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:11.374+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:11.447 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:06:11.437+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e491 v491) 2019-11-29T18:06:11.795 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:11.789+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:11.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:11.862+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:11.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:11.928+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:12.264 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:12.257+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:12.313 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:12.305+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:12.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:12.309+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:12.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:12.392+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:12.409 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:12.402+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:12.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:12.762+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:12.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:12.837+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:12.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:12.959+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:13.234 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:13.226+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:13.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:13.337+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:13.348 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:13.339+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:13.378 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:13.371+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:13.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:13.398+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:13.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:13.800+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:13.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:13.860+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:14.002 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:13.995+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:14.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:14.268+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:14.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:14.332+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:14.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:14.335+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:14.394 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:14.388+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:14.422 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:14.415+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:14.852 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:14.846+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:14.915 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:14.908+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:15.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:15.040+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:15.243 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:15.236+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:15.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:15.294+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:15.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:15.298+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:15.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:15.355+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:15.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:15.441+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:15.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:06:15.847+0000 1694c700 -1 osd.1 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.424125+0000 front 2019-11-29T18:04:53.421562+0000 (oldest deadline 2019-11-29T18:05:36.314614+0000) 2019-11-29T18:06:15.892 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:15.885+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:16.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:06:16.039+0000 1694c700 -1 osd.6 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.484136+0000 front 2019-11-29T18:04:51.530174+0000 (oldest deadline 2019-11-29T18:05:34.214050+0000) 2019-11-29T18:06:16.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:16.248+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:16.305 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:16.298+0000 1694c700 -1 osd.0 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:05:04.589869+0000 (oldest deadline 2019-11-29T18:05:44.589869+0000) 2019-11-29T18:06:16.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:06:16.299+0000 1694c700 -1 osd.0 491 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e489) 2019-11-29T18:06:16.409 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:06:16.401+0000 1694c700 -1 osd.2 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.131511+0000 front 2019-11-29T18:04:51.089082+0000 (oldest deadline 2019-11-29T18:05:34.579418+0000) 2019-11-29T18:06:16.486 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:06:16.479+0000 1694c700 -1 osd.5 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:52.811908+0000 front 2019-11-29T18:04:52.834540+0000 (oldest deadline 2019-11-29T18:05:36.296961+0000) 2019-11-29T18:06:16.515 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:06:16.508+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e491 v491) 2019-11-29T18:06:16.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:06:16.899+0000 1694c700 -1 osd.7 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:51.615772+0000 front 2019-11-29T18:04:51.614546+0000 (oldest deadline 2019-11-29T18:05:35.071587+0000) 2019-11-29T18:06:17.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:06:17.211+0000 1694c700 -1 osd.4 491 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:04:53.266872+0000 front 2019-11-29T18:04:53.278846+0000 (oldest deadline 2019-11-29T18:05:35.543397+0000) 2019-11-29T18:06:56.960 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:05.094 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:56.972 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:05.106 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.013 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:05.192 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.026 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:05.206 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.028 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:05.207 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.043 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:05.223 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.210 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:05.389 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.218 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:05.398 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:06:57.232 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:05.366 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:48.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:48.632+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:49.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:49.635+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:50.351 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:50.344+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:50.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:50.678+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:50.700 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:50.693+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:51.238 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:51.228+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:51.352 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:51.346+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:51.654 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:59.788 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.659 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:51.652+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:51.664 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:59.799 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.671 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:59.851 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.677 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:59.857 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.680 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:59.859 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.682 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:59.862 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.728 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:51:59.862 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.737 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:51:59.916 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:51.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:51.736+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:51.750 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:51:59.930 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:07:52.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:52.188+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:52.362 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:52.355+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:52.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:52.439+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:52.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:52.633+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:52.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:52.662+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:52.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:52.734+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:52.800 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:52.792+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:53.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:53.181+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:53.399 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:53.391+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:53.407 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:53.399+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:53.595 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:53.588+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:53.701 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:53.691+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:53.782 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:53.773+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:53.787 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:53.777+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:54.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:54.185+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:54.361 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:54.352+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:54.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:54.422+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:54.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:54.551+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:54.659 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:54.650+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:54.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:54.763+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:54.780 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:54.772+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:55.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:55.202+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:55.410 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:55.402+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:55.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:55.476+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:55.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:55.522+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:55.712 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:55.702+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:55.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:55.802+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:55.810 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:55.804+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:56.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:56.234+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:56.420 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:56.414+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:56.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:56.525+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:56.556 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:56.546+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:56.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:56.658+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:56.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:56.806+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:56.862 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:56.853+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:57.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:57.269+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:57.467 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:57.461+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:57.524 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:57.515+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:57.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:57.563+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:57.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:57.617+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:57.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:57.760+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:57.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:57.866+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:58.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:58.271+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:58.473 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:58.463+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:58.524 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:58.514+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:58.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:58.523+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:58.680 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:58.670+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:58.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:58.785+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:58.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:58.871+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:07:59.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:07:59.254+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:07:59.486 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:07:59.476+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:07:59.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:07:59.479+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:07:59.541 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:07:59.532+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:07:59.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:07:59.665+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:07:59.785 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:07:59.775+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:07:59.871 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:07:59.860+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:00.291 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:00.280+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:00.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:00.453+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:00.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:00.538+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:00.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:00.550+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:00.659 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:00.650+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:00.755 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:00.747+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:00.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:00.897+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:01.298 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:01.289+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:01.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:01.441+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:01.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:01.496+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:01.604 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:01.594+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:01.655 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:01.646+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:01.793 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:01.774+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:01.871 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:01.865+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:02.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:02.273+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:02.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:02.441+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:02.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:02.524+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:02.596 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:02.587+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:02.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:02.677+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:02.776 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:02.769+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:02.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:02.903+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:03.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:03.244+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:03.459 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:03.449+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:03.579 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:03.571+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:03.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:03.638+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:03.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:03.646+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:03.815 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:03.807+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:03.868 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:03.860+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:04.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:04.204+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:04.441 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:04.433+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:04.541 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:04.533+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:04.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:04.632+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:04.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:04.640+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:04.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:04.832+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:04.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:04.901+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:05.221 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:05.213+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:05.480 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:05.473+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:05.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:05.526+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:05.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:05.602+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:05.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:05.626+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:05.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:05.829+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:05.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:05.930+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:06.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:06.220+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:06.456 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:06.449+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:06.545 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:06.537+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:06.597 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:06.583+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:06.669 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:06.659+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:06.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:06.870+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:06.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:06.917+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:07.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:07.217+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:07.506 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:07.497+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:07.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:07.540+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:07.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:07.603+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:07.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:07.666+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:07.915 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:07.908+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:07.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:07.968+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:08.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:08.186+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:08.462 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:08.453+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:08.524 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:08.516+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:08.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:08.626+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:08.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:08.683+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:08.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:08.876+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:08.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:08.957+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:09.163 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:09.155+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:09.466 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:09.458+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:09.576 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:09.569+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:09.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:09.598+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:09.714 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:09.706+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:09.869 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:09.862+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:09.978 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:09.971+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:10.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:10.191+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:10.435 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:10.427+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:10.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:10.569+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:10.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:10.639+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:10.679 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:10.667+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:10.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:10.869+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:11.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:11.004+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:11.182 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:11.174+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:11.444 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:11.435+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:11.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:11.611+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:11.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:11.629+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:11.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:11.649+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:11.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:11.891+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:12.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:12.017+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:12.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:12.167+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:12.422 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:12.416+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:12.583 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:12.574+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:12.615 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:12.606+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:12.703 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:12.695+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:12.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:12.895+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:13.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:13.033+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:13.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:13.183+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:13.393 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:13.386+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:13.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:13.545+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:13.603 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:13.596+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:13.749 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:13.741+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:13.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:13.915+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:14.030 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:14.022+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:14.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:14.235+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:14.418 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:14.411+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:14.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:14.510+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:14.584 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:14.576+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:14.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:14.753+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:14.933 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:14.925+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:15.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:15.049+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:15.269 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:15.259+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:15.433 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:15.416+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:15.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:15.520+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:15.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:15.609+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:15.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:15.741+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:15.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:15.916+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:16.058 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:16.051+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:16.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:16.296+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:16.438 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:16.430+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:16.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:16.554+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:16.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:16.627+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:16.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:16.702+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:16.959 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:16.948+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:17.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:17.070+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:17.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:17.333+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:17.405 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:17.396+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:17.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:17.545+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:17.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:17.631+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:17.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:17.689+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:17.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:17.988+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:18.130 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:18.123+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:18.312 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:18.305+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:18.375 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:18.367+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:18.516 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:18.508+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:18.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:18.629+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:18.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:18.676+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:18.968 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:18.961+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:19.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:19.105+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:19.283 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:19.275+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:19.405 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:19.397+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:19.503 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:19.494+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:19.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:19.593+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:19.682 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:19.674+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:20.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:19.998+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:20.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:20.122+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:20.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:20.237+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:20.382 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:20.374+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:20.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:20.531+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:20.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:20.558+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:20.651 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:20.640+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:20.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:20.981+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:21.146 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:21.138+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:21.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:21.192+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:21.421 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:21.414+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:21.501 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:21.492+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:21.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:21.516+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:21.668 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:21.660+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:22.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:08:22.016+0000 1694c700 -1 osd.2 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.823518+0000 front 2019-11-29T18:07:06.899105+0000 (oldest deadline 2019-11-29T18:07:52.667062+0000) 2019-11-29T18:08:22.122 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:08:22.115+0000 1694c700 -1 osd.1 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.611679+0000 front 2019-11-29T18:07:06.507194+0000 (oldest deadline 2019-11-29T18:07:50.404676+0000) 2019-11-29T18:08:22.154 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:22.146+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:22.375 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:08:22.367+0000 1694c700 -1 osd.3 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.469726+0000 front 2019-11-29T18:07:07.407878+0000 (oldest deadline 2019-11-29T18:07:50.178653+0000) 2019-11-29T18:08:22.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:08:22.489+0000 1694c700 -1 osd.7 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.882673+0000 front 2019-11-29T18:07:07.883872+0000 (oldest deadline 2019-11-29T18:07:52.094267+0000) 2019-11-29T18:08:22.502 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:08:22.491+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e498 v498) 2019-11-29T18:08:22.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:08:22.528+0000 1694c700 -1 osd.6 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:07.030349+0000 front 2019-11-29T18:07:07.034729+0000 (oldest deadline 2019-11-29T18:07:51.711619+0000) 2019-11-29T18:08:22.671 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:22.665+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:08:23.124 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:08:23.118+0000 1694c700 -1 osd.5 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:06.867249+0000 front 2019-11-29T18:07:06.868871+0000 (oldest deadline 2019-11-29T18:07:51.140489+0000) 2019-11-29T18:08:23.627 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:08:23.620+0000 1694c700 -1 osd.4 498 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:07:04.629555+0000 front 2019-11-29T18:07:04.493600+0000 (oldest deadline 2019-11-29T18:07:48.468113+0000) 2019-11-29T18:09:21.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:21.080+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:21.333 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:21.324+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:21.424 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:21.413+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:22.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:22.113+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:22.327 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:22.320+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:22.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:22.434+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:23.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:23.121+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:23.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:23.302+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:23.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:23.433+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:23.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:23.499+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:23.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:23.616+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:24.108 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:24.100+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:24.353 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:24.344+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:24.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:24.384+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:24.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:24.441+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:24.460 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:24.453+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:24.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:24.575+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:25.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:25.106+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:25.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:25.326+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:25.363 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:25.354+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:25.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:25.469+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:25.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:25.481+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:25.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:25.514+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:25.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:25.594+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:26.078 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:26.068+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:26.306 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:26.298+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:26.359 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:26.350+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:26.454 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:26.444+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:26.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:26.490+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:26.522 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:26.514+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:26.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:26.624+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:27.037 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:27.029+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:27.327 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:27.319+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:27.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:27.398+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:27.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:27.497+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:27.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:27.518+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:27.531 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:27.524+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:27.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:27.679+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:28.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:28.054+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:28.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:28.327+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:28.379 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:28.370+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:28.513 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:28.497+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:28.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:28.505+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:28.527 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:28.521+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:28.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:28.683+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:29.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:29.089+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:29.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:29.362+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:29.389 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:29.382+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:29.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:29.468+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:29.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:29.510+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:29.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:29.511+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:29.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:29.681+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:30.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:30.132+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:30.348 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:30.341+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:30.426 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:30.417+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:30.474 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:30.468+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:30.519 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:30.511+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:30.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:30.545+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:30.647 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:30.638+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:31.188 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:31.179+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:31.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:31.374+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:31.422 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:31.414+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:31.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:31.518+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:31.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:31.552+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:31.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:31.578+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:31.663 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:31.649+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:32.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:32.219+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:32.415 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:32.407+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:32.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:32.412+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:32.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:32.475+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:32.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:32.575+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:32.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:32.576+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:32.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:32.628+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:33.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:33.194+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:33.452 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:33.443+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:33.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:33.464+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:33.474 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:33.467+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:33.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:33.542+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:33.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:33.554+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:33.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:33.575+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:33.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:33.680+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:34.222 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:34.215+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:34.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:34.480+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:34.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:34.488+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:34.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:34.493+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:34.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:34.537+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:34.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:34.538+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:34.617 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:34.610+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:34.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:34.641+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:35.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:35.247+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:35.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:35.463+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:35.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:35.510+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:35.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:35.511+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:35.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:35.511+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:35.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:35.516+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:35.621 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:35.611+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:35.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:35.650+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:36.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:36.208+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:36.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:36.462+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:36.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:36.485+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:36.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:36.498+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:36.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:36.501+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:36.532 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:36.525+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:36.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:36.568+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:36.694 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:36.688+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:37.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:37.192+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:37.454 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:37.447+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:37.492 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:37.485+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:37.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:37.509+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:37.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:37.511+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:37.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:37.549+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:37.588 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:37.581+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:37.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:37.721+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:38.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:38.179+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:38.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:38.456+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:38.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:38.472+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:38.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:38.546+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:38.557 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:38.551+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:38.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:38.579+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:38.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:38.626+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:38.701 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:38.677+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:39.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:39.135+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:39.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:39.464+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:39.506 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:39.498+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:39.567 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:39.555+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:39.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:39.557+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:39.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:39.598+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:39.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:39.639+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:39.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:39.673+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:40.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:40.160+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:40.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:40.483+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:40.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:40.516+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:40.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:40.602+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:40.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:40.606+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:40.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:40.646+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:40.656 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:40.648+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:40.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:40.683+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:41.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:41.134+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:41.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:41.470+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:41.545 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:41.536+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:41.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:41.564+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:41.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:41.565+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:41.644 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:41.637+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:41.702 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:41.695+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:41.717 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:41.710+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:42.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:42.162+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:42.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:42.508+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:42.530 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:42.519+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:42.574 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:42.565+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:42.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:42.568+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:42.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:42.690+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:42.712 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:42.705+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:42.723 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:42.716+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:43.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:43.191+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:43.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:43.535+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:43.567 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:43.560+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:43.608 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:43.598+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:43.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:43.602+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:43.700 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:43.692+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:43.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:43.736+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:43.744 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:43.737+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:44.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:44.182+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:44.588 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:44.581+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:44.617 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:44.610+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:44.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:44.639+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:44.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:44.640+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:44.666 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:44.656+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:44.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:44.748+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:44.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:44.776+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:45.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:45.209+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:45.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:45.592+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:45.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:45.644+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:45.667 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:45.660+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:45.668 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:45.662+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:45.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:45.674+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:45.762 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:45.754+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:45.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:45.796+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:46.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:46.230+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:46.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:46.637+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:46.649 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:46.643+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:46.652 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:46.646+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:46.695 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:46.686+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:46.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:46.688+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:46.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:46.776+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:46.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:46.811+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:47.222 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:47.215+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:47.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:47.613+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:47.668 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:47.661+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:47.668 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:47.661+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:47.669 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:47.662+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:47.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:47.722+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:47.784 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:47.778+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:47.828 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:47.821+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:48.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:48.172+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:48.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:48.584+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:48.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:48.647+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:48.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:48.649+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:48.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:48.675+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:48.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:48.719+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:48.761 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:48.754+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:48.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:48.812+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:49.203 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:49.196+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:49.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:49.551+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:49.668 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:49.660+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:49.669 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:49.663+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:49.676 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:49.668+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:49.741 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:49.734+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:49.743 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:49.735+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:49.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:49.858+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:50.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:50.167+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:50.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:50.536+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:50.650 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:50.643+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:50.651 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:50.645+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:50.699 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:50.692+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:50.711 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:50.703+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:50.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:50.703+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:50.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:50.846+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:51.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:51.169+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:51.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:51.502+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:51.651 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:51.643+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:51.652 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:51.645+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:51.710 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:51.702+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:51.720 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:51.713+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:51.764 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:51.755+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:51.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:51.883+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:52.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:52.199+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:52.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:52.515+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:52.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:52.687+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:52.698 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:52.691+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:52.699 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:52.693+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:52.738 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:52.731+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:52.797 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:52.780+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:52.852 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:09:52.846+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e506 v506) 2019-11-29T18:09:52.927 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:52.920+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:53.193 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:53.185+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:53.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:53.550+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:53.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:53.674+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:53.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:53.721+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:53.730 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:53.724+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:53.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:53.736+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:53.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:53.819+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:53.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:53.888+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:54.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:54.169+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:54.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:54.601+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:54.696 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:54.686+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:54.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:54.733+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:54.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:54.735+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:54.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:54.790+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:54.825 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:54.819+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:54.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:54.931+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:55.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:55.194+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:55.636 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:55.628+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:55.728 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:55.721+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:55.732 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:55.726+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:55.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:55.729+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:55.777 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:55.769+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:55.862 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:55.855+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:55.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:55.974+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:56.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:56.154+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:56.634 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:56.627+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:56.718 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:56.710+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:56.734 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:56.727+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:56.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:56.731+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:56.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:56.761+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:56.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:56.890+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:56.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:56.968+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:57.165 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:57.158+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:57.607 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:57.600+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:57.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:57.730+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:57.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:57.745+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:57.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:57.748+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:57.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:57.754+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:57.868 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:57.860+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:57.872 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:09:57.865+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e506 v506) 2019-11-29T18:09:57.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:57.967+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:58.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:58.203+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:58.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:58.593+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:58.703 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:58.695+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:58.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:58.722+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:58.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:58.777+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:58.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:58.782+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:58.835 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:58.824+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:09:59.020 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:09:59.012+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:09:59.199 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:09:59.193+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:09:59.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:09:59.584+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:09:59.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:09:59.673+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:09:59.765 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:09:59.758+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:09:59.840 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:59.831+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:09:59.841 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:09:59.834+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:09:59.860 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:09:59.853+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:00.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:00.043+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:00.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:00.242+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:00.578 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:00.572+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:00.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:00.663+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:00.753 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:00.744+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:00.854 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:00.847+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:00.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:00.848+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:00.860 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:00.854+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:01.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:01.024+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:01.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:01.262+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:01.626 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:01.618+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:01.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:01.649+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:01.781 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:01.771+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:01.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:01.812+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:01.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:01.887+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:01.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:01.892+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:02.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:02.008+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:02.278 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:02.261+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:02.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:02.626+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:02.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:02.638+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:02.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:02.807+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:02.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:02.818+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:02.889 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:10:02.881+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e506 v506) 2019-11-29T18:10:02.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:02.886+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:02.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:02.887+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:03.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:03.000+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:03.266 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:03.258+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:03.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:03.618+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:03.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:03.660+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:03.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:03.762+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:03.806 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:03.798+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:03.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:03.904+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:03.913 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:03.906+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:04.038 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:04.030+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:04.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:04.266+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:04.580 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:04.573+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:04.698 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:04.690+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:04.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:04.780+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:04.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:04.804+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:04.965 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:04.957+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:04.965 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:04.959+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:04.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:04.988+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:05.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:05.230+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:05.561 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:05.554+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:05.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:05.692+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:05.784 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:05.776+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:05.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:05.785+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:05.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:05.942+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:05.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:05.945+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:05.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:05.987+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:06.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:06.278+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:06.565 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:06.558+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:06.745 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:06.728+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:06.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:06.775+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:06.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:06.836+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:06.910 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:06.903+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:06.911 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:06.906+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:07.044 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:07.037+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:07.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:07.236+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:07.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:10:07.528+0000 1694c700 -1 osd.2 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:34.603242+0000 front 2019-11-29T18:08:34.605428+0000 (oldest deadline 2019-11-29T18:09:20.399157+0000) 2019-11-29T18:10:07.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:10:07.732+0000 1694c700 -1 osd.5 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.879981+0000 front 2019-11-29T18:08:38.813549+0000 (oldest deadline 2019-11-29T18:09:23.479301+0000) 2019-11-29T18:10:07.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:10:07.761+0000 1694c700 -1 osd.1 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.767251+0000 front 2019-11-29T18:08:38.786465+0000 (oldest deadline 2019-11-29T18:09:22.705866+0000) 2019-11-29T18:10:07.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:10:07.838+0000 1694c700 -1 osd.4 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:37.548605+0000 front 2019-11-29T18:08:37.437966+0000 (oldest deadline 2019-11-29T18:09:22.652272+0000) 2019-11-29T18:10:07.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:07.945+0000 1694c700 -1 osd.0 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:08:52.659204+0000 (oldest deadline 2019-11-29T18:09:32.659204+0000) 2019-11-29T18:10:07.953 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:10:07.947+0000 1694c700 -1 osd.0 506 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e503) 2019-11-29T18:10:07.967 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:10:07.960+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e506 v506) 2019-11-29T18:10:08.011 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:10:08.004+0000 1694c700 -1 osd.6 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.502138+0000 front 2019-11-29T18:08:37.568005+0000 (oldest deadline 2019-11-29T18:09:21.007106+0000) 2019-11-29T18:10:08.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:10:08.245+0000 1694c700 -1 osd.7 506 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:08:38.750023+0000 front 2019-11-29T18:08:38.789467+0000 (oldest deadline 2019-11-29T18:09:20.985433+0000) 2019-11-29T18:10:38.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:38.268+0000 31f84700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:38.429 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:38.339+0000 35f8c700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:38.508 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:38.424+0000 31f84700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:38.590 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:38.478+0000 32785700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:38.751 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:38.723+0000 33787700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:39.022 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:39.013+0000 124ad700 -1 osd.3 511 build_incremental_map_msg missing incremental map 511 2019-11-29T18:10:40.363 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:10:40.355+0000 34f8a700 -1 osd.3 512 build_incremental_map_msg missing incremental map 511 2019-11-29T18:11:38.316 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:38.309+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:38.627 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:38.617+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:38.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:38.730+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:39.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:39.277+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:39.308 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:39.289+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:39.608 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:39.580+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:39.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:39.715+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:39.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:39.739+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:40.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:40.052+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:40.318 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:40.311+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:40.325 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:40.316+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:40.593 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:40.584+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:40.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:40.765+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:40.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:40.775+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:41.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:41.046+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:41.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:41.279+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:41.351 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:41.344+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:41.566 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:41.556+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:41.758 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:41.751+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:41.797 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:41.778+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:42.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:42.030+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:42.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:42.236+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:42.326 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:42.319+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:42.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:42.534+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:42.773 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:42.764+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:42.835 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:42.827+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:42.912 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:42.902+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:43.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:43.016+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:43.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:43.196+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:43.357 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:43.351+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:43.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:43.522+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:43.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:43.732+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:43.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:43.831+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:43.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:43.900+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:43.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:43.990+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:44.233 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:44.224+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:44.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:44.370+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:44.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:44.482+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:44.784 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:44.776+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:44.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:44.818+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:44.940 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:44.933+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:45.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:45.002+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:45.203 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:45.193+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:45.426 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:45.419+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:45.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:45.517+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:45.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:45.820+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:45.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:45.856+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:45.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:45.940+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:45.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:45.965+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:46.171 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:46.163+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:46.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:46.431+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:46.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:46.496+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:46.819 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:46.813+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:46.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:46.836+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:46.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:46.936+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:46.974 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:46.966+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:47.172 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:47.163+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:47.428 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:47.421+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:47.494 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:47.486+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:47.868 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:47.862+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:47.870 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:47.862+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:47.935 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:47.927+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:47.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:47.968+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:48.153 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:48.144+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:48.396 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:48.390+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:48.495 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:48.487+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:48.831 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:48.823+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:48.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:48.897+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:48.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:48.952+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:48.982 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:48.974+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:49.127 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:49.119+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:49.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:49.369+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:49.542 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:49.535+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:49.875 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:49.868+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:49.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:49.902+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:49.927 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:49.921+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:49.999 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:49.990+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:50.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:50.159+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:50.396 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:50.388+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:50.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:50.552+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:50.916 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:50.910+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:50.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:50.926+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:50.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:50.964+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:51.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:51.013+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:51.185 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:51.178+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:51.354 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:51.346+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:51.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:51.547+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:51.889 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:51.881+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:51.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:51.899+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:51.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:51.922+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:52.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:52.005+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:52.129 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:56:00.263 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.137 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:56:00.270 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.140 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:56:00.319 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.146 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:56:00.322 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.146 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:56:00.325 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.147 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:56:00.324 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.177 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:52.168+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:52.363 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:56:00.543 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.377 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:56:00.557 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.388 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:52.381+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:52.421 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:56:00.556 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:11:52.609 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:52.601+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:52.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:52.861+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:52.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:52.886+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:52.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:52.888+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:53.055 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:53.048+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:53.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:53.213+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:53.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:53.429+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:53.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:53.614+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:53.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:53.885+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:53.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:53.899+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:53.921 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:53.912+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:54.073 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:54.065+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:54.182 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:54.175+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:54.461 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:54.453+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:54.606 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:54.597+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:54.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:54.888+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:54.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:54.908+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:54.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:54.911+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:55.095 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:55.087+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:55.170 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:55.161+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:55.429 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:55.422+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:55.600 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:55.593+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:55.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:55.860+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:55.890 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:55.883+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:55.943 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:55.934+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:56.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:56.058+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:56.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:56.206+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:56.416 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:56.409+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:56.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:56.597+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:56.843 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:56.836+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:56.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:56.864+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:56.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:56.907+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:57.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:57.021+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:57.184 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:57.176+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:57.425 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:57.418+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:57.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:57.638+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:57.804 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:57.796+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:57.872 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:57.863+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:57.893 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:57.885+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:58.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:58.021+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:58.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:58.200+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:58.388 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:58.379+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:58.680 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:58.672+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:58.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:58.761+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:58.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:58.851+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:58.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:58.892+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:11:59.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:11:59.058+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:11:59.219 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:11:59.212+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:11:59.408 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:11:59.402+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:11:59.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:11:59.699+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:11:59.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:11:59.758+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:11:59.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:11:59.818+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:11:59.873 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:11:59.866+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:00.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:00.078+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:00.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:00.248+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:00.430 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:00.422+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:00.698 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:00.690+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:00.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:00.731+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:00.810 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:00.801+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:00.831 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:00.823+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:01.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:01.095+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:01.286 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:01.278+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:01.482 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:01.474+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:01.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:01.668+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:01.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:01.729+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:01.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:01.777+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:01.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:01.838+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:02.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:02.139+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:02.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:02.280+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:02.496 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:02.488+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:02.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:02.684+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:02.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:02.686+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:02.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:02.753+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:02.842 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:02.835+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:03.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:03.123+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:03.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:03.249+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:03.497 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:03.490+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:03.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:03.666+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:03.682 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:03.673+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:03.733 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:03.725+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:03.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:03.803+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:04.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:04.102+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:04.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:04.280+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:04.484 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:04.477+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:04.658 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:04.643+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:04.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:04.677+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:04.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:04.768+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:04.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:04.783+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:05.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:05.131+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:05.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:05.332+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:05.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:05.434+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:05.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:05.658+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:05.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:05.666+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:05.759 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:05.751+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:05.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:05.798+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:06.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:06.092+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:06.314 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:06.305+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:06.438 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:06.430+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:06.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:06.657+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:06.677 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:06.669+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:06.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:06.779+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:06.842 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:06.834+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:07.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:07.134+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:07.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:07.301+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:07.467 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:07.459+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:07.636 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:07.629+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:07.690 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:07.683+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:07.794 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:07.785+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:07.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:07.840+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:08.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:08.184+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:08.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:08.342+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:08.488 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:08.478+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:08.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:08.668+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:08.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:08.734+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:08.766 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:08.758+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:08.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:08.886+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:09.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:09.236+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:09.364 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:09.355+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:09.508 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:09.500+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:09.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:09.695+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:09.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:09.716+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:09.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:09.777+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:09.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:09.865+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:10.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:10.191+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:10.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:10.377+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:10.488 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:10.481+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:10.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:10.700+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:10.738 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:10.730+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:10.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:10.817+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:10.895 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:10.888+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:11.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:11.237+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:11.360 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:11.351+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:11.444 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:11.437+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:11.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:11.696+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:11.720 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:11.712+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:11.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:11.831+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:11.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:11.859+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:12.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:12.198+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:12.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:12.403+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:12.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:12.487+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:12.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:12.677+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:12.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:12:12.730+0000 1694c700 -1 osd.6 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.269421+0000 front 2019-11-29T18:10:55.250757+0000 (oldest deadline 2019-11-29T18:11:38.125489+0000) 2019-11-29T18:12:12.879 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:12:12.872+0000 1694c700 -1 osd.2 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:52.717169+0000 front 2019-11-29T18:10:52.732892+0000 (oldest deadline 2019-11-29T18:11:38.401007+0000) 2019-11-29T18:12:12.879 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:12.872+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:13.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:13.194+0000 1694c700 -1 osd.7 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.382624+0000 front 2019-11-29T18:10:57.295103+0000 (oldest deadline 2019-11-29T18:11:41.937546+0000) 2019-11-29T18:12:13.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:12:13.453+0000 1694c700 -1 osd.4 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:54.156663+0000 front 2019-11-29T18:10:54.433815+0000 (oldest deadline 2019-11-29T18:11:38.185921+0000) 2019-11-29T18:12:13.501 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:12:13.490+0000 1694c700 -1 osd.3 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:57.578065+0000 front 2019-11-29T18:10:57.607045+0000 (oldest deadline 2019-11-29T18:11:38.653218+0000) 2019-11-29T18:12:13.522 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:12:13.509+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e512 v512) 2019-11-29T18:12:13.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:12:13.726+0000 1694c700 -1 osd.1 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:55.059165+0000 front 2019-11-29T18:10:55.181471+0000 (oldest deadline 2019-11-29T18:11:39.143111+0000) 2019-11-29T18:12:13.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:12:13.905+0000 1694c700 -1 osd.5 512 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:10:53.761590+0000 front 2019-11-29T18:10:53.823233+0000 (oldest deadline 2019-11-29T18:11:39.641893+0000) 2019-11-29T18:12:47.431 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:12:47.426+0000 114ab700 -1 osd.7 516 build_incremental_map_msg missing incremental map 516 2019-11-29T18:13:11.950 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:11.940+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:12.191 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:12.182+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:12.886 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:12.878+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:12.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:12.903+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:13.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:13.197+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:13.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:13.226+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:13.890 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:13.882+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:13.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:13.918+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:14.212 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:14.203+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:14.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:14.219+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:14.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:14.763+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:14.901 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:14.893+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:14.927 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:14.921+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:15.175 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:15.166+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:15.228 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:15.221+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:15.813 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:15.802+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:15.860 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:15.852+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:15.927 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:15.918+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:16.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:16.124+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:16.223 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:16.216+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:16.785 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:16.777+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:16.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:16.836+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:16.913 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:16.905+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:16.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:16.965+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:17.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:17.083+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:17.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:17.207+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:17.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:17.770+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:17.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:17.847+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:17.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:17.922+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:17.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:17.945+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:18.071 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:18.064+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:18.087 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:18.079+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:18.257 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:18.250+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:18.790 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:18.782+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:18.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:18.841+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:18.905 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:18.898+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:18.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:18.939+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:19.053 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:19.046+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:19.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:19.132+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:19.293 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:19.282+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:19.816 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:19.809+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:19.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:19.854+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:19.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:19.886+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:19.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:19.941+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:20.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:20.026+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:20.178 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:20.171+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:20.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:20.325+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:20.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:20.856+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:20.880 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:20.873+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:20.943 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:20.936+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:20.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:20.960+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:21.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:21.057+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:21.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:21.177+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:21.373 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:21.366+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:21.832 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:21.824+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:21.836 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:21.829+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:21.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:21.931+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:21.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:21.977+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:22.046 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:22.038+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:22.217 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:22.199+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:22.354 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:22.345+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:22.826 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:22.819+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:22.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:22.873+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:22.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:22.908+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:22.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:22.950+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:23.066 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:23.060+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:23.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:23.224+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:23.373 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:23.366+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:23.832 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:23.824+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:23.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:23.920+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:23.968 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:23.961+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:23.998 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:23.991+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:24.107 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:24.101+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:24.246 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:24.238+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:24.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:24.415+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:24.794 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:24.787+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:24.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:24.923+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:24.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:24.955+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:25.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:25.000+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:25.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:25.056+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:25.063 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:25.057+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:25.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:25.203+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:25.477 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:25.467+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:25.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:25.814+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:25.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:25.929+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:25.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:25.979+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:25.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:25.987+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:26.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:26.011+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:26.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:26.013+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:26.261 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:26.254+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:26.505 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:26.497+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:26.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:26.791+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:26.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:26.949+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:26.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:26.985+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:26.994 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:26.987+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:26.997 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:26.990+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:27.020 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:27.012+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:27.241 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:27.234+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:27.553 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:27.546+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:27.769 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:27.761+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:27.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:27.949+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:28.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:28.009+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:28.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:28.011+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:28.025 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:28.017+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:28.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:28.043+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:28.244 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:28.236+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:28.561 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:28.553+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:28.753 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:28.745+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:28.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:28.966+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:29.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:29.030+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:29.041 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:29.035+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:29.059 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:29.050+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:29.081 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:29.070+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:29.214 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:29.205+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:29.523 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:29.516+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:29.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:29.744+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:29.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:29.934+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:30.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:30.035+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:30.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:30.053+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:30.093 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:30.085+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:30.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:30.087+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:30.237 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:30.227+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:30.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:30.492+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:30.758 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:30.750+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:30.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:30.930+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:31.008 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:31.001+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:31.077 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:31.070+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:31.128 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:31.122+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:31.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:31.123+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:31.277 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:31.269+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:31.544 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:31.535+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:31.783 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:31.773+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:31.995 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:31.985+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:32.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:32.024+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:32.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:32.113+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:32.175 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:32.168+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:32.183 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:32.172+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:32.259 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:32.252+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:32.501 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:32.493+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:32.797 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:32.780+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:33.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:33.013+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:33.055 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:33.049+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:33.104 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:33.097+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:33.205 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:33.197+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:33.206 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:33.199+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:33.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:13:33.243+0000 1694c700 -1 osd.6 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:25.775468+0000 front 2019-11-29T18:12:25.762251+0000 (oldest deadline 2019-11-29T18:13:11.639530+0000) 2019-11-29T18:13:33.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:33.475+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:33.769 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:33.760+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:34.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:34.041+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:34.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:34.061+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:34.077 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:34.070+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:34.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:34.250+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:34.258 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:34.253+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:34.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:34.499+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:34.748 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:34.739+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:35.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:35.027+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:35.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:35.065+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:35.097 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:35.090+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:35.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:35.266+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:35.278 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:35.268+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:35.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:35.550+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:35.762 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:35.754+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:36.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:36.045+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:36.059 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:36.051+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:36.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:36.103+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:36.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:36.313+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:36.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:36.315+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:36.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:36.591+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:36.756 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:36.749+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:37.094 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:37.087+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:37.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:37.087+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:37.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:37.091+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:37.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:37.345+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:37.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:37.347+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:37.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:37.581+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:37.785 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:37.778+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:38.064 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:38.049+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:38.075 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:38.068+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:38.084 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:38.076+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:38.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:38.382+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:38.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:38.383+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:38.599 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:38.593+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:38.753 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:38.745+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:39.025 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:39.018+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:39.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:39.059+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:39.118 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:39.111+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:39.398 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:39.390+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:39.399 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:39.392+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:39.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:39.571+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:39.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:39.799+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:40.011 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:40.004+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:40.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:40.014+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:40.125 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:40.118+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:40.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:40.402+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:40.411 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:40.404+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:40.541 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:40.533+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:40.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:40.813+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:40.976 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:40.969+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:40.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:40.976+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:41.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:41.146+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:41.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:41.441+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:41.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:41.443+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:41.526 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:41.518+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:41.873 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:41.865+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:41.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:41.933+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:42.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:42.024+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:42.155 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:42.147+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:42.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:42.422+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:42.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:42.424+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:42.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:42.510+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:42.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:42.825+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:42.898 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:42.892+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:42.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:42.984+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:43.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:43.166+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:43.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:43.379+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:43.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:43.383+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:43.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:43.493+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:43.822 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:13:43.809+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e518 v518) 2019-11-29T18:13:43.884 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:43.874+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:43.948 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:43.941+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:43.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:43.951+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:44.216 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:44.209+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:44.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:44.426+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:44.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:44.428+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:44.503 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:44.495+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:44.916 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:44.909+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:44.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:44.941+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:44.987 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:44.979+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:45.170 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:45.163+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:45.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:45.437+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:45.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:45.439+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:45.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:45.455+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:45.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:45.897+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:45.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:45.959+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:46.037 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:46.027+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:46.201 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:46.193+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:46.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:46.485+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:46.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:46.488+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:46.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:46.504+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:46.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:46.861+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:47.014 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:46.993+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:47.026 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:47.018+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:47.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:47.240+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:47.551 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:47.534+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:47.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:47.537+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:47.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:47.541+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:47.851 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:47.842+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:48.011 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:48.003+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:48.031 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:48.012+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:48.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:48.194+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:48.543 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:48.534+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:48.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:48.540+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:48.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:48.542+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:48.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:48.897+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:48.926 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:13:48.917+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e518 v518) 2019-11-29T18:13:48.994 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:48.982+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:49.020 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:49.006+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:49.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:49.169+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:49.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:49.503+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:49.512 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:49.505+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:49.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:49.573+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:49.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:49.935+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:49.965 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:49.957+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:50.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:50.050+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:50.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:50.163+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:50.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:50.480+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:50.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:50.483+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:50.549 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:50.542+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:50.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:50.912+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:50.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:50.948+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:51.027 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:51.019+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:51.196 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:51.189+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:51.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:51.484+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:51.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:51.486+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:51.602 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:51.593+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:51.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:51.916+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:51.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:51.941+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:52.032 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:52.024+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:52.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:52.171+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:52.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:52.518+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:52.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:52.522+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:52.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:52.632+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:52.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:52.925+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:52.950 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:52.928+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:53.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:53.071+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:53.142 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:53.135+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:53.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:53.506+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:53.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:53.506+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:53.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:53.640+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:53.945 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:13:53.935+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e518 v518) 2019-11-29T18:13:53.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:53.955+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:53.988 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:53.980+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:54.109 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:54.100+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:54.123 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:54.114+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:54.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:54.483+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:54.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:54.485+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:54.614 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:54.608+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:54.943 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:54.935+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:54.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:54.990+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:55.089 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:55.082+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:55.129 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:55.121+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:55.539 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:55.532+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:55.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:55.533+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:55.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:55.563+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:55.981 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:55.973+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:55.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:55.983+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:56.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:56.059+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:56.150 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:56.142+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:56.559 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:56.551+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:56.569 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:56.562+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:56.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:56.565+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:56.994 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:56.986+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:57.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:57.026+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:57.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:57.063+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:57.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:57.194+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:57.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:57.533+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:57.608 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:57.601+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:57.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:57.606+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:58.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:58.032+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:58.043 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:58.027+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:58.110 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:58.101+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:58.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:58.245+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:58.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:13:58.533+0000 1694c700 -1 osd.2 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:28.568303+0000 front 2019-11-29T18:12:28.626830+0000 (oldest deadline 2019-11-29T18:13:12.631242+0000) 2019-11-29T18:13:58.650 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:58.644+0000 1694c700 -1 osd.0 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:12:44.253012+0000 (oldest deadline 2019-11-29T18:13:24.253012+0000) 2019-11-29T18:13:58.653 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:58.647+0000 1694c700 -1 osd.0 518 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:13:59.028 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:13:59.013+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e518 v518) 2019-11-29T18:13:59.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:13:59.036+0000 1694c700 -1 osd.1 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.866448+0000 front 2019-11-29T18:12:31.005223+0000 (oldest deadline 2019-11-29T18:13:11.351171+0000) 2019-11-29T18:13:59.049 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:13:59.042+0000 1694c700 -1 osd.7 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.337094+0000 front 2019-11-29T18:12:30.324521+0000 (oldest deadline 2019-11-29T18:13:12.008774+0000) 2019-11-29T18:13:59.149 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:13:59.142+0000 1694c700 -1 osd.4 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.384599+0000 front 2019-11-29T18:12:30.509266+0000 (oldest deadline 2019-11-29T18:13:13.836473+0000) 2019-11-29T18:13:59.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:13:59.278+0000 1694c700 -1 osd.5 518 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:12:30.947666+0000 front 2019-11-29T18:12:30.914654+0000 (oldest deadline 2019-11-29T18:13:16.795605+0000) 2019-11-29T18:13:59.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:13:59.693+0000 1694c700 -1 osd.0 519 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e516) 2019-11-29T18:15:19.566 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:27.700 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.570 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:27.705 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.613 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:27.792 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.614 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:27.794 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.620 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:27.799 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.624 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:27.803 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.785 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:27.965 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.834 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:27.969 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:19.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:28.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:25.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:25.566+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:26.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:26.157+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:26.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:26.586+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:26.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:26.590+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:26.651 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:26.644+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:27.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:27.168+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:27.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:27.560+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:27.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:27.582+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:27.632 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:27.622+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:27.704 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:27.697+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:28.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:28.134+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:28.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:28.462+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:28.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:28.518+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:28.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:28.626+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:28.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:28.662+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:28.697 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:28.689+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:29.102 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:29.092+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:29.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:29.409+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:29.483 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:29.474+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:29.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:29.537+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:29.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:29.584+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:29.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:29.638+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:29.659 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:29.653+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:30.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:30.063+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:30.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:30.389+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:30.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:30.452+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:30.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:30.527+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:30.602 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:30.594+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:30.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:30.609+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:30.673 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:30.666+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:31.098 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:31.089+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:31.380 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:31.372+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:31.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:31.412+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:31.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:31.552+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:31.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:31.562+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:31.642 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:31.636+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:31.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:31.642+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:32.058 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:32.049+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:32.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:32.358+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:32.444 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:32.435+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:32.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:32.560+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:32.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:32.578+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:32.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:32.608+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:32.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:32.679+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:33.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:33.037+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:33.396 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:33.387+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:33.483 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:33.475+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:33.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:33.520+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:33.595 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:33.587+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:33.665 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:33.657+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:33.682 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:33.668+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:34.072 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:34.063+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:34.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:34.439+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:34.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:34.453+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:34.569 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:34.562+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:34.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:34.609+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:34.638 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:34.631+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:34.666 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:34.660+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:35.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:35.102+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:35.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:35.451+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:35.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:35.482+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:35.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:35.525+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:35.585 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:35.578+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:35.642 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:35.636+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:35.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:35.678+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:36.073 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:36.066+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:36.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:36.437+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:36.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:36.514+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:36.564 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:36.556+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:36.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:36.573+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:36.606 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:36.598+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:36.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:36.704+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:37.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:37.064+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:37.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:37.481+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:37.564 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:37.557+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:37.568 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:37.561+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:37.575 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:37.566+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:37.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:37.606+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:37.668 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:37.660+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:38.042 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:38.034+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:38.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:38.472+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:38.546 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:38.539+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:38.581 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:38.573+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:38.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:38.595+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:38.614 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:38.603+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:38.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:38.708+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:39.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:39.088+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:39.462 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:39.454+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:39.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:39.508+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:39.610 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:39.603+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:39.617 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:39.610+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:39.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:39.618+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:39.699 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:39.693+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:40.098 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:40.090+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:40.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:40.464+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:40.556 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:40.548+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:40.577 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:40.569+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:40.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:40.641+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:40.664 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:40.657+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:40.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:40.682+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:41.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:41.140+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:41.453 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:41.445+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:41.563 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:41.555+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:41.576 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:41.567+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:41.623 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:41.616+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:41.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:41.657+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:41.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:41.684+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:42.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:42.156+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:42.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:42.407+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:42.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:42.575+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:42.584 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:42.576+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:42.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:42.601+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:42.668 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:42.661+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:42.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:42.683+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:43.206 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:43.199+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:43.457 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:43.449+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:43.562 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:43.554+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:43.576 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:43.569+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:43.647 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:43.639+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:43.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:43.644+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:43.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:43.649+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:44.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:44.224+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:44.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:44.461+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:44.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:44.564+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:44.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:44.571+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:44.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:44.642+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:44.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:44.649+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:44.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:44.686+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:44.792 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:52.926 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.819 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:52.998 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.820 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:53.000 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.822 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:52.957 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.824 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:53.004 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.825 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:53.004 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.866 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:06:59:53.046 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.891 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:06:59:53.070 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:44.902 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:06:59:53.036 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:15:45.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:45.232+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:45.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:45.444+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:45.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:45.547+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:45.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:45.594+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:45.641 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:45.631+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:45.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:45.640+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:45.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:45.738+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:46.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:46.218+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:46.454 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:46.445+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:46.588 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:46.581+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:46.608 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:46.600+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:46.628 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:46.620+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:46.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:46.664+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:46.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:46.706+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:47.221 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:47.214+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:47.489 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:47.480+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:47.606 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:47.598+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:47.608 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:47.600+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:47.621 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:47.614+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:47.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:47.662+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:47.686 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:47.677+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:48.196 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:48.188+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:48.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:48.489+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:48.640 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:48.633+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:48.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:48.645+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:48.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:48.652+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:48.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:48.676+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:48.735 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:48.728+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:49.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:49.205+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:49.485 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:49.477+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:49.644 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:49.637+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:49.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:49.646+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:49.665 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:49.657+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:49.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:49.671+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:49.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:49.715+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:50.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:50.201+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:50.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:50.504+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:50.621 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:50.613+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:50.653 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:50.646+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:50.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:50.686+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:50.700 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:50.691+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:50.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:50.710+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:51.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:51.202+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:51.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:51.509+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:51.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:51.587+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:51.630 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:51.623+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:51.727 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:51.704+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:51.727 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:51.703+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:51.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:51.762+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:52.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:52.231+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:52.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:52.521+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:52.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:52.593+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:52.661 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:52.654+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:52.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:52.679+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:52.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:52.726+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:52.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:52.753+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:53.236 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:53.230+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:53.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:53.562+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:53.570 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:53.563+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:53.632 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:53.623+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:53.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:53.698+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:53.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:53.724+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:53.807 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:53.799+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:54.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:54.230+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:54.561 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:54.551+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:54.581 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:54.574+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:54.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:54.593+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:54.659 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:54.653+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:54.782 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:54.774+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:54.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:54.852+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:55.242 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:55.232+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:55.521 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:55.513+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:55.559 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:55.551+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:55.597 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:55.589+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:55.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:55.653+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:55.767 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:55.760+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:55.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:55.894+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:56.222 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:56.214+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:56.497 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:56.489+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:56.612 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:56.604+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:56.648 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:56.640+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:56.665 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:56.657+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:56.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:56.766+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:56.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:56.922+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:57.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:57.205+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:57.548 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:57.540+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:57.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:57.578+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:57.622 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:57.614+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:57.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:57.643+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:57.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:57.812+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:57.956 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:57.948+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:58.180 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:58.172+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:58.511 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:58.503+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:58.627 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:58.618+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:58.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:58.649+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:58.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:58.666+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:58.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:58.784+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:58.936 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:58.929+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:15:59.165 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:15:59.158+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:15:59.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:15:59.534+0000 1694c700 -1 osd.5 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.151755+0000 front 2019-11-29T18:14:41.177877+0000 (oldest deadline 2019-11-29T18:15:26.306129+0000) 2019-11-29T18:15:59.619 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:15:59.613+0000 1694c700 -1 osd.3 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:41.164781+0000 front 2019-11-29T18:14:41.403664+0000 (oldest deadline 2019-11-29T18:15:26.376437+0000) 2019-11-29T18:15:59.652 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:15:59.644+0000 1694c700 -1 osd.6 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.067342+0000 front 2019-11-29T18:14:42.727650+0000 (oldest deadline 2019-11-29T18:15:28.586352+0000) 2019-11-29T18:15:59.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:15:59.688+0000 1694c700 -1 osd.1 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.911526+0000 front 2019-11-29T18:14:44.059190+0000 (oldest deadline 2019-11-29T18:15:25.548561+0000) 2019-11-29T18:15:59.725 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:15:59.708+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e524 v524) 2019-11-29T18:15:59.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:15:59.799+0000 1694c700 -1 osd.2 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.363377+0000 front 2019-11-29T18:14:43.495552+0000 (oldest deadline 2019-11-29T18:15:26.836282+0000) 2019-11-29T18:15:59.929 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:15:59.923+0000 1694c700 -1 osd.4 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:43.926321+0000 front 2019-11-29T18:14:43.928152+0000 (oldest deadline 2019-11-29T18:15:28.174218+0000) 2019-11-29T18:16:00.123 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:16:00.116+0000 1694c700 -1 osd.7 524 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:14:40.123660+0000 front 2019-11-29T18:14:40.322397+0000 (oldest deadline 2019-11-29T18:15:25.834625+0000) 2019-11-29T18:16:31.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:16:31.509+0000 33787700 -1 osd.7 529 build_incremental_map_msg missing incremental map 528 2019-11-29T18:16:31.535 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:16:31.517+0000 31f84700 -1 osd.7 529 build_incremental_map_msg missing incremental map 528 2019-11-29T18:16:58.084 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:16:58.074+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:16:58.437 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:16:58.430+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:16:59.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:16:59.044+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:16:59.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:16:59.084+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:16:59.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:16:59.409+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:00.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:00.017+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:00.114 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:00.108+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:00.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:00.247+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:00.455 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:00.447+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:01.023 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:01.015+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:01.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:01.072+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:01.217 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:01.210+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:01.242 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:01.235+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:01.469 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:01.460+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:01.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:01.696+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:01.939 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:01.933+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:02.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:02.005+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:02.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:02.036+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:02.180 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:02.170+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:02.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:02.191+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:02.447 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:02.439+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:02.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:02.677+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:02.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:02.936+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:03.010 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:03.002+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:03.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:03.026+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:03.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:03.161+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:03.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:03.195+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:03.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:03.436+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:03.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:03.711+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:03.908 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:03.901+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:03.996 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:03.989+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:04.016 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:04.008+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:04.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:04.155+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:04.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:04.188+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:04.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:04.436+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:04.751 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:04.744+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:04.913 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:04.898+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:05.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:05.011+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:05.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:05.059+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:05.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:05.153+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:05.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:05.206+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:05.424 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:05.417+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:05.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:05.728+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:05.934 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:05.928+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:05.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:05.977+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:06.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:06.039+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:06.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:06.181+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:06.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:06.206+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:06.394 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:06.386+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:06.745 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:06.738+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:06.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:06.931+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:06.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:06.951+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:07.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:07.057+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:07.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:07.221+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:07.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:07.238+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:07.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:07.422+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:07.757 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:07.749+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:07.972 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:07.965+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:07.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:07.968+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:08.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:08.016+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:08.233 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:08.225+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:08.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:08.254+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:08.433 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:08.426+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:08.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:08.750+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:08.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:08.951+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:08.971 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:08.965+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:08.974 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:08.968+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:09.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:09.026+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:09.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:09.212+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:09.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:09.231+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:09.454 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:09.446+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:09.738 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:09.731+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:09.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:09.939+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:09.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:09.990+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:10.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:10.017+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:10.025 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:10.019+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:10.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:10.264+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:10.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:10.264+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:10.470 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:10.463+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:10.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:10.753+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:10.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:10.956+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:10.981 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:10.972+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:10.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:10.976+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:11.039 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:11.031+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:11.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:11.222+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:11.322 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:11.315+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:11.474 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:11.465+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:11.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:11.743+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:11.987 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:11.975+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:12.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:12.009+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:12.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:12.011+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:12.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:12.048+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:12.251 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:12.244+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:12.312 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:12.305+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:12.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:12.513+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:12.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:12.742+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:12.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:12.962+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:12.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:12.976+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:12.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:12.977+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:13.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:13.051+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:13.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:13.267+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:13.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:13.334+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:13.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:13.516+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:13.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:13.755+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:13.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:13.945+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:13.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:13.946+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:13.988 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:13.979+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:14.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:14.037+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:14.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:14.293+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:14.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:14.371+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:14.510 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:14.503+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:14.740 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:14.732+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:14.970 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:14.961+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:14.970 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:14.964+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:15.018 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:15.012+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:15.019 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:15.012+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:15.346 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:15.336+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:15.348 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:15.342+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:15.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:15.477+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:15.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:15.760+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:15.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:15.971+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:16.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:16.001+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:16.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:16.006+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:16.015 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:16.008+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:16.338 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:16.330+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:16.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:16.343+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:16.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:16.528+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:16.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:16.747+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:16.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:16.928+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:17.006 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:16.999+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:17.035 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:17.029+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:17.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:17.033+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:17.328 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:17.320+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:17.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:17.346+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:17.573 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:17.565+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:17.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:17.797+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:17.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:17.955+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:17.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:17.993+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:18.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:18.009+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:18.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:18.011+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:18.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:18.366+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:18.399 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:18.393+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:18.551 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:18.544+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:18.813 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:18.806+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:18.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:18.946+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:18.958 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:18.951+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:19.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:19.053+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:19.065 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:19.055+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:19.390 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:19.382+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:19.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:19.388+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:19.532 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:19.525+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:19.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:19.848+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:19.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:19.976+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:19.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:19.983+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:20.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:20.019+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:20.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:20.021+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:20.368 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:20.361+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:20.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:20.407+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:20.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:20.575+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:20.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:20.823+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:20.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:20.979+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:21.007 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:21.001+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:21.009 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:21.003+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:21.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:21.011+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:21.367 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:21.360+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:21.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:21.372+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:21.603 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:21.597+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:21.852 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:21.845+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:22.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:21.993+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:22.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:21.997+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:22.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:22.002+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:22.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:22.031+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:22.371 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:22.364+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:22.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:22.399+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:22.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:22.631+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:22.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:22.877+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:22.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:22.986+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:22.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:22.987+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:23.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:23.045+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:23.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:23.099+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:23.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:23.373+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:23.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:23.420+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:23.692 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:23.684+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:23.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:23.869+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:24.009 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:24.000+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:24.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:24.002+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:24.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:24.092+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:24.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:24.100+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:24.399 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:24.387+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:24.418 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:24.412+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:24.669 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:24.662+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:24.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:24.896+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:25.040 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:25.031+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:25.041 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:25.033+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:25.106 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:25.098+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:25.140 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:25.132+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:25.361 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:25.354+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:25.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:25.439+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:25.631 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:25.623+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:25.901 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:25.893+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:26.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:26.083+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:26.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:26.087+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:26.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:26.122+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:26.143 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:26.135+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:26.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:26.346+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:26.455 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:26.448+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:26.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:26.676+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:26.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:26.862+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:27.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:27.091+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:27.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:27.124+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:27.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:27.126+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:27.169 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:27.161+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:27.361 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:27.354+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:27.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:27.408+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:27.693 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:27.686+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:27.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:27.885+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:28.106 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:28.098+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:28.124 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:28.117+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:28.126 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:28.121+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:28.162 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:28.155+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:28.392 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:28.385+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:28.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:28.395+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:28.726 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:28.720+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:28.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:28.869+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:29.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:29.095+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:29.111 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:29.097+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:29.150 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:29.143+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:29.180 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:29.173+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:29.426 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:29.418+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:29.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:29.436+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:29.735 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:29.728+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:29.900 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:29.893+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:30.146 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:17:30.132+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e529 v529) 2019-11-29T18:17:30.147 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:30.138+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:30.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:30.141+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:30.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:30.142+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:30.194 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:30.187+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:30.458 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:30.450+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:30.464 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:30.456+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:30.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:30.687+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:30.879 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:30.872+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:31.145 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:31.138+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:31.146 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:31.139+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:31.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:31.182+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:31.197 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:31.189+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:31.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:31.417+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:31.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:31.471+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:31.660 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:31.653+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:31.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:31.896+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:32.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:32.092+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:32.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:32.094+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:32.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:32.193+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:32.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:32.198+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:32.407 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:32.400+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:32.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:32.479+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:32.653 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:32.645+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:32.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:32.856+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:33.065 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:33.057+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:33.066 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:33.059+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:33.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:33.155+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:33.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:33.193+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:33.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:33.389+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:33.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:33.479+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:33.651 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:33.644+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:33.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:33.856+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:34.075 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:34.068+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:34.075 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:34.069+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:34.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:34.191+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:34.227 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:34.220+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:34.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:34.443+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:34.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:34.457+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:34.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:34.679+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:34.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:34.903+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:35.050 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:35.042+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:35.053 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:35.046+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:35.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:35.178+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:35.235 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:17:35.217+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e529 v529) 2019-11-29T18:17:35.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:35.264+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:35.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:35.404+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:35.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:35.458+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:35.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:35.717+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:35.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:35.869+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:36.066 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:36.059+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:36.067 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:36.061+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:36.172 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:36.165+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:36.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:36.244+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:36.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:36.397+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:36.453 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:36.445+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:36.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:36.696+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:36.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:36.898+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:37.053 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:37.046+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:37.054 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:37.048+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:37.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:37.212+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:37.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:37.287+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:37.379 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:37.371+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:37.470 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:37.463+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:37.678 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:37.670+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:37.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:37.901+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:38.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:38.029+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:38.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:38.033+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:38.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:38.229+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:38.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:38.243+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:38.409 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:38.401+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:38.470 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:38.461+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:38.688 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:38.679+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:38.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:38.872+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:39.056 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:39.049+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:39.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:39.050+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:39.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:39.185+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:39.261 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:39.255+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:39.384 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:39.376+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:39.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:39.441+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:39.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:39.673+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:39.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:17:39.910+0000 1694c700 -1 osd.1 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.547413+0000 front 2019-11-29T18:16:16.528995+0000 (oldest deadline 2019-11-29T18:17:01.213281+0000) 2019-11-29T18:17:40.090 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:40.082+0000 1694c700 -1 osd.0 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:16:28.531789+0000 (oldest deadline 2019-11-29T18:17:08.531789+0000) 2019-11-29T18:17:40.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:17:40.085+0000 1694c700 -1 osd.0 529 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e528) 2019-11-29T18:17:40.237 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:17:40.229+0000 1694c700 -1 osd.5 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:13.835328+0000 front 2019-11-29T18:16:13.779747+0000 (oldest deadline 2019-11-29T18:16:57.219036+0000) 2019-11-29T18:17:40.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:17:40.238+0000 1694c700 -1 osd.2 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:15.849850+0000 front 2019-11-29T18:16:15.834594+0000 (oldest deadline 2019-11-29T18:16:58.112156+0000) 2019-11-29T18:17:40.385 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:17:40.376+0000 1694c700 -1 osd.4 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:16.746835+0000 front 2019-11-29T18:16:16.741522+0000 (oldest deadline 2019-11-29T18:17:00.824880+0000) 2019-11-29T18:17:40.442 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:17:40.434+0000 1694c700 -1 osd.6 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:14.788886+0000 front 2019-11-29T18:16:14.752505+0000 (oldest deadline 2019-11-29T18:16:59.460848+0000) 2019-11-29T18:17:40.568 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:17:40.555+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e529 v529) 2019-11-29T18:17:40.717 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:17:40.709+0000 1694c700 -1 osd.7 529 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:16:12.875892+0000 front 2019-11-29T18:16:13.149076+0000 (oldest deadline 2019-11-29T18:16:57.773703+0000) 2019-11-29T18:17:40.759 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:01:48.893 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.768 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:01:48.903 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.790 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:01:48.970 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.792 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:01:48.972 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.818 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:01:48.997 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.842 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:01:49.016 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:40.901 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:01:49.035 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:41.059 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:01:49.238 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:17:41.086 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:01:49.264 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:10.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:10.265+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:11.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:11.095+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:11.284 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:11.277+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:11.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:11.891+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:12.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:12.011+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:12.069 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:12.061+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:12.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:12.310+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:12.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:12.895+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:12.985 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:12.977+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:13.085 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:13.076+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:13.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:13.288+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:13.340 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:13.332+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:13.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:13.334+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:13.919 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:13.909+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:13.947 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:13.940+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:14.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:14.124+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:14.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:14.196+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:14.281 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:14.274+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:14.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:14.295+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:14.391 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:14.383+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:14.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:14.388+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:14.901 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:14.893+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:14.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:14.971+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:15.131 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:15.121+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:15.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:15.162+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:15.233 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:15.227+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:15.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:15.309+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:15.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:15.417+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:15.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:15.420+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:15.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:15.925+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:16.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:16.010+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:16.129 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:16.117+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:16.215 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:16.208+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:16.288 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:16.280+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:16.362 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:16.354+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:16.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:16.420+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:16.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:16.424+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:16.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:16.923+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:17.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:17.018+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:17.121 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:17.111+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:17.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:17.185+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:17.298 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:17.292+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:17.388 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:17.378+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:17.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:17.458+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:17.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:17.459+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:17.895 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:17.885+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:18.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:17.999+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:18.118 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:18.109+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:18.180 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:18.174+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:18.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:18.292+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:18.397 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:18.389+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:18.499 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:18.489+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:18.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:18.492+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:18.901 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:18.892+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:19.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:18.999+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:19.103 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:19.095+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:19.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:19.177+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:19.288 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:19.282+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:19.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:19.370+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:19.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:19.467+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:19.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:19.474+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:19.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:19.943+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:20.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:20.012+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:20.109 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:20.100+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:20.196 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:20.188+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:20.258 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:20.250+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:20.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:20.381+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:20.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:20.430+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:20.460 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:20.432+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:20.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:20.977+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:20.994 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:20.986+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:21.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:21.151+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:21.201 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:21.193+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:21.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:21.293+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:21.395 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:21.387+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:21.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:21.430+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:21.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:21.433+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:21.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:21.988+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:22.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:22.004+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:22.211 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:22.204+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:22.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:22.220+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:22.356 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:22.347+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:22.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:22.397+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:22.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:22.482+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:22.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:22.485+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:22.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:22.968+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:22.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:22.969+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:23.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:23.189+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:23.256 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:23.248+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:23.345 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:23.336+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:23.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:23.397+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:23.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:23.490+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:23.499 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:23.493+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:23.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:23.925+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:23.964 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:23.956+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:24.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:24.206+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:24.251 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:24.243+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:24.329 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:24.321+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:24.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:24.369+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:24.516 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:24.507+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:24.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:24.510+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:24.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:24.888+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:24.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:24.979+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:25.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:25.216+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:25.284 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:25.278+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:25.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:25.336+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:25.356 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:25.349+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:25.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:25.471+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:25.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:25.474+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:25.910 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:25.902+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:25.971 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:25.961+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:26.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:26.205+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:26.275 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:26.268+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:26.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:26.316+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:26.368 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:26.360+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:26.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:26.499+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:26.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:26.504+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:26.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:26.865+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:27.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:26.993+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:27.178 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:27.170+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:27.272 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:27.264+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:27.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:27.295+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:27.337 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:27.330+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:27.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:27.480+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:27.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:27.484+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:27.862 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:27.855+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:27.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:27.954+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:28.207 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:28.200+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:28.321 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:28.312+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:28.327 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:28.319+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:28.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:28.326+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:28.489 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:28.480+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:28.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:28.483+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:28.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:28.825+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:28.966 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:28.959+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:29.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:29.231+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:29.308 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:29.300+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:29.354 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:29.346+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:29.358 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:29.350+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:29.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:29.499+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:29.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:29.504+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:29.875 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:29.868+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:30.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:30.000+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:30.254 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:30.244+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:30.277 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:30.269+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:30.347 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:30.339+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:30.362 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:30.355+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:30.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:30.540+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:30.550 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:30.543+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:30.847 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:30.839+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:31.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:31.032+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:31.295 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:31.288+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:31.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:31.299+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:31.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:31.332+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:31.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:31.367+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:31.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:31.544+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:31.555 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:31.549+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:31.802 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:31.793+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:32.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:32.052+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:32.304 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:32.298+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:32.335 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:32.328+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:32.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:32.335+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:32.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:32.349+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:32.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:32.549+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:32.560 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:32.555+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:32.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:32.825+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:33.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:33.054+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:33.318 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:33.311+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:33.335 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:33.327+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:33.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:33.347+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:33.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:33.385+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:33.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:33.528+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:33.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:33.531+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:33.790 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:33.782+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:34.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:34.087+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:34.308 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:34.300+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:34.347 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:34.339+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:34.351 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:34.342+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:34.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:34.378+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:34.502 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:34.494+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:34.503 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:34.496+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:34.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:34.774+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:35.112 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:35.104+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:35.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:35.294+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:35.336 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:35.329+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:35.363 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:35.356+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:35.422 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:35.414+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:35.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:35.482+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:35.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:35.486+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:35.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:35.733+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:36.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:36.142+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:36.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:36.259+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:36.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:36.353+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:36.363 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:36.356+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:36.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:36.461+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:36.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:36.490+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:36.501 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:36.495+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:36.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:36.787+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:37.201 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:37.193+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:37.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:37.265+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:37.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:37.357+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:37.416 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:37.408+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:37.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:37.419+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:37.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:37.461+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:37.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:37.464+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:37.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:37.755+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:38.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:38.181+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:38.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:38.294+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:38.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:38.371+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:38.394 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:38.387+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:38.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:38.438+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:38.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:38.448+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:38.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:38.452+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:38.798 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:38.790+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:39.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:39.228+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:39.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:39.339+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:39.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:39.386+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:39.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:39.406+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:39.416 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:39.407+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:39.437 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:39.429+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:39.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:39.432+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:39.847 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:39.839+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:40.279 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:40.271+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:40.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:40.385+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:40.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:40.384+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:40.403 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:40.395+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:40.409 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:40.402+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:40.412 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:40.406+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:40.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:40.407+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:40.893 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:40.885+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:41.318 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:41.311+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:41.373 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:41.362+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:41.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:41.365+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:41.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:41.366+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:41.381 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:41.370+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:41.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:41.432+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:41.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:41.435+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:41.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:41.928+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:42.179 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:03:50.309 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.189 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:03:50.364 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.189 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:03:50.317 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.190 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:03:50.369 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.192 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:03:50.371 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.194 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:03:50.373 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.313 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:03:50.486 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:42.301+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:42.354 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:42.347+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:42.368 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:03:50.548 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.383 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:42.375+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:42.397 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:03:50.528 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:19:42.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:42.388+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:42.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:42.392+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:42.420 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:42.412+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:42.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:42.413+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:42.921 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:42.915+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:43.262 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:43.255+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:43.337 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:43.330+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:43.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:43.347+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:43.355 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:43.348+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:43.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:43.388+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:43.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:43.409+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:43.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:43.456+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:43.962 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:43.955+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:44.280 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:44.273+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:44.334 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:44.326+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:44.335 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:44.329+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:44.377 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:44.369+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:44.420 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:44.412+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:44.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:44.418+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:44.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:44.464+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:44.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:44.949+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:45.292 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:45.286+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:45.375 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:45.367+0000 1694c700 -1 osd.6 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.663451+0000 front 2019-11-29T18:18:27.998910+0000 (oldest deadline 2019-11-29T18:19:12.940817+0000) 2019-11-29T18:19:45.378 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:45.372+0000 1694c700 -1 osd.6 535 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:45.402 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:19:45.396+0000 1694c700 -1 osd.3 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.674395+0000 front 2019-11-29T18:18:29.841843+0000 (oldest deadline 2019-11-29T18:19:14.214905+0000) 2019-11-29T18:19:45.407 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:19:45.397+0000 1694c700 -1 osd.7 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:27.137514+0000 front 2019-11-29T18:18:27.026085+0000 (oldest deadline 2019-11-29T18:19:12.778839+0000) 2019-11-29T18:19:45.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:19:45.433+0000 1694c700 -1 osd.1 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:28.238803+0000 front 2019-11-29T18:18:28.254596+0000 (oldest deadline 2019-11-29T18:19:14.047967+0000) 2019-11-29T18:19:45.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:45.461+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:46.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:19:45.996+0000 1694c700 -1 osd.5 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:25.244140+0000 front 2019-11-29T18:18:25.290134+0000 (oldest deadline 2019-11-29T18:19:11.116056+0000) 2019-11-29T18:19:46.014 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:19:46.007+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e535 v535) 2019-11-29T18:19:46.336 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:19:46.329+0000 1694c700 -1 osd.2 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.858576+0000 front 2019-11-29T18:18:29.857990+0000 (oldest deadline 2019-11-29T18:19:11.502915+0000) 2019-11-29T18:19:46.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:46.364+0000 1694c700 -1 osd.6 536 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:19:46.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:19:46.471+0000 1694c700 -1 osd.4 535 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:18:29.391930+0000 front 2019-11-29T18:18:29.674416+0000 (oldest deadline 2019-11-29T18:19:10.476840+0000) 2019-11-29T18:19:47.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:19:47.329+0000 1694c700 -1 osd.6 536 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81265 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e535) 2019-11-29T18:20:43.649 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:43.640+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:44.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:44.116+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:44.603 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:44.594+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:44.608 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:44.596+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:45.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:45.137+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:45.567 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:45.558+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:45.628 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:45.615+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:45.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:45.687+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:46.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:46.162+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:46.219 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:46.211+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:46.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:46.566+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:46.657 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:46.648+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:46.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:46.674+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:47.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:47.205+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:47.252 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:47.244+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:47.545 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:47.536+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:47.663 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:47.655+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:47.683 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:47.674+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:48.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:48.208+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:48.292 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:48.284+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:48.528 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:48.520+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:48.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:48.627+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:48.667 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:48.660+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:49.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:49.188+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:49.346 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:49.339+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:49.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:49.550+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:49.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:49.615+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:49.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:49.663+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:50.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:50.149+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:50.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:50.349+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:50.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:50.569+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:50.582 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:50.575+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:50.715 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:50.707+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:50.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:50.760+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:51.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:51.180+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:51.316 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:51.308+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:51.546 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:51.539+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:51.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:51.590+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:51.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:51.730+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:51.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:51.738+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:52.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:52.228+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:52.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:52.269+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:52.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:52.553+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:52.635 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:52.627+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:52.700 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:52.693+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:52.712 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:52.706+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:53.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:53.281+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:53.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:53.298+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:53.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:53.535+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:53.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:53.657+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:53.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:53.678+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:53.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:53.736+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:54.260 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:54.253+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:54.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:54.256+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:54.537 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:54.530+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:54.675 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:54.654+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:54.697 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:54.690+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:54.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:54.788+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:55.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:55.218+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:55.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:55.287+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:55.514 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:55.504+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:55.702 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:55.695+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:55.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:55.719+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:55.763 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:55.755+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:20:55.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:55.757+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:56.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:56.185+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:56.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:56.311+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:56.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:56.483+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:56.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:56.691+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:56.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:56.761+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:20:56.769 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:56.762+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:56.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:56.763+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:57.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:57.209+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:57.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:57.343+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:57.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:57.533+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:57.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:57.692+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:57.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:57.789+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:57.807 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:57.800+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:20:57.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:57.801+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:58.260 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:58.253+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:58.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:58.384+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:58.594 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:58.583+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:58.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:58.698+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:58.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:58.778+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:58.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:58.797+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:20:58.806 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:58.801+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:20:59.280 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:20:59.273+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:20:59.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:20:59.361+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:20:59.599 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:20:59.592+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:20:59.729 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:20:59.722+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:20:59.825 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:20:59.818+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:20:59.828 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:59.821+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:20:59.829 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:20:59.822+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:00.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:00.316+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:00.348 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:00.340+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:00.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:00.632+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:00.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:00.718+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:00.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:00.829+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:00.864 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:00.856+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:00.867 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:00.860+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:01.319 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:01.311+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:01.346 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:01.338+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:01.601 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:01.593+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:01.755 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:01.748+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:01.820 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:01.812+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:01.844 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:01.835+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:01.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:01.837+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:02.313 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:02.303+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:02.313 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:02.304+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:02.617 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:02.608+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:02.727 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:02.713+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:02.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:02.789+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:02.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:02.790+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:02.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:02.841+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:03.287 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:03.279+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:03.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:03.349+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:03.615 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:03.606+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:03.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:03.744+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:03.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:03.767+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:03.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:03.769+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:03.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:03.850+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:04.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:04.267+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:04.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:04.357+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:04.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:04.626+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:04.774 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:04.766+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:04.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:04.783+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:04.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:04.786+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:04.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:04.888+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:05.294 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:05.287+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:05.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:05.395+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:05.675 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:05.667+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:05.801 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:05.794+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:05.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:05.794+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:05.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:05.798+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:05.930 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:05.922+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:06.334 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:06.327+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:06.374 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:06.367+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:06.722 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:06.715+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:06.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:06.756+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:06.846 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:06.839+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:06.847 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:06.840+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:06.906 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:06.899+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:07.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:07.289+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:07.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:07.326+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:07.744 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:07.736+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:07.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:07.743+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:07.838 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:07.831+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:07.840 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:07.833+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:07.903 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:07.895+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:08.326 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:08.318+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:08.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:08.348+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:08.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:08.743+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:08.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:08.787+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:08.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:08.791+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:08.808 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:08.797+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:08.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:08.874+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:09.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:09.332+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:09.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:09.348+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:09.712 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:09.704+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:09.774 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:09.766+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:09.821 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:09.810+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:09.821 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:09.812+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:09.862 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:09.855+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:10.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:10.289+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:10.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:10.331+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:10.736 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:10.728+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:10.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:10.787+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:10.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:10.786+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:10.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:10.790+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:10.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:10.904+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:11.316 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:11.306+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:11.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:11.334+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:11.715 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:11.708+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:11.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:11.786+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:11.849 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:11.841+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:11.850 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:11.843+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:11.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:11.895+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:12.343 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:12.335+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:12.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:12.341+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:12.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:12.753+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:12.815 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:12.808+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:12.868 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:12.860+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:12.869 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:12.862+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:12.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:12.901+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:13.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:13.338+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:13.351 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:13.344+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:13.755 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:13.747+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:13.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:13.841+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:13.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:13.883+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:13.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:13.885+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:13.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:13.906+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:14.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:14.374+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:14.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:14.386+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:14.740 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:14.729+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:14.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:14.863+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:14.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:14.867+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:14.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:14.913+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:14.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:14.917+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:15.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:15.376+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:15.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:15.417+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:15.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:15.714+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:15.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:15.844+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:15.916 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:15.905+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:15.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:15.932+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:15.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:15.934+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:16.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:16.373+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:16.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:16.395+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:16.697 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:16.685+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:16.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:16.869+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:16.920 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:16.912+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:16.921 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:16.914+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:16.962 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:16.956+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:17.351 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:17.344+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:17.392 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:17.384+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:17.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:17.644+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:17.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:17.869+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:17.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:17.872+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:17.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:17.918+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:17.958 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:17.951+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:18.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:18.055+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:18.342 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:18.335+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:18.439 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:18.424+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:18.644 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:18.636+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:18.841 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:18.834+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:18.842 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:18.835+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:18.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:18.940+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:18.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:18.992+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:19.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:19.060+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:19.347 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:19.339+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:19.469 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:19.462+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:19.609 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:19.600+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:19.851 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:19.844+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:19.851 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:19.845+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:19.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:19.909+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:19.992 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:19.984+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:20.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:20.075+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:20.365 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:20.359+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:20.458 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:20.451+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:20.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:20.638+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:20.817 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:20.806+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:20.820 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:20.809+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:20.969 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:20.962+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:20.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:20.968+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:21.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:21.055+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:21.346 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:21.338+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:21.471 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:21:21.450+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e542 v542) 2019-11-29T18:21:21.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:21.499+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:21.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:21.683+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:21.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:21.801+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:21.814 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:21.804+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:21.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:21.948+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:22.023 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:22.016+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:22.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:22.080+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:22.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:22.366+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:22.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:22.526+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:22.669 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:22.661+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:22.776 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:22.768+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:22.777 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:22.770+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:22.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:22.978+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:23.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:23.063+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:23.126 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:23.117+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:23.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:23.396+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:23.551 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:23.544+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:23.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:23.687+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:23.749 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:23.742+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:23.752 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:23.745+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:23.965 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:23.957+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:24.103 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:24.094+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:24.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:24.124+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:24.385 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:24.377+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:24.528 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:24.520+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:24.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:24.663+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:24.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:24.780+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:24.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:24.781+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:24.953 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:24.944+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:25.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:25.117+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:25.175 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:25.166+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:25.398 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:25.389+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:25.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:25.568+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:25.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:21:25.627+0000 1694c700 -1 osd.2 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:01.840187+0000 front 2019-11-29T18:20:01.853023+0000 (oldest deadline 2019-11-29T18:20:45.204809+0000) 2019-11-29T18:21:25.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:25.734+0000 1694c700 -1 osd.0 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:20:14.986101+0000 (oldest deadline 2019-11-29T18:20:54.986101+0000) 2019-11-29T18:21:25.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:25.735+0000 1694c700 -1 osd.0 542 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:26.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:21:25.995+0000 1694c700 -1 osd.5 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.426319+0000 front 2019-11-29T18:19:59.511671+0000 (oldest deadline 2019-11-29T18:20:44.108675+0000) 2019-11-29T18:21:26.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:26.142+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:26.195 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:21:26.187+0000 1694c700 -1 osd.1 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.849012+0000 front 2019-11-29T18:19:59.956090+0000 (oldest deadline 2019-11-29T18:21:18.037544+0000) 2019-11-29T18:21:26.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:26.435+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:26.548 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:21:26.530+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e542 v542) 2019-11-29T18:21:26.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:26.540+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:27.065 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:21:26.962+0000 1694c700 -1 osd.0 543 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e540) 2019-11-29T18:21:27.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:21:27.105+0000 1694c700 -1 osd.6 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:19:59.090815+0000 front 2019-11-29T18:19:59.096439+0000 (oldest deadline 2019-11-29T18:20:43.165506+0000) 2019-11-29T18:21:27.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:21:27.496+0000 1694c700 -1 osd.4 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.178336+0000 front 2019-11-29T18:20:00.530246+0000 (oldest deadline 2019-11-29T18:20:45.860911+0000) 2019-11-29T18:21:27.575 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:21:27.557+0000 1694c700 -1 osd.7 542 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:20:00.349615+0000 front 2019-11-29T18:20:00.437415+0000 (oldest deadline 2019-11-29T18:20:43.769081+0000) 2019-11-29T18:21:57.325 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:21:57.317+0000 3778f700 -1 osd.3 547 build_incremental_map_msg missing incremental map 547 2019-11-29T18:21:57.829 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:21:57.754+0000 34f8a700 -1 osd.3 547 build_incremental_map_msg missing incremental map 547 2019-11-29T18:21:57.879 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:21:57.831+0000 35f8c700 -1 osd.3 547 build_incremental_map_msg missing incremental map 547 2019-11-29T18:21:57.946 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:21:57.878+0000 35f8c700 -1 osd.3 547 build_incremental_map_msg missing incremental map 547 2019-11-29T18:21:59.095 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:21:59.085+0000 34f8a700 -1 osd.3 548 build_incremental_map_msg missing incremental map 547 2019-11-29T18:22:56.971 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:22:56.964+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:22:57.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:22:57.478+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:22:57.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:22:57.509+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:22:57.927 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:22:57.920+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:22:58.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:22:58.465+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:22:58.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:22:58.519+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:22:58.969 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:22:58.961+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:22:59.063 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:22:59.057+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:22:59.496 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:22:59.485+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:22:59.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:22:59.488+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:22:59.939 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:22:59.932+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:00.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:00.052+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:00.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:00.088+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:00.224 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:00.215+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:00.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:00.494+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:00.523 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:00.515+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:00.989 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:00.982+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:01.038 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:01.030+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:01.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:01.055+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:01.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:01.186+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:01.196 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:01.188+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:01.484 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:01.476+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:01.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:01.496+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:01.966 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:01.959+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:02.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:02.013+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:02.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:02.075+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:02.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:02.182+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:02.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:02.203+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:02.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:02.452+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:02.531 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:02.522+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:02.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:02.980+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:03.009 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:03.003+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:03.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:03.100+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:03.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:03.220+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:03.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:03.247+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:03.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:03.449+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:03.578 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:03.569+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:04.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:04.013+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:04.028 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:04.021+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:04.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:04.056+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:04.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:04.192+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:04.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:04.225+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:04.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:04.466+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:04.598 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:04.590+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:04.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:04.983+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:04.993 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:04.983+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:05.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:05.040+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:05.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:05.164+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:05.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:05.245+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:05.458 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:05.450+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:05.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:05.601+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:05.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:05.969+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:06.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:05.990+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:06.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:06.040+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:06.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:06.155+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:06.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:06.246+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:06.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:06.440+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:06.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:06.610+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:06.932 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:06.926+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:06.958 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:06.951+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:07.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:07.004+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:07.204 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:07.196+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:07.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:07.265+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:07.412 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:07.404+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:07.591 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:07.583+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:07.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:07.920+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:07.968 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:07.961+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:08.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:08.048+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:08.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:08.200+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:08.325 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:08.317+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:08.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:08.384+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:08.576 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:08.569+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:08.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:08.935+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:08.956 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:08.949+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:09.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:09.068+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:09.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:09.205+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:09.344 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:09.336+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:09.410 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:09.401+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:09.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:09.596+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:09.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:09.899+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:09.960 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:09.951+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:10.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:10.078+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:10.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:10.211+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:10.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:10.323+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:10.370 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:10.361+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:10.655 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:10.646+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:10.959 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:10.951+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:10.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:10.953+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:11.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:11.037+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:11.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:11.192+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:11.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:11.337+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:11.360 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:11.353+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:11.614 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:11.606+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:11.937 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:11.930+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:11.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:11.949+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:12.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:12.037+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:12.222 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:12.214+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:12.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:12.315+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:12.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:12.351+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:12.653 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:12.645+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:12.933 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:12.926+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:12.969 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:12.962+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:13.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:12.998+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:13.210 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:13.202+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:13.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:13.317+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:13.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:13.319+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:13.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:13.676+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:13.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:13.923+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:13.947 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:13.939+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:14.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:14.018+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:14.179 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:14.170+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:14.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:14.295+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:14.325 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:14.317+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:14.683 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:14.674+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:14.884 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:14.877+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:14.940 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:14.932+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:15.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:15.063+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:15.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:15.166+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:15.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:15.295+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:15.333 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:15.326+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:15.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:15.630+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:15.851 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:15.842+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:15.909 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:15.902+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:16.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:16.096+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:16.152 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:16.135+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:16.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:16.277+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:16.302 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:16.294+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:16.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:16.679+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:16.879 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:16.872+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:16.948 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:16.942+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:17.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:17.134+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:17.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:17.156+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:17.287 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:17.279+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:17.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:17.298+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:17.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:17.680+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:17.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:17.911+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:17.994 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:17.987+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:18.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:18.123+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:18.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:18.168+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:18.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:18.268+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:18.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:18.345+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:18.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:18.678+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:18.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:18.889+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:19.012 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:19.003+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:19.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:19.109+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:19.230 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:19.222+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:19.266 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:19.259+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:19.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:19.301+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:19.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:19.692+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:19.905 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:19.897+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:20.024 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:20.014+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:20.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:20.097+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:20.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:20.179+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:20.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:20.263+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:20.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:20.345+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:20.701 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:20.693+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:20.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:20.858+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:21.063 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:21.056+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:21.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:21.074+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:21.167 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:21.159+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:21.296 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:21.281+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:21.326 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:21.319+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:21.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:21.679+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:21.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:21.822+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:22.101 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:22.091+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:22.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:22.118+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:22.155 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:22.147+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:22.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:22.314+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:22.376 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:22.365+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:22.736 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:22.728+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:22.851 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:22.842+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:23.117 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:23.110+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:23.131 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:23.124+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:23.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:23.131+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:23.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:23.346+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:23.359 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:23.352+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:23.716 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:23.706+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:23.838 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:23.831+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:24.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:24.083+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:24.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:24.111+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:24.128 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:24.122+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:24.380 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:24.372+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:24.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:24.384+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:24.714 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:24.707+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:24.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:24.841+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:25.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:25.087+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:25.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:25.089+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:25.101 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:25.092+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:25.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:25.409+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:25.433 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:25.425+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:25.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:25.726+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:25.847 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:25.840+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:26.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:26.044+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:26.080 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:26.073+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:26.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:26.131+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:26.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:26.374+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:26.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:26.474+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:26.737 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:26.729+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:26.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:26.847+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:27.089 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:27.082+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:27.124 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:27.117+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:27.169 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:27.162+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:27.399 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:27.391+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:27.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:27.468+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:27.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:27.756+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:27.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:27.871+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:28.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:28.048+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:28.146 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:28.138+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:28.216 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:28.208+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:28.437 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:28.429+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:28.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:28.452+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:28.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:28.769+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:28.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:28.915+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:29.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:29.072+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:29.145 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:29.137+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:29.220 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:29.212+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:29.427 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:29.420+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:29.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:29.448+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:29.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:29.760+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:29.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:29.887+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:30.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:30.035+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:30.129 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:30.120+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:30.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:30.206+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:30.440 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:30.432+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:30.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:30.448+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:30.759 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:30.751+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:30.856 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:30.848+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:31.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:31.013+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:31.140 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:31.132+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:31.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:23:31.237+0000 1694c700 -1 osd.5 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.459293+0000 front 2019-11-29T18:22:16.665881+0000 (oldest deadline 2019-11-29T18:22:59.316871+0000) 2019-11-29T18:23:31.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:31.435+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:31.472 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:23:31.465+0000 1694c700 -1 osd.7 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:15.313039+0000 front 2019-11-29T18:22:15.075238+0000 (oldest deadline 2019-11-29T18:23:00.346617+0000) 2019-11-29T18:23:31.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:23:31.761+0000 1694c700 -1 osd.6 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:12.818986+0000 front 2019-11-29T18:22:13.022244+0000 (oldest deadline 2019-11-29T18:22:57.346452+0000) 2019-11-29T18:23:31.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:23:31.816+0000 1694c700 -1 osd.1 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.836294+0000 front 2019-11-29T18:22:13.837070+0000 (oldest deadline 2019-11-29T18:22:59.660089+0000) 2019-11-29T18:23:31.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:23:31.983+0000 1694c700 -1 osd.2 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:13.768671+0000 front 2019-11-29T18:22:13.580155+0000 (oldest deadline 2019-11-29T18:22:58.835428+0000) 2019-11-29T18:23:32.027 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:23:32.021+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e548 v548) 2019-11-29T18:23:32.116 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:23:32.107+0000 1694c700 -1 osd.3 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:16.700345+0000 front 2019-11-29T18:22:16.287649+0000 (oldest deadline 2019-11-29T18:22:56.771587+0000) 2019-11-29T18:23:32.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:23:32.417+0000 1694c700 -1 osd.4 548 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:22:14.559319+0000 front 2019-11-29T18:22:14.609947+0000 (oldest deadline 2019-11-29T18:22:57.403742+0000) 2019-11-29T18:23:34.599 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:42.733 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.604 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:42.784 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.610 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:42.745 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.611 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:42.791 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.615 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:42.794 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.615 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:42.795 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.848 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:43.027 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.874 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:43.054 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:34.989 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:43.123 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.280 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:50.414 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.287 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:50.421 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.313 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:50.492 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.338 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:07:50.472 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.342 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:50.522 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.344 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:50.524 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.364 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:50.544 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.375 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:07:50.554 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:23:42.399 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:07:50.579 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:24:03.862 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:03.763+0000 2184f700 -1 reset not still connected to 0x10260f50 2019-11-29T18:24:03.908 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:03.764+0000 2184f700 -1 reset not still connected to 0x39d76380 2019-11-29T18:24:08.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.379+0000 31783700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.409+0000 31f84700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.441+0000 11cac700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.498 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.490+0000 33787700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.537 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.527+0000 33787700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.636 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.593+0000 31f84700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.699 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.694+0000 34f8a700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.714+0000 36f8e700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.833 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.763+0000 36f8e700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.844+0000 34789700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:08.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.910+0000 34f8a700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:09.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:08.934+0000 38f92700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:09.052 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:09.015+0000 32f86700 -1 osd.0 553 build_incremental_map_msg missing incremental map 553 2019-11-29T18:24:29.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:29.252+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:30.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:30.087+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:30.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:30.221+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:31.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:31.136+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:31.259 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:31.250+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:31.282 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:31.271+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:31.298 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:31.292+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:32.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:32.148+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:32.218 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:32.210+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:32.299 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:32.290+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:32.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:32.329+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:33.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:33.110+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:33.197 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:33.183+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:33.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:33.330+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:33.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:33.372+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:34.123 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:34.113+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:34.194 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:34.184+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:34.370 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:34.362+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:34.411 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:34.404+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:35.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:35.009+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:35.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:35.075+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:35.241 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:35.233+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:35.242 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:35.235+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:35.369 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:35.361+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:35.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:35.369+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:36.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:36.040+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:36.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:36.078+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:36.248 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:36.239+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:36.257 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:36.249+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:36.330 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:36.322+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:36.420 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:36.412+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:37.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:37.091+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:37.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:37.128+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:37.263 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:37.255+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:37.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:37.283+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:37.357 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:37.350+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:37.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:37.424+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:37.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:37.782+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:38.096 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:38.089+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:38.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:38.171+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:38.222 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:38.215+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:38.259 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:38.252+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:38.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:38.330+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:38.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:38.432+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:38.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:38.766+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:39.134 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:39.127+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:39.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:39.181+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:39.194 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:39.185+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:39.312 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:39.305+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:39.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:39.354+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:39.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:39.444+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:39.820 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:39.814+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:40.162 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:40.155+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:40.163 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:40.156+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:40.183 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:40.175+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:40.286 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:40.279+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:40.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:40.367+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:40.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:40.473+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:40.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:40.788+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:41.135 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:41.129+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:41.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:41.171+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:41.206 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:41.198+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:41.283 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:41.273+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:41.330 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:41.322+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:41.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:41.428+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:41.767 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:41.760+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:42.115 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:42.109+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:42.139 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:42.133+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:42.219 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:42.210+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:42.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:42.311+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:42.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:42.324+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:42.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:42.438+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:42.757 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:42.749+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:43.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:43.093+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:43.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:43.158+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:43.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:43.222+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:43.300 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:43.293+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:43.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:43.370+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:43.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:43.395+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:43.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:43.789+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:44.131 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:44.124+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:44.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:44.165+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:44.250 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:44.242+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:44.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:44.278+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:44.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:44.370+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:44.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:44.434+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:44.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:44.751+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:45.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:45.109+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:45.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:45.141+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:45.290 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:45.282+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:45.325 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:45.317+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:45.425 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:45.414+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:45.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:45.445+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:45.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:45.767+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:45.776 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:45.770+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:46.095 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:46.087+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:46.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:46.115+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:46.277 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:46.270+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:46.320 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:46.313+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:46.417 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:46.410+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:46.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:46.473+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:46.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:46.787+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:46.795 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:46.789+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:47.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:47.070+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:47.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:47.129+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:47.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:47.262+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:47.279 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:47.272+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:47.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:47.442+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:47.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:47.517+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:47.835 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:47.826+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:47.835 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:47.828+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:48.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:48.068+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:48.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:48.157+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:48.307 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:48.299+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:48.313 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:48.306+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:48.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:48.479+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:48.488 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:48.480+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:48.885 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:48.875+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:48.886 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:48.879+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:49.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:49.122+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:49.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:49.210+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:49.278 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:49.270+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:49.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:49.340+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:49.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:49.463+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:49.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:49.464+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:49.911 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:49.904+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:49.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:49.905+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:50.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:50.164+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:50.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:50.219+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:50.296 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:50.288+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:50.320 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:50.312+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:50.430 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:50.422+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:50.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:50.505+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:50.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:50.950+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:50.960 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:50.953+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:51.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:51.122+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:51.212 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:51.204+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:51.254 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:51.246+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:51.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:51.340+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:51.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:51.449+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:51.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:51.513+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:51.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:51.947+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:51.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:51.948+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:52.179 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:52.171+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:52.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:52.227+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:52.257 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:52.248+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:52.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:52.392+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:52.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:52.415+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:52.523 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:52.516+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:52.911 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:52.903+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:52.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:52.904+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:53.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:53.151+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:53.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:53.224+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:53.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:53.251+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:53.409 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:53.401+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:53.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:53.457+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:53.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:53.501+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:53.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:53.895+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:53.905 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:53.900+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:54.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:54.151+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:54.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:54.194+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:54.246 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:54.240+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:54.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:54.438+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:54.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:54.504+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:54.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:54.522+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:54.899 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:54.891+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:54.900 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:54.893+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:55.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:55.164+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:55.221 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:55.212+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:55.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:55.235+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:55.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:55.459+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:55.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:55.483+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:55.530 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:55.523+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:55.860 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:55.851+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:55.866 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:55.854+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:56.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:56.146+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:56.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:56.238+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:56.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:56.255+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:56.494 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:56.481+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:56.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:56.487+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:56.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:56.494+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:56.890 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:56.882+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:56.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:56.884+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:57.121 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:57.114+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:57.226 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:57.219+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:57.295 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:57.288+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:57.455 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:57.448+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:57.508 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:57.500+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:57.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:57.520+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:57.914 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:57.906+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:57.915 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:57.908+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:58.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:58.157+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:58.260 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:58.253+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:58.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:58.314+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:58.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:58.476+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:58.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:58.529+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:58.544 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:58.537+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:58.870 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:58.862+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:58.872 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:58.864+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:24:59.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:24:59.180+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:24:59.240 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:24:59.228+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:24:59.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:24:59.282+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:24:59.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:24:59.506+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:24:59.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:24:59.510+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:24:59.553 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:24:59.546+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:24:59.911 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:59.903+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:24:59.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:24:59.905+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:00.157 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:00.147+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:00.198 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:00.191+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:00.301 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:00.294+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:00.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:00.472+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:00.521 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:00.514+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:00.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:00.543+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:00.928 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:00.921+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:00.931 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:00.925+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:01.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:01.178+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:01.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:01.214+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:01.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:01.328+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:01.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:01.469+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:01.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:01.548+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:01.594 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:01.588+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:01.992 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:01.984+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:01.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:01.986+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:02.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:02.189+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:02.205 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:02.197+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:02.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:02.363+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:02.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:02.432+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:02.507 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:25:02.500+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e554 v554) 2019-11-29T18:25:02.593 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:02.583+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:02.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:02.598+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:03.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:02.995+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:03.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:02.998+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:03.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:03.151+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:03.255 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:03.247+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:03.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:03.356+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:03.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:03.427+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:03.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:03.538+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:03.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:03.565+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:04.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:04.010+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:04.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:04.013+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:04.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:04.141+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:04.294 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:04.287+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:04.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:04.391+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:04.430 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:04.422+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:04.521 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:04.513+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:04.609 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:04.600+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:05.061 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:05.054+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:05.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:05.055+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:05.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:05.195+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:05.291 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:05.284+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:05.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:05.400+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:05.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:05.404+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:05.478 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:05.471+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:05.640 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:05.634+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:06.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:06.014+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:06.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:06.017+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:06.206 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:06.199+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:06.278 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:06.271+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:06.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:06.369+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:06.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:06.418+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:06.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:06.458+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:06.644 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:06.636+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:07.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:07.035+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:07.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:07.036+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:07.182 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:07.164+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:07.313 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:07.305+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:07.408 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:07.401+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:07.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:07.435+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:07.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:07.442+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:07.521 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:25:07.510+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e554 v554) 2019-11-29T18:25:07.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:07.662+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:08.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:08.015+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:08.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:08.020+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:08.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:08.218+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:08.370 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:08.359+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:08.447 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:08.439+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:08.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:08.449+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:08.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:08.485+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:08.635 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:08.628+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:09.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:09.002+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:09.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:09.004+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:09.187 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:09.179+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:09.375 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:09.367+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:09.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:09.455+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:09.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:09.466+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:09.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:09.499+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:09.636 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:09.630+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:09.972 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:09.963+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:09.972 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:09.965+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:10.244 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:10.235+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:10.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:10.412+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:10.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:10.450+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:10.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:10.488+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:10.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:10.491+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:10.665 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:10.657+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:10.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:10.976+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:10.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:10.978+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:11.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:11.270+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:11.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:11.446+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:11.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:11.472+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:11.488 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:11.480+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:11.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:11.525+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:11.657 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:11.640+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:11.992 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:11.985+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:11.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:11.986+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:12.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:12.298+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:12.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:12.449+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:12.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:12.469+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:12.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:12.491+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:12.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:12.519+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:12.541 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:25:12.528+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e554 v554) 2019-11-29T18:25:12.608 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:12.600+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:12.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:12.975+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:12.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:12.977+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:13.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:13.286+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:13.418 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:13.411+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:13.427 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:13.421+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:13.519 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:13.511+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:13.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:13.525+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:13.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:13.557+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:13.955 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:13.947+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:13.958 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:13.952+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:14.323 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:14.314+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:14.390 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:14.383+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:14.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:14.397+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:14.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:14.490+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:14.516 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:14.508+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:14.617 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:14.608+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:14.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:14.911+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:14.920 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:14.914+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:15.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:15.277+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:15.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:15.383+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:15.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:15.430+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:15.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:15.467+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:15.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:15.503+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:15.602 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:15.595+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:15.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:15.892+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:15.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:15.896+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:16.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:16.261+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:16.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:16.388+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:16.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:16.403+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:16.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:16.478+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:16.521 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:16.513+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:16.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:16.585+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:16.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:16.895+0000 1694c700 -1 osd.0 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:24:04.767458+0000 (oldest deadline 2019-11-29T18:24:44.767458+0000) 2019-11-29T18:25:16.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:16.898+0000 1694c700 -1 osd.0 554 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:25:17.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:25:17.297+0000 1694c700 -1 osd.5 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:48.412827+0000 front 2019-11-29T18:23:48.472711+0000 (oldest deadline 2019-11-29T18:24:34.296087+0000) 2019-11-29T18:25:17.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:25:17.359+0000 1694c700 -1 osd.1 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:49.059441+0000 front 2019-11-29T18:23:48.985106+0000 (oldest deadline 2019-11-29T18:24:34.235783+0000) 2019-11-29T18:25:17.399 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:25:17.390+0000 1694c700 -1 osd.7 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:45.219406+0000 front 2019-11-29T18:23:45.401694+0000 (oldest deadline 2019-11-29T18:24:29.281543+0000) 2019-11-29T18:25:17.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:25:17.463+0000 1694c700 -1 osd.4 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.633828+0000 front 2019-11-29T18:23:48.964168+0000 (oldest deadline 2019-11-29T18:24:28.893146+0000) 2019-11-29T18:25:17.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:25:17.499+0000 1694c700 -1 osd.2 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:47.018859+0000 front 2019-11-29T18:23:46.872385+0000 (oldest deadline 2019-11-29T18:24:30.346804+0000) 2019-11-29T18:25:17.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:25:17.611+0000 1694c700 -1 osd.6 554 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:23:46.631115+0000 front 2019-11-29T18:23:46.640434+0000 (oldest deadline 2019-11-29T18:24:30.702164+0000) 2019-11-29T18:25:17.630 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:25:17.621+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e554 v554) 2019-11-29T18:25:18.259 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:18.235+0000 38f92700 -1 osd.0 555 build_incremental_map_msg missing incremental map 553 2019-11-29T18:25:18.259 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:25:18.242+0000 1694c700 -1 osd.0 555 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e552) 2019-11-29T18:26:42.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:42.122+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:42.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:42.657+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:43.134 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:43.125+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:43.552 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:43.545+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:43.692 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:43.682+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:44.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:44.093+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:44.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:44.563+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:44.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:44.696+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:44.816 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:44.806+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:45.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:45.061+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:45.497 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:45.490+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:45.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:45.548+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:45.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:45.653+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:45.820 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:45.811+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:46.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:46.015+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:46.084 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:46.076+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:46.464 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:46.457+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:46.541 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:46.533+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:46.644 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:46.636+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:46.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:46.773+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:46.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:46.864+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:47.062 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:47.054+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:47.125 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:47.117+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:47.502 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:47.495+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:47.593 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:47.586+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:47.678 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:47.669+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:47.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:47.743+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:47.889 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:47.880+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:48.100 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:48.093+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:48.131 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:48.118+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:48.540 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:48.533+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:48.553 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:48.547+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:48.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:48.641+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:48.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:48.791+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:48.846 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:48.837+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:49.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:49.140+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:49.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:49.147+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:49.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:49.561+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:49.578 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:49.571+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:49.621 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:49.611+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:49.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:49.786+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:49.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:49.830+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:50.142 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:50.134+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:50.187 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:50.180+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:50.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:50.532+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:50.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:50.568+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:50.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:50.589+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:50.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:50.776+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:50.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:50.804+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:51.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:51.123+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:51.176 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:51.168+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:51.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:51.509+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:51.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:51.581+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:51.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:51.596+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:51.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:51.810+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:51.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:51.829+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:52.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:52.131+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:52.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:52.145+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:52.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:52.536+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:52.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:52.575+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:52.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:52.640+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:52.857 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:52.842+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:52.897 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:52.883+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:53.107 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:53.099+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:53.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:53.158+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:53.544 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:53.535+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:53.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:53.608+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:53.706 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:53.695+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:53.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:53.866+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:53.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:53.869+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:54.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:54.073+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:54.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:54.166+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:54.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:54.490+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:54.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:54.593+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:54.742 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:54.731+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:54.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:54.880+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:54.911 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:54.903+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:55.038 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:55.029+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:55.170 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:55.162+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:55.478 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:55.469+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:55.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:55.599+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:55.765 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:55.757+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:55.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:55.868+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:55.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:55.928+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:55.997 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:55.989+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:56.164 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:56.153+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:56.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:56.460+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:56.615 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:56.607+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:56.749 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:56.741+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:56.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:56.871+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:56.960 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:56.951+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:57.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:57.019+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:57.208 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:57.201+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:57.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:57.467+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:57.630 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:57.624+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:57.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:57.739+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:57.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:57.862+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:57.955 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:57.946+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:58.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:58.052+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:58.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:58.221+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:58.511 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:58.502+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:58.631 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:58.622+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:58.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:58.736+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:58.919 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:58.911+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:26:58.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:26:58.984+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:26:59.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:26:59.053+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:26:59.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:26:59.193+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:26:59.543 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:26:59.536+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:26:59.670 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:26:59.662+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:26:59.728 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:26:59.720+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:26:59.949 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:26:59.942+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:00.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:00.025+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:00.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:00.040+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:00.241 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:27:00.230+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:27:00.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:00.588+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:00.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:00.708+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:00.747 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:00.740+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:00.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:00.982+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:01.004 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:00.996+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:01.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:01.091+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:01.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:27:01.227+0000 1694c700 -1 osd.5 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:56.584582+0000 front 2019-11-29T18:25:56.588466+0000 (oldest deadline 2019-11-29T18:26:42.113335+0000) 2019-11-29T18:27:01.573 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:01.566+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:01.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:01.722+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:01.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:01.783+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:01.972 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:01.956+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:01.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:01.963+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:02.083 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:02.075+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:02.570 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:02.562+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:02.690 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:02.682+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:02.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:02.798+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:02.965 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:02.957+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:02.974 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:02.966+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:03.050 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:03.042+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:03.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:03.592+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:03.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:03.667+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:03.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:03.821+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:03.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:03.924+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:04.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:03.995+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:04.084 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:04.078+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:04.647 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:04.638+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:04.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:04.647+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:04.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:04.856+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:04.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:04.923+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:04.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:04.970+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:05.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:05.054+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:05.690 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:05.680+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:05.697 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:05.690+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:05.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:05.810+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:05.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:05.942+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:05.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:05.953+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:06.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:06.052+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:06.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:06.678+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:06.733 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:06.725+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:06.774 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:06.765+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:06.926 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:06.917+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:06.967 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:06.957+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:07.027 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:07.019+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:07.720 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:07.711+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:07.723 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:07.715+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:07.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:07.809+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:07.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:07.885+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:07.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:07.988+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:08.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:08.019+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:08.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:08.678+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:08.709 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:08.700+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:08.773 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:08.765+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:08.879 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:08.870+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:08.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:08.989+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:09.003 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:08.995+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:09.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:09.707+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:09.716 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:09.708+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:09.729 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:09.722+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:09.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:09.869+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:10.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:10.042+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:10.051 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:10.044+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:10.714 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:10.703+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:10.759 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:10.751+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:10.770 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:10.763+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:10.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:10.883+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:11.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:10.998+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:11.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:11.085+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:11.670 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:11.661+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:11.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:11.722+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:11.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:11.779+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:11.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:11.933+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:12.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:12.010+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:12.095 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:12.087+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:12.657 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:12.649+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:12.767 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:12.759+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:12.830 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:12.823+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:12.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:12.912+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:12.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:12.964+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:12.994 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:27:12.985+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e560 v560) 2019-11-29T18:27:13.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:13.057+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:13.647 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:13.637+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:13.739 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:13.731+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:13.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:13.832+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:13.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:13.965+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:14.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:14.000+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:14.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:14.033+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:14.679 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:14.672+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:14.715 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:14.706+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:14.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:14.801+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:14.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:14.945+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:14.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:14.973+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:15.096 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:15.086+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:15.644 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:15.637+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:15.760 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:15.752+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:15.791 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:15.783+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:15.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:15.959+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:15.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:15.991+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:16.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:16.136+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:16.619 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:16.610+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:16.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:16.744+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:16.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:16.780+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:16.957 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:16.949+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:17.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:17.007+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:17.170 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:17.152+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:17.654 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:17.647+0000 1694c700 -1 osd.3 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.445674+0000 front 2019-11-29T18:26:01.385507+0000 (oldest deadline 2019-11-29T18:26:45.365779+0000) 2019-11-29T18:27:17.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:27:17.763+0000 1694c700 -1 osd.2 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:00.877937+0000 front 2019-11-29T18:26:00.724001+0000 (oldest deadline 2019-11-29T18:26:43.003841+0000) 2019-11-29T18:27:17.788 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:27:17.780+0000 1694c700 -1 osd.7 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.186290+0000 front 2019-11-29T18:25:59.184582+0000 (oldest deadline 2019-11-29T18:26:42.216021+0000) 2019-11-29T18:27:18.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:27:17.994+0000 1694c700 -1 osd.1 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:25:59.705568+0000 front 2019-11-29T18:25:59.708724+0000 (oldest deadline 2019-11-29T18:26:45.585570+0000) 2019-11-29T18:27:18.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:27:18.037+0000 1694c700 -1 osd.6 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.064815+0000 front 2019-11-29T18:26:01.066530+0000 (oldest deadline 2019-11-29T18:26:44.522432+0000) 2019-11-29T18:27:18.063 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:27:18.056+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e560 v560) 2019-11-29T18:27:18.211 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:27:18.204+0000 1694c700 -1 osd.4 560 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:26:01.072417+0000 front 2019-11-29T18:26:01.067696+0000 (oldest deadline 2019-11-29T18:26:46.437718+0000) 2019-11-29T18:27:24.717 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:11:32.847 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.728 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:11:32.862 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.734 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:11:32.913 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.740 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:11:32.920 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.741 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:11:32.920 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.747 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:11:32.926 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:24.987 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:11:33.122 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:25.020 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:11:33.199 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:25.027 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:11:33.206 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:27:54.046 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:27:53.898+0000 34f8a700 -1 osd.3 564 build_incremental_map_msg missing incremental map 564 2019-11-29T18:28:16.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:16.447+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:16.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:16.697+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:16.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:16.985+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:17.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:17.477+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:17.726 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:17.718+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:18.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:18.008+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:18.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:18.140+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:18.228 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:18.221+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:18.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:18.490+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:18.590 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:18.580+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:18.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:18.740+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:19.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:19.054+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:19.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:19.162+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:19.265 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:19.258+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:19.508 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:19.500+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:19.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:19.596+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:19.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:19.749+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:20.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:20.106+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:20.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:20.140+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:20.288 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:20.280+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:20.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:20.516+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:20.593 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:20.585+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:20.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:20.734+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:21.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:21.108+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:21.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:21.116+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:21.280 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:21.271+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:21.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:21.540+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:21.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:21.566+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:21.740 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:21.731+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:22.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:22.084+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:22.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:22.095+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:22.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:22.317+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:22.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:22.525+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:22.548 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:22.539+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:22.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:22.772+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:23.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:23.084+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:23.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:23.087+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:23.318 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:23.311+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:23.507 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:23.501+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:23.519 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:23.513+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:23.834 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:23.819+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:24.075 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:24.068+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:24.093 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:24.085+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:24.364 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:24.357+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:24.475 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:24.468+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:24.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:24.513+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:24.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:24.793+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:25.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:25.038+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:25.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:25.047+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:25.324 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:25.317+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:25.472 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:25.460+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:25.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:25.503+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:25.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:25.766+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:26.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:26.012+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:26.023 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:26.016+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:26.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:26.342+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:26.404 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:26.398+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:26.523 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:26.508+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:26.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:26.519+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:26.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:26.802+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:27.047 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:27.040+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:27.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:27.056+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:27.384 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:27.378+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:27.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:27.408+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:27.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:27.506+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:27.514 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:27.506+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:27.827 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:27.820+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:28.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:28.001+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:28.114 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:28.107+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:28.378 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:28.372+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:28.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:28.426+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:28.477 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:28.470+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:28.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:28.537+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:28.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:28.855+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:28.964 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:28.957+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:29.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:29.168+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:29.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:29.334+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:29.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:29.468+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:29.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:29.471+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:29.564 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:29.556+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:29.890 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:29.883+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:29.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:29.934+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:30.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:30.167+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:30.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:30.382+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:30.478 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:30.470+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:30.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:30.509+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:30.580 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:30.573+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:30.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:30.886+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:30.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:30.904+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:31.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:31.181+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:31.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:31.421+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:31.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:31.423+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:31.471 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:31.463+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:31.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:31.518+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:31.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:31.562+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:31.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:31.854+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:31.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:31.925+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:32.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:32.211+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:32.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:32.408+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:32.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:32.411+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:32.500 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:32.491+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:32.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:32.493+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:32.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:32.579+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:32.819 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:32.811+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:32.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:32.978+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:33.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:33.231+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:33.383 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:33.376+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:33.387 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:33.380+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:33.471 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:33.463+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:33.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:33.511+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:33.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:33.564+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:33.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:33.815+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:34.035 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:34.028+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:34.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:34.256+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:34.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:34.337+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:34.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:34.339+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:34.497 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:34.491+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:34.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:34.532+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:34.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:34.593+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:34.795 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:34.788+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:35.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:35.047+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:35.238 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:35.230+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:35.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:35.313+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:35.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:35.315+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:35.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:35.520+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:35.555 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:35.547+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:35.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:35.640+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:35.790 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:35.783+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:36.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:36.043+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:36.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:36.199+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:36.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:36.289+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:36.300 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:36.294+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:36.547 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:36.539+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:36.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:36.573+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:36.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:36.669+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:36.788 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:36.781+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:37.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:37.063+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:37.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:37.252+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:37.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:37.262+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:37.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:37.264+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:37.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:37.545+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:37.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:37.577+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:37.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:37.674+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:37.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:37.759+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:38.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:38.053+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:38.256 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:38.248+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:38.259 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:38.253+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:38.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:38.299+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:38.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:38.560+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:38.578 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:38.571+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:38.659 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:38.652+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:38.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:38.777+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:39.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:39.065+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:39.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:39.278+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:39.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:39.304+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:39.312 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:39.306+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:39.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:39.529+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:39.629 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:39.623+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:39.695 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:39.689+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:39.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:39.753+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:40.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:40.037+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:40.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:40.321+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:40.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:40.322+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:40.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:40.326+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:40.578 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:40.572+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:40.667 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:40.655+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:40.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:40.716+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:40.743 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:40.736+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:41.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:41.004+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:41.347 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:41.340+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:41.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:41.363+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:41.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:41.365+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:41.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:41.568+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:41.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:41.642+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:41.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:41.723+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:41.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:41.732+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:42.016 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:42.008+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:42.337 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:42.330+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:42.339 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:42.332+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:42.348 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:42.341+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:42.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:42.532+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:42.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:42.610+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:42.706 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:42.698+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:42.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:42.781+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:43.014 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:43.007+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:43.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:43.360+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:43.368 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:43.362+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:43.395 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:43.387+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:43.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:43.536+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:43.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:43.640+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:43.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:43.721+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:43.750 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:43.742+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:43.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:43.991+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:44.360 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:44.353+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:44.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:44.408+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:44.416 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:44.409+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:44.555 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:44.549+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:44.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:44.637+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:44.746 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:44.739+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:44.797 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:44.783+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:45.015 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:45.008+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:45.376 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:45.369+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:45.378 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:45.372+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:45.387 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:45.381+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:45.588 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:45.581+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:45.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:45.630+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:45.749 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:45.735+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:45.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:45.749+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:46.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:46.025+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:46.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:46.360+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:46.385 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:46.377+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:46.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:46.382+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:46.592 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:46.585+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:46.641 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:46.635+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:46.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:46.756+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:46.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:46.772+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:47.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:47.029+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:47.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:47.334+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:47.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:47.335+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:47.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:47.386+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:47.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:47.572+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:47.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:47.672+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:47.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:47.745+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:47.802 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:47.794+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:48.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:48.033+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:48.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:48.287+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:48.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:48.288+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:48.424 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:28:48.418+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e565 v565) 2019-11-29T18:28:48.437 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:48.429+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:48.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:48.584+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:48.681 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:48.673+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:48.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:48.735+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:48.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:48.787+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:49.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:49.033+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:49.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:49.286+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:49.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:49.290+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:49.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:49.459+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:49.641 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:49.634+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:49.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:49.681+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:49.742 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:49.734+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:49.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:49.804+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:50.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:49.990+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:50.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:50.311+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:50.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:50.313+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:50.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:50.420+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:50.614 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:50.607+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:50.700 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:50.692+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:50.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:50.759+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:50.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:50.779+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:51.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:50.997+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:51.284 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:51.277+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:51.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:51.279+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:51.455 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:51.448+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:51.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:51.592+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:51.658 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:51.651+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:51.792 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:51.784+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:51.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:51.811+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:52.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:51.997+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:52.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:52.289+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:52.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:52.292+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:52.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:52.470+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:52.624 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:52.611+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:52.681 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:52.675+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:52.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:52.786+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:52.797 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:52.790+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:52.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:52.983+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:53.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:53.254+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:53.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:53.257+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:53.450 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:53.442+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:53.457 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:28:53.449+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e565 v565) 2019-11-29T18:28:53.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:53.584+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:53.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:53.682+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:53.797 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:53.790+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:53.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:53.830+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:54.032 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:54.025+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:54.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:54.221+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:54.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:54.223+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:54.499 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:54.491+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:54.624 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:54.617+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:54.671 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:54.662+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:54.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:54.801+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:54.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:54.868+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:55.053 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:55.047+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:55.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:55.201+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:55.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:55.202+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:55.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:55.481+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:55.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:55.646+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:55.659 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:55.651+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:55.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:55.797+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:55.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:55.918+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:56.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:56.054+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:56.215 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:56.207+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:56.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:56.209+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:56.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:56.454+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:56.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:56.602+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:56.664 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:56.656+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:56.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:56.845+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:56.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:56.965+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:57.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:57.094+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:57.213 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:57.201+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:57.213 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:57.205+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:57.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:57.476+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:57.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:57.583+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:57.653 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:57.646+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:57.880 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:57.872+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:58.021 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:58.014+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:58.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:58.094+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:58.182 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:58.175+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:58.184 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:58.178+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:58.476 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:28:58.465+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e565 v565) 2019-11-29T18:28:58.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:58.528+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:58.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:58.571+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:58.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:58.661+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:58.871 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:58.863+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:28:59.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:28:59.052+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:28:59.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:28:59.126+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:28:59.161 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:59.154+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:28:59.162 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:28:59.156+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:28:59.554 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:28:59.545+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:28:59.597 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:28:59.589+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:28:59.705 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:28:59.696+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:28:59.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:28:59.857+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:29:00.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:29:00.066+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:29:00.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:29:00.091+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:29:00.149 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:00.142+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:29:00.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:00.143+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:29:00.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:29:00.576+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:29:00.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:29:00.585+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:29:00.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:29:00.731+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:29:00.899 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:29:00.890+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:29:01.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:29:01.022+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:29:01.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:29:01.142+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:29:01.166 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:01.159+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:29:01.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:01.162+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:29:01.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:29:01.539+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:29:01.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:29:01.558+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:29:01.704 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:29:01.695+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:29:01.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:29:01.849+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:29:02.027 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:29:02.017+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:29:02.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:29:02.133+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:29:02.218 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:02.212+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:29:02.220 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:02.214+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:29:02.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:29:02.582+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:29:02.614 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:29:02.606+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:29:02.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:29:02.689+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:29:02.874 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:29:02.865+0000 1694c700 -1 osd.7 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.546558+0000 front 2019-11-29T18:27:33.633750+0000 (oldest deadline 2019-11-29T18:28:16.427510+0000) 2019-11-29T18:29:03.037 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:29:03.028+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:29:03.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:29:03.118+0000 1694c700 -1 osd.2 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.881664+0000 front 2019-11-29T18:27:30.911028+0000 (oldest deadline 2019-11-29T18:28:16.164618+0000) 2019-11-29T18:29:03.192 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:03.185+0000 1694c700 -1 osd.0 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:27:50.857253+0000 (oldest deadline 2019-11-29T18:28:30.857253+0000) 2019-11-29T18:29:03.194 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:29:03.188+0000 1694c700 -1 osd.0 565 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e564) 2019-11-29T18:29:03.581 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:29:03.565+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e565 v565) 2019-11-29T18:29:03.583 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:29:03.575+0000 1694c700 -1 osd.1 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:33.884265+0000 front 2019-11-29T18:27:34.002781+0000 (oldest deadline 2019-11-29T18:28:17.958038+0000) 2019-11-29T18:29:03.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:29:03.646+0000 1694c700 -1 osd.5 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:32.711760+0000 front 2019-11-29T18:27:32.709578+0000 (oldest deadline 2019-11-29T18:28:17.385701+0000) 2019-11-29T18:29:03.676 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:29:03.667+0000 1694c700 -1 osd.6 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:34.835558+0000 front 2019-11-29T18:27:34.848133+0000 (oldest deadline 2019-11-29T18:28:18.306223+0000) 2019-11-29T18:29:04.002 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:29:03.994+0000 1694c700 -1 osd.4 565 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:27:30.855880+0000 front 2019-11-29T18:27:30.868200+0000 (oldest deadline 2019-11-29T18:28:16.140850+0000) 2019-11-29T18:30:28.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:28.387+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:28.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:28.761+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:29.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:29.297+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:29.381 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:29.371+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:29.426 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:29.416+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:29.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:29.523+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:29.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:29.739+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:30.274 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:30.265+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:30.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:30.410+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:30.460 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:30.451+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:30.560 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:30.551+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:30.704 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:30.696+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:31.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:31.255+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:31.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:31.368+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:31.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:31.454+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:31.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:31.516+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:31.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:31.650+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:32.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:32.258+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:32.418 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:32.407+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:32.468 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:32.460+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:32.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:32.528+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:32.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:32.654+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:33.176 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:33.167+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:33.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:33.250+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:33.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:33.371+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:33.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:33.458+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:33.505 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:33.492+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:33.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:33.655+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:34.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:34.110+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:34.145 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:14:42.279 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:34.147+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:34.159 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:14:42.293 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.197 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:14:42.377 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.200 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:14:42.380 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.215 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:14:42.394 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.217 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:14:42.396 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:34.254+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:34.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:34.329+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:34.402 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:14:42.536 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.456 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:14:42.635 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.468 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:14:42.647 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:30:34.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:34.474+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:34.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:34.513+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:34.640 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:34.633+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:35.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:35.096+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:35.204 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:35.194+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:35.236 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:35.225+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:35.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:35.345+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:35.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:35.468+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:35.517 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:35.509+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:35.612 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:35.603+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:36.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:36.052+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:36.220 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:36.212+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:36.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:36.218+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:36.398 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:36.390+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:36.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:36.489+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:36.554 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:36.546+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:36.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:36.564+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:37.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:37.097+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:37.202 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:37.192+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:37.209 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:37.202+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:37.423 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:37.415+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:37.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:37.473+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:37.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:37.544+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:37.583 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:37.575+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:38.068 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:38.060+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:38.177 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:38.169+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:38.204 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:38.196+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:38.444 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:38.436+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:38.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:38.441+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:38.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:38.531+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:38.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:38.592+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:39.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:39.111+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:39.186 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:39.179+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:39.242 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:39.235+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:39.433 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:39.425+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:39.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:39.460+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:39.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:39.542+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:39.585 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:39.577+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:40.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:40.110+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:40.155 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:40.148+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:40.275 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:40.267+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:40.426 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:40.419+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:40.437 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:40.430+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:40.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:40.543+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:40.632 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:40.624+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:41.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:41.116+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:41.162 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:41.154+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:41.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:41.296+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:41.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:41.434+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:41.489 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:41.482+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:41.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:41.544+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:41.662 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:41.655+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:42.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:42.106+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:42.137 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:42.130+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:42.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:42.261+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:42.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:42.470+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:42.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:42.487+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:42.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:42.527+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:42.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:42.679+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:43.096 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:43.090+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:43.183 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:43.175+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:43.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:43.236+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:43.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:43.474+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:43.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:43.507+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:43.567 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:43.559+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:43.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:43.707+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:44.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:44.100+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:44.222 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:44.216+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:44.251 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:44.243+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:44.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:44.459+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:44.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:44.507+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:44.555 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:44.546+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:44.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:44.709+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:45.123 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:45.115+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:45.235 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:45.228+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:45.290 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:45.282+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:45.503 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:45.493+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:45.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:45.517+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:45.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:45.556+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:45.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:45.703+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:46.168 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:46.160+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:46.228 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:46.220+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:46.343 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:46.335+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:46.508 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:46.499+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:46.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:46.545+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:46.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:46.544+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:46.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:46.758+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:47.198 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:47.189+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:47.210 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:47.201+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:47.370 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:47.361+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:47.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:47.522+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:47.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:47.528+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:47.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:47.571+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:47.808 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:47.801+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:48.234 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:48.227+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:48.251 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:48.244+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:48.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:48.377+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:48.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:48.503+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:48.545 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:48.537+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:48.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:48.597+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:48.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:48.848+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:49.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:49.211+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:49.238 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:49.230+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:49.346 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:49.338+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:49.475 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:49.468+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:49.503 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:49.496+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:49.599 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:49.592+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:49.822 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:49.815+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:50.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:50.233+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:50.251 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:50.243+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:50.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:50.384+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:50.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:50.503+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:50.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:50.524+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:50.587 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:50.579+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:50.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:50.790+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:51.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:51.208+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:51.293 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:51.283+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:51.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:51.349+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:51.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:51.509+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:51.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:51.522+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:51.635 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:51.629+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:51.802 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:51.794+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:52.170 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:52.162+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:52.286 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:52.279+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:52.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:52.383+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:52.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:52.486+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:52.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:52.496+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:52.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:52.609+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:52.830 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:52.822+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:53.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:53.137+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:53.329 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:53.321+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:53.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:53.369+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:53.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:53.494+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:53.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:53.501+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:53.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:53.633+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:53.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:53.873+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:54.185 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:54.178+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:54.321 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:54.312+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:54.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:54.368+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:54.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:54.476+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:54.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:54.490+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:54.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:54.645+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:54.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:54.857+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:55.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:55.198+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:55.304 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:55.297+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:55.389 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:55.382+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:55.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:55.460+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:55.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:55.488+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:55.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:55.633+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:55.872 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:55.864+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:56.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:56.197+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:56.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:56.293+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:56.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:56.384+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:56.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:56.438+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:56.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:56.517+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:56.674 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:56.667+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:56.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:56.907+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:57.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:57.213+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:57.279 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:57.271+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:57.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:57.422+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:57.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:57.423+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:57.560 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:57.553+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:57.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:57.636+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:57.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:57.951+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:58.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:58.190+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:58.300 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:58.292+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:58.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:58.403+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:58.420 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:58.412+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:58.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:58.533+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:58.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:58.609+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:58.954 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:58.946+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:30:59.174 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:30:59.167+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e572 v572) 2019-11-29T18:30:59.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:30:59.239+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:30:59.325 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:30:59.318+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:30:59.425 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:30:59.417+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:30:59.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:30:59.419+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:30:59.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:30:59.488+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:30:59.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:30:59.634+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:30:59.960 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:30:59.952+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:31:00.261 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:31:00.249+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:31:00.318 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:00.311+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:31:00.380 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:31:00.372+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:31:00.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:31:00.411+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:31:00.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:31:00.488+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:31:00.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:31:00.641+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:31:00.981 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:31:00.973+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:31:01.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:31:01.267+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:31:01.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:31:01.334+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:31:01.364 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:01.355+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:31:01.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:31:01.419+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:31:01.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:31:01.507+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:31:01.615 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:31:01.606+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:31:02.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:31:02.000+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:31:02.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:31:02.306+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:31:02.338 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:31:02.330+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:31:02.409 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:02.400+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:31:02.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:31:02.455+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:31:02.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:31:02.551+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:31:02.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:31:02.563+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:31:03.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:31:03.011+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:31:03.300 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:31:03.291+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:31:03.360 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:31:03.351+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:31:03.388 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:03.380+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:31:03.445 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:31:03.437+0000 1694c700 -1 osd.7 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:46.980279+0000 front 2019-11-29T18:29:46.985326+0000 (oldest deadline 2019-11-29T18:30:28.654582+0000) 2019-11-29T18:31:03.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:31:03.533+0000 1694c700 -1 osd.1 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:45.657934+0000 front 2019-11-29T18:29:45.307199+0000 (oldest deadline 2019-11-29T18:30:28.051306+0000) 2019-11-29T18:31:03.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:31:03.564+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:31:04.014 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:31:04.006+0000 1694c700 -1 osd.5 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.468533+0000 front 2019-11-29T18:29:47.347754+0000 (oldest deadline 2019-11-29T18:30:29.001636+0000) 2019-11-29T18:31:04.253 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:31:04.244+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e572 v572) 2019-11-29T18:31:04.299 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:31:04.291+0000 1694c700 -1 osd.6 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:44.159547+0000 front 2019-11-29T18:29:44.231939+0000 (oldest deadline 2019-11-29T18:30:28.816554+0000) 2019-11-29T18:31:04.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:31:04.356+0000 1694c700 -1 osd.2 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.209864+0000 front 2019-11-29T18:29:47.265648+0000 (oldest deadline 2019-11-29T18:30:33.100205+0000) 2019-11-29T18:31:04.369 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:04.362+0000 1694c700 -1 osd.3 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:47.893388+0000 front 2019-11-29T18:29:47.837101+0000 (oldest deadline 2019-11-29T18:30:32.490216+0000) 2019-11-29T18:31:04.546 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:31:04.540+0000 1694c700 -1 osd.4 572 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:29:42.980798+0000 front 2019-11-29T18:29:42.873237+0000 (oldest deadline 2019-11-29T18:30:28.085790+0000) 2019-11-29T18:31:16.068 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:15:24.202 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.080 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:15:24.259 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.081 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:15:24.260 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.085 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:15:24.265 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.086 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:15:24.220 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.090 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:15:24.270 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.154 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:15:24.333 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.160 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:15:24.294 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:16.160 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:15:24.340 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:31:36.597 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:31:36.587+0000 34f8a700 -1 osd.3 577 build_incremental_map_msg missing incremental map 577 2019-11-29T18:32:02.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:02.708+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:03.183 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:03.173+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:03.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:03.429+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:03.755 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:03.747+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:04.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:04.133+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:04.361 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:04.355+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:04.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:04.479+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:04.669 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:16:12.801 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.672 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:16:12.806 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.693 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:16:12.873 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.737 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:16:12.872 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.741 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:04.733+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:04.744 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:16:12.923 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.748 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:16:12.927 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.750 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:16:12.929 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.816 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:16:12.995 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.846 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:16:13.016 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:32:04.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:04.838+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:05.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:05.096+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:05.290 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:05.279+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:05.408 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:05.402+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:05.457 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:05.439+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:05.765 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:05.756+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:05.840 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:05.832+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:06.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:06.107+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:06.287 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:06.280+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:06.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:06.407+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:06.481 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:06.473+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:06.807 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:06.798+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:06.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:06.803+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:07.073 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:07.065+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:07.139 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:07.132+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:07.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:07.269+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:07.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:07.429+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:07.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:07.466+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:07.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:07.794+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:07.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:07.834+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:08.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:08.080+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:08.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:08.087+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:08.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:08.278+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:08.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:08.439+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:08.454 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:08.447+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:08.781 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:08.774+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:08.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:08.876+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:09.092 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:09.084+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:09.102 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:09.094+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:09.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:09.252+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:09.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:09.421+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:09.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:09.471+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:09.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:09.795+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:09.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:09.931+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:10.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:10.050+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:10.122 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:10.115+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:10.314 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:10.307+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:10.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:10.466+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:10.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:10.470+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:10.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:10.753+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:10.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:10.895+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:11.079 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:11.067+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:11.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:11.133+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:11.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:11.296+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:11.455 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:11.447+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:11.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:11.465+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:11.473 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:11.467+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:11.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:11.808+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:11.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:11.879+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:12.075 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:12.063+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:12.123 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:12.116+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:12.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:12.269+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:12.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:12.408+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:12.474 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:12.467+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:12.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:12.470+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:12.791 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:12.783+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:12.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:12.872+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:13.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:13.094+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:13.123 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:13.112+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:13.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:13.254+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:13.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:13.415+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:13.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:13.518+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:13.526 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:13.519+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:13.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:13.830+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:13.868 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:13.860+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:14.075 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:14.068+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:14.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:14.092+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:14.272 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:14.265+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:14.442 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:14.435+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:14.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:14.517+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:14.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:14.518+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:14.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:14.859+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:14.879 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:14.871+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:15.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:15.047+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:15.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:15.063+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:15.291 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:15.284+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:15.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:15.431+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:15.489 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:15.482+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:15.489 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:15.483+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:15.826 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:15.820+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:15.920 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:15.911+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:16.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:16.021+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:16.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:16.101+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:16.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:16.259+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:16.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:16.467+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:16.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:16.510+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:16.518 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:16.511+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:16.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:16.872+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:16.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:16.939+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:17.012 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:17.005+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:17.087 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:17.080+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:17.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:17.276+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:17.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:17.437+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:17.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:17.550+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:17.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:17.553+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:17.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:17.833+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:17.968 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:17.960+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:18.040 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:18.032+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:18.130 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:18.122+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:18.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:18.317+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:18.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:18.415+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:18.576 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:18.569+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:18.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:18.571+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:18.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:18.873+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:18.931 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:18.923+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:19.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:18.995+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:19.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:19.102+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:19.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:19.298+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:19.389 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:19.381+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:19.608 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:19.601+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:19.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:19.603+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:19.898 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:19.892+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:19.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:19.892+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:19.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:19.950+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:20.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:20.129+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:20.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:20.310+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:20.355 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:20.347+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:20.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:20.564+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:20.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:20.566+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:20.882 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:20.874+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:20.939 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:20.932+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:20.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:20.944+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:21.162 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:21.154+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:21.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:21.280+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:21.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:21.365+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:21.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:21.598+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:21.607 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:21.601+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:21.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:21.865+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:21.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:21.889+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:21.945 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:21.937+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:22.172 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:22.165+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:22.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:22.295+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:22.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:22.367+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:22.597 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:22.591+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:22.599 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:22.593+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:22.865 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:22.857+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:22.938 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:22.931+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:22.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:22.951+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:23.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:23.146+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:23.274 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:23.267+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:23.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:23.340+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:23.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:23.562+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:23.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:23.565+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:23.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:23.846+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:23.920 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:23.913+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:23.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:23.921+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:24.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:24.131+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:24.314 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:24.300+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:24.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:24.367+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:24.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:24.577+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:24.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:24.581+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:24.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:24.808+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:24.962 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:24.955+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:24.972 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:24.965+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:25.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:25.182+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:25.266 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:25.259+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:25.409 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:25.401+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:25.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:25.608+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:25.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:25.609+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:25.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:25.806+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:25.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:25.952+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:25.970 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:25.962+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:26.182 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:26.175+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:26.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:26.237+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:26.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:26.439+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:26.634 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:26.626+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:26.636 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:26.630+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:26.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:26.820+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:26.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:26.990+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:27.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:26.996+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:27.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:27.201+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:27.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:27.253+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:27.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:27.432+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:27.593 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:27.585+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:27.594 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:27.587+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:27.781 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:27.775+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:27.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:27.972+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:27.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:27.990+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:28.219 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:28.211+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:28.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:28.244+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:28.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:28.436+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:28.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:28.620+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:28.628 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:28.621+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:28.827 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:28.819+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:28.977 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:28.970+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:28.991 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:28.984+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:29.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:29.234+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:29.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:29.261+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:29.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:29.459+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:29.675 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:29.668+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:29.678 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:29.672+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:29.849 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:29.842+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:29.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:29.982+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:30.030 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:30.023+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:30.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:30.227+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:30.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:30.253+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:30.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:30.498+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:30.695 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:30.687+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:30.696 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:30.690+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:30.842 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:30.835+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:31.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:31.018+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:31.061 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:31.054+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:31.248 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:31.242+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:31.252 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:31.244+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:31.539 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:31.532+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:31.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:31.739+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:31.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:31.741+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:31.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:31.807+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:32.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:32.017+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:32.047 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:32.034+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:32.228 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:32.220+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:32.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:32.234+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:32.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:32.532+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:32.790 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:32.782+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:32.792 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:32.786+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:32.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:32.809+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:32.999 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:32.991+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:33.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:32.996+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:33.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:33.203+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:33.289 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:33.281+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:33.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:33.511+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:33.751 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:33.744+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:33.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:33.747+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:33.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:33.786+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:33.989 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:33.982+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:34.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:34.028+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:34.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:34.226+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:34.273 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:34.264+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:34.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:34.555+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:34.721 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:32:34.710+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e578 v578) 2019-11-29T18:32:34.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:34.753+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:34.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:34.754+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:34.827 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:34.820+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:34.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:34.983+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:35.012 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:35.002+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:35.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:35.202+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:35.240 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:35.229+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:35.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:35.518+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:35.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:35.761+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:35.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:35.763+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:35.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:35.812+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:35.962 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:35.955+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:35.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:35.987+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:36.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:36.173+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:36.264 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:36.256+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:36.490 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:36.483+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:36.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:36.771+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:36.781 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:36.774+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:36.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:36.862+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:36.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:36.950+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:36.960 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:36.951+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:37.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:37.217+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:37.229 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:37.222+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:37.458 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:37.448+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:37.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:37.733+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:37.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:37.734+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:37.849 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:37.842+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:37.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:37.907+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:37.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:37.943+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:38.188 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:38.181+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:38.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:38.224+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:38.483 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:38.475+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:38.709 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:38.699+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:38.714 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:38.704+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:38.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:38.855+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:38.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:38.889+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:32:39.000 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:32:38.993+0000 1694c700 -1 osd.5 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:17.814786+0000 front 2019-11-29T18:31:17.838651+0000 (oldest deadline 2019-11-29T18:32:02.506582+0000) 2019-11-29T18:32:39.241 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:32:39.234+0000 1694c700 -1 osd.7 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:20.889148+0000 front 2019-11-29T18:31:20.879420+0000 (oldest deadline 2019-11-29T18:32:05.188717+0000) 2019-11-29T18:32:39.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:32:39.255+0000 1694c700 -1 osd.1 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.493069+0000 front 2019-11-29T18:31:21.562558+0000 (oldest deadline 2019-11-29T18:32:06.120823+0000) 2019-11-29T18:32:39.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:32:39.450+0000 1694c700 -1 osd.6 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.155804+0000 front 2019-11-29T18:31:18.194053+0000 (oldest deadline 2019-11-29T18:32:03.420395+0000) 2019-11-29T18:32:39.743 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:39.735+0000 1694c700 -1 osd.0 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:31:30.739549+0000 (oldest deadline 2019-11-29T18:32:10.739549+0000) 2019-11-29T18:32:39.744 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:32:39.737+0000 1694c700 -1 osd.0 578 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e576) 2019-11-29T18:32:39.796 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:32:39.791+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e578 v578) 2019-11-29T18:32:39.890 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:32:39.883+0000 1694c700 -1 osd.4 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:18.145592+0000 front 2019-11-29T18:31:18.161554+0000 (oldest deadline 2019-11-29T18:32:02.214774+0000) 2019-11-29T18:32:39.900 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:32:39.891+0000 1694c700 -1 osd.2 578 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:31:21.620451+0000 front 2019-11-29T18:31:21.708078+0000 (oldest deadline 2019-11-29T18:32:04.509273+0000) 2019-11-29T18:33:12.642 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:33:12.636+0000 34789700 -1 osd.3 578 build_incremental_map_msg missing incremental map 577 2019-11-29T18:34:17.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:17.000+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:17.996 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:17.989+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:18.972 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:18.963+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:19.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:19.153+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:19.430 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:19.420+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:20.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:19.998+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:20.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:20.106+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:20.398 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:20.388+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:20.624 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:20.616+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:20.936 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:20.929+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:20.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:20.945+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:21.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:20.999+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:21.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:21.160+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:21.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:21.429+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:21.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:21.526+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:21.605 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:21.597+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:21.915 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:21.908+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:21.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:21.908+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:22.000 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:21.992+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:22.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:22.133+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:22.452 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:22.440+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:22.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:22.486+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:22.656 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:22.649+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:22.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:22.926+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:22.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:22.946+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:22.988 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:22.978+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:23.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:23.150+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:23.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:23.454+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:23.514 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:23.506+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:23.634 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:23.626+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:23.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:23.888+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:23.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:23.975+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:23.998 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:23.990+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:24.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:24.152+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:24.454 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:24.446+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:24.484 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:24.475+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:24.599 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:24.591+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:24.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:24.923+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:25.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:25.015+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:25.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:25.021+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:25.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:25.157+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:25.434 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:25.426+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:25.443 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:25.435+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:25.577 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:25.569+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:25.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:25.881+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:25.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:25.991+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:26.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:26.018+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:26.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:26.197+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:26.430 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:26.422+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:26.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:26.485+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:26.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:26.579+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:26.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:26.841+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:27.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:27.009+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:27.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:27.069+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:27.168 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:27.154+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:27.394 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:27.386+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:27.516 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:27.507+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:27.620 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:27.612+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:27.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:27.877+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:28.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:28.002+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:28.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:28.050+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:28.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:28.133+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:28.350 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:28.343+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:28.529 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:28.520+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:28.669 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:28.661+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:28.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:28.891+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:28.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:28.984+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:29.020 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:29.013+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:29.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:29.138+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:29.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:29.379+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:29.510 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:29.503+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:29.663 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:29.655+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:29.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:29.936+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:30.014 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:30.006+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:30.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:30.014+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:30.193 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:30.186+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:30.364 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:30.355+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:30.518 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:30.507+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:30.627 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:30.619+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:30.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:30.982+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:31.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:31.035+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:31.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:31.040+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:31.155 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:31.147+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:31.385 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:31.378+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:31.487 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:31.481+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:31.620 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:31.613+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:31.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:31.974+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:32.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:32.025+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:32.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:32.060+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:32.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:32.141+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:32.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:32.381+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:32.499 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:32.492+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:32.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:32.572+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:33.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:32.995+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:33.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:33.019+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:33.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:33.033+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:33.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:33.192+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:33.391 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:33.384+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:33.492 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:33.484+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:33.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:33.527+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:33.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:33.958+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:34.024 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:34.016+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:34.089 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:34.081+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:34.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:34.189+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:34.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:34.394+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:34.476 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:34.468+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:34.536 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:34.526+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:34.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:34.951+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:34.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:34.974+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:35.108 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:35.097+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:35.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:35.177+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:35.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:35.441+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:35.489 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:35.482+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:35.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:35.486+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:35.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:35.965+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:36.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:36.026+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:36.082 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:36.074+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:36.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:36.192+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:36.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:36.471+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:36.516 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:36.509+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:36.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:36.509+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:36.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:36.957+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:36.996 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:36.988+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:37.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:37.043+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:37.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:37.227+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:37.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:37.478+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:37.518 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:37.510+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:37.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:37.529+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:37.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:37.977+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:38.001 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:37.995+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:38.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:38.090+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:38.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:38.221+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:38.486 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:38.478+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:38.506 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:38.497+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:38.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:38.548+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:38.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:38.938+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:39.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:39.028+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:39.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:39.126+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:39.225 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:39.217+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:39.488 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:39.482+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:39.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:39.483+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:39.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:39.531+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:39.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:39.912+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:40.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:40.062+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:40.113 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:40.106+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:40.220 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:40.213+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:40.466 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:40.458+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:40.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:40.528+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:40.552 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:40.544+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:40.940 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:40.933+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:41.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:41.061+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:41.118 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:41.107+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:41.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:41.225+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:41.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:41.417+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:41.501 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:41.494+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:41.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:41.578+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:41.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:41.935+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:42.088 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:42.079+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:42.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:42.124+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:42.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:42.219+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:42.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:42.404+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:42.473 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:42.466+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:42.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:42.603+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:42.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:42.947+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:43.076 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:43.067+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:43.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:43.143+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:43.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:43.230+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:43.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:43.436+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:43.481 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:43.474+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:43.626 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:43.618+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:43.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:43.921+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:44.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:44.031+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:44.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:44.146+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:44.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:44.240+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:44.400 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:44.392+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:44.525 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:44.518+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:44.665 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:44.657+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:44.941 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:44.933+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:45.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:45.034+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:45.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:45.169+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:45.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:45.257+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:45.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:45.389+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:45.514 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:45.507+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:45.700 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:45.693+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:45.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:45.979+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:46.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:46.082+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:46.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:46.161+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:46.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:46.226+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:46.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:46.379+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:46.550 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:46.540+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:46.695 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:46.688+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:46.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:46.956+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:47.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:47.046+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:47.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:47.207+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:47.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:47.235+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:47.408 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:47.399+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:47.547 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:47.540+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:47.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:47.645+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:47.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:47.974+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:48.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:48.018+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:48.256 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:48.248+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:48.274 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:48.267+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:48.405 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:48.396+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:48.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:48.525+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:48.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:48.614+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:48.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:48.938+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:49.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:49.063+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:49.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:49.232+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:49.326 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:49.318+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:49.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:49.414+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:34:49.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:34:49.537+0000 1694c700 -1 osd.3 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.833682+0000 front 2019-11-29T18:33:35.911387+0000 (oldest deadline 2019-11-29T18:34:20.501552+0000) 2019-11-29T18:34:49.675 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:34:49.667+0000 1694c700 -1 osd.2 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.988192+0000 front 2019-11-29T18:33:34.700199+0000 (oldest deadline 2019-11-29T18:34:20.575524+0000) 2019-11-29T18:34:49.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:34:49.967+0000 1694c700 -1 osd.1 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.696219+0000 front 2019-11-29T18:33:34.355492+0000 (oldest deadline 2019-11-29T18:34:20.213893+0000) 2019-11-29T18:34:50.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:34:50.047+0000 1694c700 -1 osd.5 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:32.049024+0000 front 2019-11-29T18:33:31.747239+0000 (oldest deadline 2019-11-29T18:34:17.000668+0000) 2019-11-29T18:34:50.247 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:34:50.238+0000 1694c700 -1 osd.6 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.593754+0000 front 2019-11-29T18:33:34.583117+0000 (oldest deadline 2019-11-29T18:34:20.253559+0000) 2019-11-29T18:34:50.322 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:34:50.316+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e583 v583) 2019-11-29T18:34:50.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:34:50.370+0000 1694c700 -1 osd.7 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:34.112164+0000 front 2019-11-29T18:33:34.408428+0000 (oldest deadline 2019-11-29T18:34:18.666936+0000) 2019-11-29T18:34:50.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:34:50.432+0000 1694c700 -1 osd.4 583 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:33:35.048159+0000 front 2019-11-29T18:33:34.787073+0000 (oldest deadline 2019-11-29T18:34:19.384493+0000) 2019-11-29T18:35:18.832 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:19:26.966 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:18.843 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:19:26.978 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:18.858 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:19:27.038 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:18.862 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:19:27.042 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:18.863 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:19:27.042 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:18.868 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:19:27.047 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:19.025 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:19:27.159 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:19.059 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:19:27.239 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:19.118 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:19:27.297 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:35:29.576 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:35:29.521+0000 34f8a700 -1 osd.3 588 build_incremental_map_msg missing incremental map 588 2019-11-29T18:35:48.931 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:48.924+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:49.165 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:49.157+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:49.735 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:49.726+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:49.963 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:49.955+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:50.146 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:50.138+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:50.635 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:50.627+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:50.726 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:50.718+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:51.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:51.003+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:51.191 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:51.181+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:51.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:51.383+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:51.679 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:51.672+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:51.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:51.695+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:51.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:51.907+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:51.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:51.967+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:52.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:52.202+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:52.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:52.438+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:52.670 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:52.663+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:52.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:52.683+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:52.901 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:52.895+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:52.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:52.965+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:53.176 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:53.169+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:53.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:53.404+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:53.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:53.675+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:53.730 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:53.722+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:53.898 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:53.889+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:53.965 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:53.959+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:54.198 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:54.190+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:54.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:54.399+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:54.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:54.631+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:54.747 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:54.740+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:54.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:54.874+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:55.009 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:55.002+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:55.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:55.201+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:55.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:55.437+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:55.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:55.675+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:55.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:55.726+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:55.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:55.876+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:56.000 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:55.992+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:56.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:35:56.166+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:35:56.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:56.219+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:56.497 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:56.490+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:56.712 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:56.705+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:56.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:56.778+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:56.892 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:56.884+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:57.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:57.037+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:57.163 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:35:57.157+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:35:57.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:57.227+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:57.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:57.479+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:57.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:57.746+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:57.759 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:57.752+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:57.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:57.844+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:58.050 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:58.043+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:58.194 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:35:58.186+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:35:58.286 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:58.279+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:58.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:58.434+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:58.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:58.792+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:58.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:58.804+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:58.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:58.895+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:35:59.033 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:35:59.016+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:35:59.154 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:35:59.148+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:35:59.307 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:35:59.300+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:35:59.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:35:59.423+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:35:59.769 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:35:59.762+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:35:59.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:35:59.775+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:35:59.867 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:35:59.861+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:00.061 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:00.054+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:00.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:00.191+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:00.352 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:00.346+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:00.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:00.407+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:00.743 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:00.735+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:00.756 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:00.748+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:00.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:00.908+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:01.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:01.046+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:01.233 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:01.226+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:01.359 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:01.352+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:01.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:01.415+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:01.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:01.731+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:01.762 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:01.754+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:01.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:01.907+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:02.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:02.004+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:02.206 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:02.199+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:02.354 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:02.347+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:02.425 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:02.418+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:02.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:02.717+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:02.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:02.799+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:02.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:02.895+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:02.971 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:02.964+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:03.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:03.203+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:03.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:03.206+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:03.333 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:03.326+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:03.416 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:03.408+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:03.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:03.761+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:03.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:03.798+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:03.856 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:03.849+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:03.960 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:03.953+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:04.196 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:04.187+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:04.197 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:04.190+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:04.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:04.328+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:04.410 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:04.401+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:04.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:04.743+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:04.811 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:04.803+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:04.839 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:04.832+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:05.015 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:05.006+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:05.216 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:05.207+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:05.218 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:05.211+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:05.320 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:05.313+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:05.416 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:05.409+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:05.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:05.769+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:05.796 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:05.788+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:05.863 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:05.856+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:06.030 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:06.023+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:06.217 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:06.209+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:06.218 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:06.211+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:06.298 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:06.290+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:06.461 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:06.454+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:06.802 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:06.793+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:06.805 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:06.798+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:06.839 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:06.832+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:07.058 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:07.051+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:07.211 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:07.203+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:07.214 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:07.207+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:07.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:07.332+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:07.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:07.473+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:07.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:07.792+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:07.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:07.803+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:07.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:07.817+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:08.087 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:08.079+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:08.199 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:08.191+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:08.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:08.193+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:08.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:08.338+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:08.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:08.440+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:08.786 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:08.779+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:08.790 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:08.783+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:08.803 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:08.796+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:09.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:09.107+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:09.235 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:09.227+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:09.235 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:09.229+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:09.355 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:09.347+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:09.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:09.464+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:09.781 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:09.773+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:09.812 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:09.806+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:09.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:09.847+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:10.074 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:10.067+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:10.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:10.257+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:10.267 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:10.259+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:10.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:10.364+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:10.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:10.424+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:10.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:10.758+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:10.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:10.831+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:10.867 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:10.859+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:11.039 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:11.032+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:11.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:11.255+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:11.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:11.257+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:11.349 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:11.342+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:11.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:11.434+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:11.755 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:11.749+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:11.848 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:11.841+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:11.872 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:11.865+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:12.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:12.023+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:12.239 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:12.231+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:12.240 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:12.233+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:12.306 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:12.299+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:12.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:12.439+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:12.763 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:12.756+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:12.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:12.858+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:12.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:12.873+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:12.998 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:12.991+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:13.242 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:13.236+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:13.244 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:13.238+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:13.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:13.307+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:13.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:13.427+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:13.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:13.801+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:13.908 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:13.901+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:13.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:13.903+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:14.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:14.022+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:14.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:14.260+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:14.268 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:14.262+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:14.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:14.288+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:14.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:14.397+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:14.834 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:14.826+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:14.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:14.874+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:14.890 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:14.883+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:14.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:14.979+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:15.315 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:15.309+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:15.317 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:15.310+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:15.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:15.312+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:15.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:15.410+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:15.842 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:15.835+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:15.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:15.846+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:15.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:15.859+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:15.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:15.965+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:16.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:16.318+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:16.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:16.319+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:16.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:16.336+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:16.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:16.432+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:16.879 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:16.871+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:16.890 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:16.883+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:16.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:16.906+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:16.944 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:16.937+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:17.304 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:17.297+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:17.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:17.343+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:17.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:17.344+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:17.441 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:17.435+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:17.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:17.870+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:17.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:17.894+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:17.904 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:17.897+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:17.935 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:17.924+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:18.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:18.277+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:18.348 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:18.341+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:18.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:18.344+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:18.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:18.478+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:18.907 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:18.899+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:18.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:18.917+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:18.930 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:18.923+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:18.980 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:18.971+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:19.264 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:19.258+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:19.401 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:19.393+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:19.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:19.395+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:19.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:19.526+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:19.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:19.944+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:19.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:19.948+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:19.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:19.948+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:19.958 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:19.951+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:20.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:20.219+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:20.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:20.433+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:20.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:20.435+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:20.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:20.521+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:20.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:20.906+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:20.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:20.930+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:20.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:20.968+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:20.993 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:20.986+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:21.227 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:21.219+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:21.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:21.441+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:21.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:21.443+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:21.497 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:21.490+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:21.940 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:21.933+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:21.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:21.937+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:21.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:21.942+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:21.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:21.962+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:22.242 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:22.234+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:22.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:22.398+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:22.408 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:22.402+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:22.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:22.495+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:22.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:22.906+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:22.944 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:22.937+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:22.963 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:22.956+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:22.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:22.962+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:23.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:23.258+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:23.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:23.424+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:23.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:23.426+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:23.461 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:23.452+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:23.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:23.873+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:23.904 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:23.897+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:23.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:23.975+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:24.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:24.001+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:24.288 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:24.280+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:24.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:24.405+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:24.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:24.409+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:24.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:24.503+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:24.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:24.858+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:24.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:24.940+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:24.952 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:24.942+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:25.009 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:25.002+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:25.319 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:25.311+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:25.444 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:25.428+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:25.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:25.431+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:25.527 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:25.520+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:25.699 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:36:25.692+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e589 v589) 2019-11-29T18:36:25.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:25.850+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:25.941 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:25.926+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:25.983 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:25.976+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:25.994 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:25.987+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:26.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:26.359+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:26.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:26.481+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:26.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:26.483+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:26.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:26.545+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:26.847 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:26.840+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:26.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:26.913+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:26.989 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:26.982+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:26.993 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:26.987+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:27.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:27.357+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:27.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:27.473+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:27.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:27.476+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:27.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:27.588+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:27.882 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:27.875+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:27.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:27.916+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:27.988 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:27.981+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:28.043 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:28.035+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:28.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:28.350+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:28.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:28.499+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:28.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:28.503+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:28.640 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:28.631+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:28.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:28.876+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:28.956 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:28.947+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:28.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:28.960+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:29.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:29.030+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:29.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:29.377+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:29.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:29.550+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:29.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:29.552+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:29.617 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:29.596+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:29.874 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:29.866+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:29.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:29.942+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:29.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:29.975+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:29.992 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:29.985+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:30.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:30.338+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:30.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:30.566+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:30.576 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:30.568+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:30.615 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:30.606+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:30.716 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:36:30.705+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e589 v589) 2019-11-29T18:36:30.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:30.870+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:30.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:30.954+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:31.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:31.017+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:31.035 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:31.027+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:31.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:31.385+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:31.608 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:31.600+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:31.609 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:31.602+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:31.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:31.642+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:31.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:31.839+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:31.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:31.942+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:31.994 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:31.986+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:32.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:32.057+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:32.373 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:32.366+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:32.635 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:32.626+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:32.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:32.650+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:32.658 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:32.651+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:32.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:32.851+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:32.949 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:32.941+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:32.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:32.987+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:33.092 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:33.084+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:33.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:33.392+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:33.614 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:33.606+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:33.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:33.620+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:33.636 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:33.629+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:33.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:33.838+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:34.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:33.993+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:34.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:34.010+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:34.100 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:34.091+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:34.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:34.391+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:34.635 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:34.622+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:34.692 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:34.684+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:34.703 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:34.686+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:34.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:34.838+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:35.008 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:34.999+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:35.022 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:36:35.013+0000 1694c700 -1 osd.7 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:07.255856+0000 front 2019-11-29T18:35:07.311133+0000 (oldest deadline 2019-11-29T18:35:49.337168+0000) 2019-11-29T18:36:35.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:36:35.070+0000 1694c700 -1 osd.1 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.953928+0000 front 2019-11-29T18:35:05.953162+0000 (oldest deadline 2019-11-29T18:35:51.233089+0000) 2019-11-29T18:36:35.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:36:35.383+0000 1694c700 -1 osd.2 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.257903+0000 front 2019-11-29T18:35:04.862062+0000 (oldest deadline 2019-11-29T18:35:48.300811+0000) 2019-11-29T18:36:35.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:36:35.612+0000 1694c700 -1 osd.6 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.186927+0000 front 2019-11-29T18:35:05.219649+0000 (oldest deadline 2019-11-29T18:35:51.001687+0000) 2019-11-29T18:36:35.689 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:35.681+0000 1694c700 -1 osd.0 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:35:22.777911+0000 (oldest deadline 2019-11-29T18:36:02.777911+0000) 2019-11-29T18:36:35.691 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:36:35.685+0000 1694c700 -1 osd.0 589 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e587) 2019-11-29T18:36:35.877 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:36:35.870+0000 1694c700 -1 osd.5 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:04.516457+0000 front 2019-11-29T18:35:04.536053+0000 (oldest deadline 2019-11-29T18:35:50.364523+0000) 2019-11-29T18:36:35.880 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:36:35.789+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e589 v589) 2019-11-29T18:36:36.022 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:36.014+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:36:37.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:36:37.008+0000 1694c700 -1 osd.4 589 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:35:05.827959+0000 front 2019-11-29T18:35:05.756732+0000 (oldest deadline 2019-11-29T18:35:48.627838+0000) 2019-11-29T18:37:03.263 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:37:03.250+0000 34f8a700 -1 osd.3 595 build_incremental_map_msg missing incremental map 595 2019-11-29T18:37:03.314 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:37:03.307+0000 37f90700 -1 osd.3 595 build_incremental_map_msg missing incremental map 595 2019-11-29T18:37:03.919 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:37:03.835+0000 3578b700 -1 osd.3 595 build_incremental_map_msg missing incremental map 595 2019-11-29T18:37:04.405 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:37:04.388+0000 30f82700 -1 osd.3 595 build_incremental_map_msg missing incremental map 595 2019-11-29T18:38:02.762 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:02.752+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:03.052 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:03.043+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:03.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:03.616+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:03.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:03.737+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:03.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:03.937+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:04.061 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:04.052+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:04.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:04.659+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:04.784 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:04.775+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:04.960 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:04.952+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:05.035 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:05.026+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:05.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:05.247+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:05.462 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:05.454+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:05.624 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:05.616+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:05.831 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:05.823+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:05.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:05.965+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:06.014 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:06.002+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:06.170 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:06.161+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:06.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:06.242+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:06.436 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:06.427+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:06.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:06.629+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:06.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:06.843+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:06.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:06.966+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:07.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:07.033+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:07.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:07.208+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:07.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:07.257+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:07.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:07.430+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:07.689 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:07.668+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:07.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:07.857+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:07.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:07.945+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:08.028 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:08.022+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:08.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:08.192+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:08.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:08.217+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:08.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:08.456+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:08.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:08.700+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:08.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:08.905+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:08.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:08.923+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:09.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:09.062+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:09.173 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:09.167+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:09.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:09.192+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:09.416 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:09.408+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:09.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:09.725+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:09.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:09.879+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:09.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:09.925+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:10.087 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:10.080+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:10.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:10.154+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:10.165 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:10.158+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:10.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:10.455+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:10.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:10.712+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:10.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:10.837+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:10.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:10.904+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:11.123 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:11.114+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:11.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:11.166+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:11.178 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:11.169+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:11.485 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:11.476+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:11.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:11.699+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:11.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:11.859+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:11.903 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:11.895+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:12.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:12.134+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:12.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:12.154+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:12.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:12.210+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:12.506 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:12.499+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:12.720 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:12.713+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:12.851 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:12.844+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:12.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:12.944+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:13.135 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:13.128+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:13.198 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:13.191+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:13.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:13.227+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:13.477 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:13.467+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:13.724 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:13.716+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:13.855 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:13.847+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:13.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:13.928+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:14.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:14.090+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:14.230 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:14.223+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:14.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:14.249+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:14.490 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:14.482+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:14.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:14.678+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:14.868 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:14.860+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:14.933 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:14.925+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:15.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:15.082+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:15.247 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:15.240+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:15.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:15.244+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:15.512 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:15.505+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:15.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:15.710+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:15.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:15.889+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:15.916 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:15.910+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:16.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:16.089+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:16.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:16.224+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:16.248 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:16.241+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:16.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:16.527+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:16.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:16.691+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:16.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:16.929+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:16.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:16.934+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:17.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:17.094+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:17.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:17.214+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:17.222 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:17.214+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:17.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:17.521+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:17.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:17.741+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:17.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:17.899+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:17.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:17.923+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:18.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:18.074+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:18.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:18.216+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:18.284 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:18.272+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:18.503 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:18.495+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:18.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:18.736+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:18.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:18.884+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:18.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:18.920+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:19.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:19.099+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:19.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:19.247+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:19.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:19.267+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:19.470 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:19.462+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:19.747 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:19.740+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:19.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:19.897+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:19.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:19.924+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:20.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:20.099+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:20.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:20.230+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:20.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:20.253+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:20.436 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:20.429+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:20.755 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:20.747+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:20.909 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:20.901+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:20.919 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:20.912+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:21.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:21.149+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:21.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:21.232+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:21.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:21.289+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:21.445 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:21.438+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:21.796 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:21.786+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:21.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:21.861+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:21.934 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:21.927+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:22.165 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:22.159+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:22.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:22.251+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:22.342 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:22.335+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:22.487 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:22.481+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:22.828 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:22.821+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:22.889 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:22.881+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:22.980 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:22.972+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:23.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:23.194+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:23.267 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:23.260+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:23.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:23.296+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:23.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:23.440+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:23.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:23.830+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:23.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:23.927+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:24.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:24.019+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:24.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:24.159+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:24.260 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:24.252+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:24.277 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:24.270+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:24.455 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:24.446+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:24.871 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:24.863+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:24.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:24.911+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:25.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:25.048+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:25.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:25.127+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:25.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:25.275+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:25.295 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:25.288+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:25.432 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:25.423+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:25.835 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:25.828+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:25.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:25.929+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:26.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:26.081+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:26.147 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:26.140+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:26.286 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:26.279+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:26.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:26.324+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:26.444 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:26.436+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:26.815 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:26.807+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:26.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:26.929+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:27.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:27.119+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:27.159 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:27.152+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:27.246 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:27.238+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:27.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:27.324+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:27.455 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:27.447+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:27.832 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:27.825+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:27.974 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:27.966+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:28.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:28.130+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:28.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:28.149+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:28.278 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:28.270+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:28.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:28.354+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:28.433 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:28.425+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:28.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:28.847+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:28.956 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:28.949+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:29.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:29.083+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:29.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:29.162+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:29.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:29.322+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:29.333 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:29.324+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:29.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:29.478+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:29.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:29.865+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:30.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:30.004+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:30.140 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:30.134+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:30.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:30.202+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:30.294 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:30.284+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:30.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:30.328+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:30.507 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:30.500+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:30.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:30.836+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:30.988 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:30.979+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:31.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:31.151+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:31.226 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:31.218+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:31.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:31.277+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:31.333 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:31.327+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:31.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:31.511+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:31.868 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:31.860+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:31.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:31.950+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:32.152 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:32.145+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:32.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:32.217+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:32.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:32.257+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:32.362 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:32.354+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:32.550 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:32.544+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:32.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:32.860+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:32.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:32.917+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:33.139 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:33.131+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:33.219 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:33.212+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:33.249 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:33.241+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:33.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:33.324+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:33.523 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:33.516+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:33.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:33.908+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:33.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:33.955+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:34.152 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:34.144+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:34.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:34.205+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:34.258 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:34.251+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:34.310 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:34.304+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:34.512 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:34.505+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:34.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:34.906+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:34.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:34.950+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:35.181 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:35.173+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:35.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:35.228+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:35.252 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:35.244+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:35.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:35.278+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:35.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:35.547+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:38:35.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:38:35.868+0000 1694c700 -1 osd.1 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.611497+0000 front 2019-11-29T18:37:21.243320+0000 (oldest deadline 2019-11-29T18:38:03.356694+0000) 2019-11-29T18:38:35.922 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:38:35.914+0000 1694c700 -1 osd.5 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.506805+0000 front 2019-11-29T18:37:19.394321+0000 (oldest deadline 2019-11-29T18:38:02.283015+0000) 2019-11-29T18:38:36.163 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:38:36.155+0000 1694c700 -1 osd.2 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.374528+0000 front 2019-11-29T18:37:21.620838+0000 (oldest deadline 2019-11-29T18:38:06.034217+0000) 2019-11-29T18:38:36.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:38:36.216+0000 1694c700 -1 osd.6 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:20.010695+0000 front 2019-11-29T18:37:19.971833+0000 (oldest deadline 2019-11-29T18:38:03.400359+0000) 2019-11-29T18:38:36.282 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:38:36.275+0000 1694c700 -1 osd.4 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.017472+0000 front 2019-11-29T18:37:19.328520+0000 (oldest deadline 2019-11-29T18:38:02.196746+0000) 2019-11-29T18:38:36.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:38:36.330+0000 1694c700 -1 osd.7 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:19.282069+0000 front 2019-11-29T18:37:19.307121+0000 (oldest deadline 2019-11-29T18:38:04.560975+0000) 2019-11-29T18:38:36.337 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:38:36.327+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e596 v596) 2019-11-29T18:38:36.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:38:36.579+0000 1694c700 -1 osd.3 596 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:37:21.158867+0000 front 2019-11-29T18:37:21.184089+0000 (oldest deadline 2019-11-29T18:38:04.874699+0000) 2019-11-29T18:39:10.079 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:23:18.213 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.083 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:23:18.218 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.102 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:23:18.282 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.103 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:23:18.282 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.108 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:23:18.286 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.115 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:23:18.288 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.340 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:23:18.474 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.414 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:23:18.593 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:10.463 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:23:18.639 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:39:13.077 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:39:13.036+0000 32785700 -1 osd.3 601 build_incremental_map_msg missing incremental map 600 2019-11-29T18:39:34.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:34.680+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:35.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:35.063+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:35.316 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:35.308+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:35.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:35.714+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:35.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:35.965+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:36.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:36.078+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:36.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:36.335+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:36.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:36.760+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:36.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:36.985+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:37.123 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:37.115+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:37.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:37.363+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:37.799 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:37.790+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:37.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:37.966+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:38.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:38.027+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:38.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:38.034+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:38.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:38.109+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:38.376 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:38.369+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:38.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:38.795+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:38.982 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:38.975+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:39.074 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:39.066+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:39.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:39.081+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:39.167 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:39.160+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:39.400 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:39.389+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:39.804 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:39.796+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:39.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:39.966+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:40.043 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:40.036+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:40.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:40.069+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:40.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:40.209+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:40.377 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:40.370+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:40.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:40.805+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:41.013 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:41.006+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:41.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:41.036+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:41.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:41.042+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:41.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:41.201+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:41.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:41.374+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:41.467 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:41.461+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:41.854 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:41.846+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:42.026 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:42.018+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:42.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:42.029+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:42.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:42.040+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:42.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:42.237+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:42.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:42.420+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:42.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:42.462+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:42.822 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:42.815+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:42.984 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:42.978+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:43.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:43.047+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:43.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:43.058+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:43.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:43.193+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:43.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:43.381+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:43.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:43.507+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:43.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:43.863+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:43.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:43.978+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:44.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:44.021+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:44.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:44.092+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:44.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:44.212+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:44.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:44.343+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:44.512 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:44.505+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:44.918 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:44.911+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:44.946 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:44.939+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:45.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:45.054+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:45.116 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:45.109+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:45.236 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:45.228+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:45.314 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:45.306+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:45.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:45.518+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:45.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:45.946+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:45.958 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:45.951+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:46.039 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:46.032+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:46.147 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:46.141+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:46.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:46.225+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:46.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:46.311+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:46.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:46.570+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:46.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:46.961+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:46.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:46.961+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:47.055 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:47.047+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:47.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:47.152+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:47.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:47.203+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:47.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:47.298+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:47.569 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:47.563+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:47.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:47.964+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:47.996 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:47.989+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:48.038 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:48.031+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:48.189 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:48.182+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:48.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:48.204+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:48.286 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:48.279+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:48.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:48.556+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:48.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:48.981+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:48.995 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:48.988+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:49.032 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:49.025+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:49.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:49.175+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:49.191 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:49.184+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:49.279 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:49.272+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:49.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:49.581+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:49.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:49.582+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:49.948 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:49.941+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:50.032 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:50.025+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:50.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:50.039+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:50.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:50.163+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:50.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:50.230+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:50.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:50.233+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:50.600 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:50.592+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:50.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:50.598+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:50.965 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:50.958+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:51.036 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:51.028+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:51.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:51.075+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:51.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:51.147+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:51.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:51.240+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:51.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:51.282+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:51.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:51.572+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:51.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:51.574+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:51.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:51.975+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:52.022 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:52.008+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:52.083 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:52.076+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:52.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:52.129+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:52.239 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:52.233+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:52.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:52.313+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:52.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:52.619+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:52.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:52.620+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:53.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:52.999+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:53.008 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:53.001+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:53.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:53.101+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:53.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:53.116+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:53.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:53.278+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:53.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:53.314+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:53.662 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:53.655+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:53.664 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:53.659+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:54.020 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:54.014+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:54.059 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:54.050+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:54.087 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:54.078+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:54.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:54.162+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:54.306 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:54.297+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:54.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:54.364+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:54.625 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:54.617+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:54.626 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:54.619+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:55.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:55.009+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:55.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:55.023+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:55.097 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:55.090+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:55.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:55.150+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:55.331 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:55.325+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:55.382 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:55.375+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:55.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:55.612+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:55.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:55.614+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:56.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:56.006+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:56.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:56.063+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:56.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:56.083+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:56.178 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:56.171+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:56.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:56.304+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:56.387 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:56.379+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:56.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:56.606+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:56.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:56.608+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:57.045 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:57.038+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:57.067 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:57.060+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:57.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:57.067+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:57.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:57.149+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:57.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:57.354+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:57.419 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:57.412+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:57.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:57.612+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:57.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:57.614+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:58.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:58.053+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:58.073 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:58.065+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:58.097 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:58.090+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:58.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:58.189+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:58.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:58.373+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:58.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:58.383+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:58.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:58.579+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:58.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:58.582+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:39:59.046 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:39:59.038+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:39:59.073 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:39:59.066+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:39:59.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:39:59.076+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:39:59.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:39:59.159+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:39:59.429 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:39:59.421+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:39:59.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:39:59.424+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:39:59.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:59.556+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:39:59.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:39:59.559+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:00.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:00.050+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:00.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:00.090+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:00.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:00.095+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:00.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:00.154+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:00.402 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:00.395+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:00.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:00.440+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:00.567 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:00.558+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:00.567 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:00.560+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:01.055 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:01.048+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:01.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:01.066+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:01.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:01.091+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:01.119 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:01.112+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:01.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:01.362+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:01.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:01.424+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:01.582 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:01.575+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:01.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:01.576+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:02.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:02.033+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:02.067 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:02.059+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:02.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:02.118+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:02.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:02.151+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:02.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:02.336+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:02.455 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:02.448+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:02.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:02.572+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:02.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:02.573+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:03.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:03.063+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:03.075 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:03.062+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:03.105 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:03.095+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:03.213 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:03.201+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:03.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:03.342+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:03.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:03.431+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:03.617 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:03.611+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:03.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:03.613+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:04.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:04.061+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:04.080 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:04.074+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:04.105 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:04.096+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:04.231 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:04.225+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:04.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:04.325+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:04.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:04.441+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:04.591 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:04.585+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:04.593 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:04.588+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:05.097 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:05.088+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:05.100 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:05.089+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:05.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:05.114+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:05.243 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:05.226+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:05.362 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:05.355+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:05.423 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:05.415+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:05.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:05.569+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:05.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:05.570+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:06.081 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:06.074+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:06.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:06.093+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:06.123 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:06.115+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:06.246 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:06.237+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:06.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:06.368+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:06.401 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:06.393+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:06.608 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:06.600+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:06.609 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:06.602+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:07.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:07.102+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:07.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:07.105+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:07.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:07.162+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:07.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:07.295+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:07.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:07.374+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:07.389 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:07.377+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:07.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:07.607+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:07.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:07.608+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:08.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:08.095+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:08.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:08.104+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:08.205 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:08.198+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:08.298 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:08.291+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:08.425 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:08.418+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:08.435 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:08.425+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:08.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:08.598+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:08.606 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:08.600+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:09.109 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:09.101+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:09.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:09.141+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:09.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:09.172+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:09.290 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:09.283+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:09.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:09.406+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:09.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:09.419+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:09.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:09.597+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:09.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:09.598+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:10.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:10.064+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:10.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:10.172+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:10.231 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:10.223+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:10.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:10.267+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:10.384 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:10.376+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:10.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:10.451+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:10.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:10.633+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:10.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:10.636+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:11.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:11.100+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:11.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:11.181+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:11.236 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:11.228+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:11.307 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:11.300+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:11.390 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:11.383+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:11.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:11.407+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:11.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:11.607+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:11.616 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:11.610+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:11.715 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:40:11.709+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e601 v601) 2019-11-29T18:40:12.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:12.057+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:12.160 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:12.152+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:12.194 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:12.186+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:12.323 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:12.315+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:12.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:12.371+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:12.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:12.434+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:12.645 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:12.636+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:12.645 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:12.638+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:13.088 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:13.080+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:13.159 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:13.152+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:13.214 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:13.205+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:13.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:13.349+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:13.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:13.410+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:13.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:13.420+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:13.669 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:13.661+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:13.670 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:13.664+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:14.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:14.110+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:14.125 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:14.118+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:14.202 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:14.195+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:14.391 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:14.383+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:14.422 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:14.414+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:14.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:14.473+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:14.665 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:14.657+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:14.665 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:14.659+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:15.085 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:15.073+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:15.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:15.126+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:15.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:15.217+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:15.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:15.344+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:15.387 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:15.376+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:15.505 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:15.499+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:15.689 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:15.683+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:15.691 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:15.685+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:16.083 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:16.075+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:16.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:16.157+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:16.233 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:16.225+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:16.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:16.359+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:16.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:16.382+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:16.521 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:16.514+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:16.731 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:40:16.723+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e601 v601) 2019-11-29T18:40:16.735 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:16.728+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:16.736 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:16.730+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:17.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:17.123+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:17.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:17.172+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:17.254 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:17.246+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:17.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:17.361+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:17.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:17.390+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:17.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:17.564+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:17.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:17.781+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:17.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:17.788+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:18.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:18.075+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:18.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:18.152+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:18.296 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:18.287+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:18.418 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:18.409+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:18.443 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:18.435+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:18.562 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:18.554+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:18.836 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:18.826+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:18.836 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:18.829+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:19.054 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:19.048+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:19.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:19.149+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:19.292 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:19.284+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:19.374 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:19.366+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:19.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:19.389+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:19.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:19.527+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:19.868 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:19.859+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:19.869 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:19.861+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:20.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:20.071+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:20.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:20.132+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:20.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:20.259+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:20.351 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:20.343+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:20.389 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:20.380+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:20.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:20.484+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:20.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:20.897+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:20.906 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:20.900+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:21.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:40:21.063+0000 1694c700 -1 osd.1 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.644299+0000 front 2019-11-29T18:38:53.657079+0000 (oldest deadline 2019-11-29T18:39:35.159952+0000) 2019-11-29T18:40:21.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:40:21.182+0000 1694c700 -1 osd.7 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.316676+0000 front 2019-11-29T18:38:53.336381+0000 (oldest deadline 2019-11-29T18:39:37.992161+0000) 2019-11-29T18:40:21.233 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:40:21.220+0000 1694c700 -1 osd.6 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.400766+0000 front 2019-11-29T18:38:50.385670+0000 (oldest deadline 2019-11-29T18:39:34.416582+0000) 2019-11-29T18:40:21.401 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:21.387+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:21.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:21.409+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:21.471 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:40:21.463+0000 1694c700 -1 osd.2 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:51.537762+0000 front 2019-11-29T18:38:51.509407+0000 (oldest deadline 2019-11-29T18:39:34.382884+0000) 2019-11-29T18:40:21.827 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:40:21.817+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e601 v601) 2019-11-29T18:40:21.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:21.916+0000 1694c700 -1 osd.0 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:39:08.740532+0000 (oldest deadline 2019-11-29T18:39:48.740532+0000) 2019-11-29T18:40:21.945 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:40:21.918+0000 1694c700 -1 osd.0 601 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e600) 2019-11-29T18:40:22.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:40:22.352+0000 1694c700 -1 osd.4 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:53.424378+0000 front 2019-11-29T18:38:53.413285+0000 (oldest deadline 2019-11-29T18:39:37.388959+0000) 2019-11-29T18:40:22.379 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:40:22.372+0000 1694c700 -1 osd.5 601 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:38:50.437764+0000 front 2019-11-29T18:38:50.569736+0000 (oldest deadline 2019-11-29T18:39:34.514371+0000) 2019-11-29T18:40:27.008 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:24:35.143 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.014 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:24:35.148 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.051 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:24:35.230 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.057 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:24:35.235 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.063 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:24:35.243 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.083 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:24:35.263 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.160 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:24:35.295 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.175 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:24:35.353 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:40:27.210 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:24:35.390 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:41:47.524 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:47.517+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:47.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:47.783+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:48.479 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:48.472+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:48.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:48.759+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:49.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:49.003+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:49.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:49.169+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:49.438 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:49.431+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:49.796 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:49.787+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:49.984 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:49.975+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:50.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:50.125+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:50.413 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:50.406+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:50.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:50.784+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:50.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:50.817+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:51.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:51.023+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:51.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:51.047+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:51.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:51.055+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:51.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:51.168+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:51.424 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:51.416+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:51.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:51.758+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:51.858 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:51.850+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:52.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:52.010+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:52.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:52.029+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:52.064 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:52.056+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:52.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:52.151+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:52.383 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:52.377+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:52.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:52.747+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:52.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:52.870+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:52.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:52.978+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:52.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:52.987+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:53.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:53.062+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:53.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:53.197+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:53.348 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:53.341+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:53.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:53.786+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:53.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:53.900+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:53.989 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:53.982+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:54.033 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:54.024+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:54.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:54.041+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:54.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:54.228+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:54.398 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:54.392+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:54.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:54.832+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:54.951 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:54.944+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:54.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:54.953+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:55.020 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:55.013+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:55.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:55.074+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:55.223 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:55.216+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:55.367 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:55.360+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:55.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:55.823+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:55.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:55.902+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:55.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:55.962+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:56.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:56.026+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:56.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:56.123+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:56.236 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:56.228+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:56.403 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:56.395+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:56.830 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:56.819+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:56.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:56.921+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:56.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:56.945+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:57.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:57.049+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:57.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:57.110+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:57.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:57.257+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:57.388 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:57.380+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:57.796 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:57.789+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:57.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:57.879+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:57.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:57.957+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:58.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:58.041+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:58.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:58.140+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:58.310 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:58.303+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:58.367 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:58.360+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:58.830 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:58.822+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:58.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:58.879+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:59.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:58.998+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:41:59.030 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:59.023+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:59.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:41:59.122+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:41:59.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:41:59.322+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:41:59.368 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:41:59.361+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:41:59.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:41:59.859+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:41:59.909 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:41:59.902+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:41:59.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:41:59.989+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:41:59.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:41:59.987+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:00.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:00.143+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:00.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:00.314+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:00.402 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:00.394+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:00.915 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:00.907+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:00.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:00.936+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:00.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:00.981+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:01.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:00.995+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:01.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:01.143+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:01.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:01.297+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:01.425 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:01.419+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:01.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:01.886+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:01.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:01.955+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:01.965 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:01.958+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:01.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:01.971+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:02.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:02.099+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:02.341 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:02.328+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:02.400 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:02.393+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:02.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:02.893+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:02.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:02.941+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:03.008 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:03.000+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:03.030 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:03.023+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:03.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:03.084+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:03.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:03.287+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:03.417 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:03.410+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:03.892 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:03.884+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:03.940 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:03.932+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:04.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:04.042+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:04.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:04.061+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:04.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:04.063+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:04.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:04.255+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:04.429 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:04.422+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:04.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:04.906+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:04.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:04.919+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:05.025 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:05.017+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:05.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:05.096+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:05.111 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:05.103+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:05.223 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:05.214+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:05.453 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:05.442+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:05.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:05.876+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:05.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:05.942+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:06.023 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:06.016+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:06.072 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:06.064+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:06.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:06.070+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:06.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:06.171+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:06.480 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:06.473+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:06.936 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:06.921+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:06.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:06.930+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:07.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:07.052+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:07.106 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:07.099+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:07.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:07.108+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:07.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:07.179+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:07.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:07.483+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:07.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:07.955+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:07.974 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:07.968+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:08.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:08.048+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:08.073 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:08.066+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:08.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:08.112+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:08.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:08.160+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:08.455 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:08.446+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:08.931 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:08.924+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:08.973 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:08.965+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:09.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:09.068+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:09.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:09.089+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:09.102 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:09.093+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:09.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:09.171+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:09.477 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:09.471+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:09.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:09.914+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:09.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:09.939+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:10.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:10.093+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:10.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:10.099+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:10.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:10.140+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:10.220 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:10.212+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:10.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:10.509+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:10.929 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:10.921+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:10.956 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:10.948+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:11.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:11.097+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:11.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:11.098+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:11.182 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:11.174+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:11.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:11.254+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:11.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:11.523+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:11.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:11.904+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:11.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:11.926+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:12.113 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:12.103+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:12.146 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:12.138+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:12.202 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:12.194+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:12.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:12.230+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:12.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:12.533+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:12.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:12.909+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:12.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:12.936+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:13.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:13.125+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:13.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:13.129+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:13.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:13.232+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:13.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:13.242+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:13.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:13.535+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:13.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:13.965+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:13.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:13.970+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:14.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:14.137+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:14.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:14.168+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:14.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:14.195+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:14.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:14.246+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:14.508 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:14.500+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:14.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:14.922+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:15.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:14.993+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:15.166 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:15.158+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:15.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:15.179+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:15.194 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:15.187+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:15.255 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:15.247+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:15.549 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:15.542+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:15.931 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:15.923+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:16.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:16.041+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:16.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:16.148+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:16.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:16.168+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:16.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:16.208+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:16.289 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:16.282+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:16.564 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:16.556+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:16.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:16.913+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:17.021 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:17.013+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:17.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:17.143+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:17.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:17.152+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:17.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:17.188+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:17.325 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:17.317+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:17.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:17.584+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:17.948 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:17.941+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:17.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:17.982+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:18.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:18.155+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:18.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:18.173+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:18.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:18.224+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:18.295 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:18.287+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:18.604 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:18.596+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:18.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:18.940+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:18.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:18.987+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:19.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:19.136+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:19.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:19.155+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:19.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:19.243+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:19.287 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:19.280+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:19.653 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:19.645+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:19.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:19.951+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:19.989 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:19.981+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:20.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:20.109+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:20.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:20.166+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:20.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:20.212+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:20.305 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:20.298+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:20.703 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:20.695+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:20.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:20.981+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:21.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:21.033+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:21.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:21.120+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:21.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:21.169+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:21.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:21.257+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:21.275 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:21.267+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:21.752 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:42:21.746+0000 1694c700 -1 osd.3 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.281338+0000 front 2019-11-29T18:41:05.078891+0000 (oldest deadline 2019-11-29T18:41:47.136896+0000) 2019-11-29T18:42:22.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:42:21.996+0000 1694c700 -1 osd.1 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.098491+0000 front 2019-11-29T18:41:05.080148+0000 (oldest deadline 2019-11-29T18:41:49.962924+0000) 2019-11-29T18:42:22.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:42:22.060+0000 1694c700 -1 osd.4 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:02.026787+0000 front 2019-11-29T18:41:02.031335+0000 (oldest deadline 2019-11-29T18:41:47.306798+0000) 2019-11-29T18:42:22.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:42:22.089+0000 1694c700 -1 osd.6 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.612915+0000 front 2019-11-29T18:41:05.748873+0000 (oldest deadline 2019-11-29T18:41:50.283318+0000) 2019-11-29T18:42:22.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:42:22.207+0000 1694c700 -1 osd.7 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:03.296652+0000 front 2019-11-29T18:41:03.108769+0000 (oldest deadline 2019-11-29T18:41:48.979652+0000) 2019-11-29T18:42:22.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:42:22.225+0000 1694c700 -1 osd.5 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:05.111391+0000 front 2019-11-29T18:41:04.858685+0000 (oldest deadline 2019-11-29T18:41:50.135227+0000) 2019-11-29T18:42:22.271 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:42:22.264+0000 1694c700 -1 osd.2 607 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:41:04.049382+0000 front 2019-11-29T18:41:04.681901+0000 (oldest deadline 2019-11-29T18:41:48.298159+0000) 2019-11-29T18:42:22.458 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:42:22.441+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e607 v607) 2019-11-29T18:43:06.347 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:14.481 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.361 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:14.491 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.362 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:14.542 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.366 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:14.546 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.381 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:14.556 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.385 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:14.564 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.543 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:14.722 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.599 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:14.734 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:06.618 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:14.798 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:20.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:20.564+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:21.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:21.172+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:21.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:21.549+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:21.591 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:21.583+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:22.209 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:22.199+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:22.509 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:22.502+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:22.533 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:22.526+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:22.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:22.569+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:23.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:23.145+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:23.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:23.242+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:23.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:23.529+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:23.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:23.535+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:23.577 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:23.570+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:23.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:23.979+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:24.200 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:24.192+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:24.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:24.231+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:24.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:24.558+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:24.566 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:24.559+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:24.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:24.583+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:24.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:24.945+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:25.199 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:25.190+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:25.221 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:25.215+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:25.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:25.556+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:25.596 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:25.589+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:25.607 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:25.597+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:25.921 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:25.903+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:26.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:26.175+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:26.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:26.248+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:26.523 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:26.516+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:26.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:26.555+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:26.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:26.615+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:26.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:26.881+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:27.213 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:27.206+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:27.288 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:27.281+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:27.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:27.526+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:27.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:27.573+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:27.593 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:27.583+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:27.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:27.889+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:28.240 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:28.232+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:28.300 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:28.293+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:28.521 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:28.515+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:28.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:28.572+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:28.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:28.636+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:28.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:28.895+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:29.195 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:29.188+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:29.308 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:29.300+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:29.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:29.476+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:29.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:29.576+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:29.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:29.665+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:29.857 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:29.850+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:30.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:30.149+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:30.274 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:30.267+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:30.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:30.442+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:30.604 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:30.597+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:30.676 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:30.664+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:30.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:30.804+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:30.812 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:30.806+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:31.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:31.174+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:31.323 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:31.314+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:31.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:31.461+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:31.574 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:31.568+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:31.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:31.627+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:31.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:31.789+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:31.800 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:31.794+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:32.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:32.134+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:32.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:32.299+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:32.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:32.477+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:32.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:32.545+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:32.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:32.616+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:32.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:32.758+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:32.767 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:32.761+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:33.101 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:33.095+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:33.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:33.266+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:33.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:33.481+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:33.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:33.548+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:33.619 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:33.612+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:33.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:33.779+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:33.790 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:33.782+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:34.092 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:34.081+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:34.313 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:34.306+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:34.491 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:34.484+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:34.575 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:34.569+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:34.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:34.658+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:34.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:34.780+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:34.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:34.782+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:35.079 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:35.073+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:35.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:35.266+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:35.480 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:35.473+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:35.616 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:35.610+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:35.723 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:35.706+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:35.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:35.762+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:35.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:35.763+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:36.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:36.082+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:36.256 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:36.249+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:36.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:36.518+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:36.658 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:36.650+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:36.688 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:36.681+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:36.807 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:36.789+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:36.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:36.792+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:37.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:37.081+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:37.262 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:37.255+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:37.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:37.510+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:37.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:37.628+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:37.721 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:37.709+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:37.759 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:37.748+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:37.759 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:37.749+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:38.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:38.045+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:38.281 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:38.274+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:38.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:38.501+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:38.607 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:38.600+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:38.711 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:38.705+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:38.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:38.708+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:38.726 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:38.719+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:39.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:39.071+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:39.293 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:39.284+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:39.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:39.532+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:39.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:39.573+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:39.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:39.684+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:39.704 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:39.696+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:39.705 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:39.699+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:40.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:40.104+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:40.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:40.246+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:40.571 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:40.563+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:40.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:40.562+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:40.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:40.643+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:40.693 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:40.684+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:40.693 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:40.686+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:41.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:41.156+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:41.216 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:41.209+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:41.537 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:41.529+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:41.611 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:41.602+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:41.654 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:41.646+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:41.655 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:41.649+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:41.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:41.674+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:42.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:42.134+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:42.261 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:42.254+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:42.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:42.484+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:42.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:42.596+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:42.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:42.639+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:42.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:42.640+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:42.690 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:42.683+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:43.143 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:51.277 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:43.136+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:43.152 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:51.286 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.192 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:51.372 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.257 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:27:51.384 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.257 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:51.406 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.257 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:51.410 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.258 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:51.417 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:43.278+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:43.300 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:27:51.478 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.302 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:27:51.482 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:43:43.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:43.531+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:43.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:43.580+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:43.618 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:43.611+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:43.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:43.613+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:43.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:43.676+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:44.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:44.106+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:44.320 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:44.313+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:44.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:44.331+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:44.492 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:44.484+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:44.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:44.547+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:44.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:44.575+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:44.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:44.576+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:44.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:44.723+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:45.114 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:45.106+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:45.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:45.326+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:45.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:45.380+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:45.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:45.454+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:45.537 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:45.530+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:45.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:45.612+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:45.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:45.614+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:45.771 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:45.764+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:46.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:46.145+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:46.300 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:46.288+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:46.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:46.382+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:46.445 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:46.437+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:46.564 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:46.558+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:46.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:46.650+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:46.660 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:46.652+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:46.781 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:46.774+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:47.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:47.156+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:47.288 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:47.281+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:47.375 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:47.369+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:47.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:47.450+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:47.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:47.518+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:47.702 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:47.694+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:47.702 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:47.695+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:47.812 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:47.805+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:48.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:48.130+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:48.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:48.249+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:48.377 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:48.370+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:48.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:48.421+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:48.529 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:48.522+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:48.750 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:48.741+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:48.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:48.744+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:48.783 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:48.776+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:49.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:49.104+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:49.261 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:49.254+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:49.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:49.378+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:49.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:49.397+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:49.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:49.495+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:49.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:49.782+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:49.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:49.783+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:49.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:49.806+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:50.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:50.091+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:50.293 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:50.286+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:50.347 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:50.341+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:50.362 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:50.354+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:50.546 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:50.538+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:50.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:50.782+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:50.792 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:50.786+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:50.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:50.846+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:51.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:51.057+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:51.330 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:51.321+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:51.391 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:51.384+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:51.400 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:51.394+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:51.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:51.576+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:51.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:51.754+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:51.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:51.755+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:51.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:51.833+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:52.097 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:52.090+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:52.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:52.360+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:52.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:52.403+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:52.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:52.425+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:52.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:52.579+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:52.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:52.783+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:52.790 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:52.785+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:52.835 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:52.828+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:53.089 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:53.082+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:53.163 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:43:53.153+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e612 v612) 2019-11-29T18:43:53.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:53.339+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:53.433 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:53.426+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:53.476 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:53.470+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:53.548 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:53.542+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:53.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:53.804+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:53.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:53.805+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:53.887 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:53.880+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:54.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:54.038+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:54.325 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:54.316+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:54.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:54.395+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:54.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:54.493+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:54.593 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:54.586+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:54.828 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:54.821+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:54.829 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:54.823+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:54.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:54.846+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:55.048 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:55.041+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:55.375 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:55.368+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:55.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:55.425+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:55.481 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:55.474+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:55.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:55.592+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:55.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:55.795+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:55.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:55.797+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:55.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:55.847+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:56.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:56.004+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:56.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:56.370+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:56.391 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:56.384+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:56.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:56.455+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:56.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:56.618+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:56.757 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:56.750+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:56.757 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:56.752+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:56.864 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:56.857+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:57.015 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:57.006+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:57.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:57.382+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:57.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:57.428+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:57.463 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:57.456+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:57.640 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:57.633+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:57.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:57.731+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:57.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:57.734+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:57.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:57.862+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:58.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:58.026+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:58.181 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:43:58.176+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e612 v612) 2019-11-29T18:43:58.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:58.360+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:58.474 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:58.467+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:58.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:58.470+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:58.613 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:58.600+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:58.777 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:58.764+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:58.777 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:58.767+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:58.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:58.899+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:43:58.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:43:58.983+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:43:59.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:43:59.387+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:43:59.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:43:59.450+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:43:59.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:43:59.469+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:43:59.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:43:59.588+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:43:59.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:59.778+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:43:59.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:43:59.781+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:43:59.922 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:43:59.914+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:44:00.013 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:44:00.006+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:44:00.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:44:00.434+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:44:00.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:44:00.484+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:44:00.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:44:00.510+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:44:00.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:44:00.554+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:44:00.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:00.744+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:44:00.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:00.746+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:44:00.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:44:00.962+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:44:01.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:44:01.054+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:44:01.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:44:01.450+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:44:01.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:44:01.457+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:44:01.500 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:44:01.492+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:44:01.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:44:01.588+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:44:01.728 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:01.720+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:44:01.730 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:01.724+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:44:01.931 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:44:01.923+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:44:02.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:44:02.027+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:44:02.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:44:02.445+0000 1694c700 -1 osd.2 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.275848+0000 front 2019-11-29T18:42:36.292005+0000 (oldest deadline 2019-11-29T18:43:20.371694+0000) 2019-11-29T18:44:02.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:44:02.483+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:44:02.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:44:02.494+0000 1694c700 -1 osd.6 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:38.769564+0000 front 2019-11-29T18:42:38.717728+0000 (oldest deadline 2019-11-29T18:43:20.396565+0000) 2019-11-29T18:44:02.557 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:44:02.548+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:44:02.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:02.771+0000 1694c700 -1 osd.0 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:42:50.231772+0000 (oldest deadline 2019-11-29T18:43:30.231772+0000) 2019-11-29T18:44:02.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:02.774+0000 1694c700 -1 osd.0 612 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:44:02.976 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:44:02.967+0000 1694c700 -1 osd.7 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.666577+0000 front 2019-11-29T18:42:39.621110+0000 (oldest deadline 2019-11-29T18:43:21.904303+0000) 2019-11-29T18:44:03.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:44:03.018+0000 1694c700 -1 osd.1 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:36.642524+0000 front 2019-11-29T18:42:36.685213+0000 (oldest deadline 2019-11-29T18:43:22.428833+0000) 2019-11-29T18:44:03.265 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:44:03.256+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e612 v612) 2019-11-29T18:44:03.498 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:44:03.491+0000 1694c700 -1 osd.4 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:39.142930+0000 front 2019-11-29T18:42:39.320582+0000 (oldest deadline 2019-11-29T18:43:44.142414+0000) 2019-11-29T18:44:03.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:44:03.507+0000 1694c700 -1 osd.5 612 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:42:35.783787+0000 front 2019-11-29T18:42:35.729763+0000 (oldest deadline 2019-11-29T18:43:21.496529+0000) 2019-11-29T18:44:03.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:44:03.763+0000 1694c700 -1 osd.0 613 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:112554 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e611) 2019-11-29T18:44:36.748 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:44:36.738+0000 31783700 -1 osd.3 618 build_incremental_map_msg missing incremental map 618 2019-11-29T18:44:37.261 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:44:37.244+0000 3578b700 -1 osd.3 618 build_incremental_map_msg missing incremental map 618 2019-11-29T18:44:38.518 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:44:38.512+0000 30f82700 -1 osd.3 618 build_incremental_map_msg missing incremental map 618 2019-11-29T18:44:38.981 INFO:teuthology.orchestra.run.smithi182.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-11-29T18:45:34.141 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:34.133+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:34.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:34.297+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:34.868 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:34.862+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:35.169 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:35.161+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:35.319 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:35.311+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:35.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:35.826+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:35.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:35.990+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:36.198 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:36.191+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:36.284 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:36.274+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:36.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:36.684+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:36.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:36.830+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:36.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:36.985+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:37.182 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:37.173+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:37.208 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:37.201+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:37.244 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:37.236+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:37.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:37.737+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:37.853 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:37.846+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:37.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:37.987+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:38.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:38.183+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:38.239 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:38.231+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:38.293 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:38.284+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:38.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:38.764+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:38.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:38.811+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:38.968 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:38.961+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:39.222 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:39.214+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:39.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:39.284+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:39.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:39.315+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:39.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:39.782+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:39.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:39.831+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:40.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:40.002+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:40.209 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:40.203+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:40.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:40.261+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:40.283 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:40.277+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:40.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:40.362+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:40.785 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:40.777+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:40.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:40.818+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:41.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:41.017+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:41.178 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:41.165+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:41.270 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:41.263+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:41.303 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:41.295+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:41.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:41.361+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:41.747 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:41.739+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:41.826 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:41.819+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:42.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:42.011+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:42.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:42.135+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:42.236 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:42.223+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:42.282 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:42.275+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:42.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:42.405+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:42.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:42.697+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:42.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:42.820+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:43.020 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:43.011+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:43.105 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:43.098+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:43.255 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:43.248+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:43.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:43.297+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:43.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:43.371+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:43.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:43.672+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:43.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:43.832+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:44.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:44.028+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:44.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:44.147+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:44.234 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:44.226+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:44.352 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:44.344+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:44.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:44.403+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:44.652 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:44.645+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:44.822 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:44.813+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:45.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:45.063+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:45.189 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:45.181+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:45.243 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:45.236+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:45.356 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:45.348+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:45.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:45.454+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:45.615 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:45.607+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:45.791 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:45.784+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:46.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:46.046+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:46.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:46.173+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:46.233 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:46.226+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:46.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:46.384+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:46.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:46.498+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:46.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:46.656+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:46.831 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:46.822+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:47.101 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:47.093+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:47.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:47.142+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:47.247 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:47.241+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:47.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:47.372+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:47.528 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:47.520+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:47.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:47.623+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:47.803 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:47.795+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:48.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:48.070+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:48.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:48.157+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:48.289 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:48.281+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:48.426 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:48.418+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:48.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:48.559+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:48.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:48.626+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:48.785 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:48.779+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:49.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:49.102+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:49.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:49.134+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:49.302 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:49.295+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:49.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:49.471+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:49.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:49.582+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:49.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:49.599+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:49.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:49.794+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:50.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:50.119+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:50.137 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:50.130+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:50.322 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:50.315+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:50.503 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:50.496+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:50.580 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:50.573+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:50.653 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:50.646+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:50.767 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:50.760+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:51.131 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:51.123+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:51.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:51.150+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:51.308 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:51.299+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:51.463 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:51.457+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:51.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:51.578+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:51.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:51.625+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:51.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:51.753+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:52.126 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:52.116+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:52.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:52.184+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:52.348 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:52.342+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:52.488 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:52.480+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:52.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:52.620+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:52.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:52.633+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:52.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:52.764+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:53.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:53.161+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:53.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:53.169+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:53.362 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:53.354+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:53.473 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:53.465+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:53.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:53.581+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:53.665 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:53.657+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:53.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:53.816+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:54.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:54.141+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:54.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:54.203+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:54.413 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:54.406+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:54.442 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:54.434+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:54.562 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:54.555+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:54.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:54.611+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:54.844 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:54.837+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:55.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:55.101+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:55.264 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:55.256+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:55.419 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:55.412+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:55.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:55.460+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:55.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:55.547+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:55.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:55.621+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:55.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:55.885+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:56.150 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:56.143+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:56.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:56.260+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:56.381 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:56.373+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:56.506 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:56.499+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:56.608 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:56.601+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:56.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:56.626+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:56.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:56.852+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:57.142 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:57.135+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:57.295 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:57.288+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:57.416 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:57.407+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:57.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:57.504+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:57.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:57.598+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:57.627 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:57.620+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:57.884 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:57.871+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:58.182 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:58.174+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:58.319 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:58.311+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:58.370 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:58.362+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:58.530 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:58.522+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:58.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:58.580+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:58.672 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:58.664+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:58.869 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:58.861+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:45:59.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:45:59.198+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:45:59.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:45:59.337+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:45:59.423 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:45:59.414+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:45:59.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:45:59.543+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:45:59.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:45:59.575+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:45:59.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:45:59.700+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:45:59.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:45:59.862+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:00.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:00.193+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:00.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:00.339+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:00.450 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:00.443+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:00.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:00.563+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:00.574 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:00.567+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:00.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:00.708+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:00.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:00.889+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:01.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:01.182+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:01.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:01.300+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:01.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:01.491+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:01.564 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:01.556+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:01.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:01.590+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:01.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:01.674+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:01.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:01.884+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:02.207 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:02.200+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:02.311 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:02.304+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:02.473 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:02.465+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:02.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:02.589+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:02.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:02.601+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:02.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:02.651+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:02.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:02.841+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:03.213 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:03.206+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:03.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:03.303+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:03.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:03.490+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:03.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:03.590+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:03.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:03.632+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:03.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:03.632+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:03.900 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:03.893+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:04.197 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:04.189+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:04.321 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:04.314+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:04.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:04.467+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:04.634 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:04.626+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:04.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:04.632+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:04.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:04.679+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:04.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:04.888+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:05.225 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:05.217+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:05.328 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:05.314+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:05.512 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:05.504+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:05.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:05.589+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:05.633 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:05.625+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:05.734 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:05.727+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:05.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:05.850+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:06.259 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:06.252+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:06.359 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:06.352+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:06.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:06.485+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:06.602 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:06.595+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:06.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:06.613+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:06.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:06.725+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:06.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:06.825+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:07.308 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:07.301+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:07.412 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:07.403+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:07.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:07.537+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:07.561 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:07.553+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:07.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:07.632+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:07.755 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:07.747+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:07.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:07.832+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:08.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:08.306+0000 1694c700 -1 osd.1 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:50.218314+0000 front 2019-11-29T18:44:50.226242+0000 (oldest deadline 2019-11-29T18:45:35.498297+0000) 2019-11-29T18:46:08.444 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:46:08.437+0000 1694c700 -1 osd.6 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:54.177500+0000 front 2019-11-29T18:44:53.760458+0000 (oldest deadline 2019-11-29T18:45:39.578913+0000) 2019-11-29T18:46:08.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:46:08.580+0000 1694c700 -1 osd.3 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:53.760222+0000 front 2019-11-29T18:44:48.180580+0000 (oldest deadline 2019-11-29T18:45:33.725726+0000) 2019-11-29T18:46:08.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:46:08.589+0000 1694c700 -1 osd.5 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.509638+0000 front 2019-11-29T18:44:51.638364+0000 (oldest deadline 2019-11-29T18:45:36.178803+0000) 2019-11-29T18:46:08.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:46:08.628+0000 1694c700 -1 osd.4 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:51.105970+0000 front 2019-11-29T18:44:51.259326+0000 (oldest deadline 2019-11-29T18:45:36.379400+0000) 2019-11-29T18:46:08.720 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:46:08.712+0000 1694c700 -1 osd.7 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.404623+0000 front 2019-11-29T18:44:49.979896+0000 (oldest deadline 2019-11-29T18:45:34.085644+0000) 2019-11-29T18:46:08.761 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:46:08.753+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e618 v618) 2019-11-29T18:46:08.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:46:08.808+0000 1694c700 -1 osd.2 618 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:44:49.601614+0000 front 2019-11-29T18:44:49.979731+0000 (oldest deadline 2019-11-29T18:45:34.271039+0000) 2019-11-29T18:46:39.447 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:46:39.439+0000 1694c700 -1 osd.1 620 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117002 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 145] snapc 0=[] ondisk+write+known_if_redirected e619) 2019-11-29T18:46:59.144 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:31:07.279 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.155 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:31:07.290 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.157 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:31:07.337 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.163 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:31:07.343 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.164 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:31:07.344 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.170 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:31:07.350 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.388 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:31:07.568 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.441 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:31:07.620 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:46:59.480 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:31:07.615 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:47:07.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:07.063+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:07.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:07.423+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:07.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:07.824+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:08.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:08.039+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:08.145 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:08.137+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:08.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:08.428+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:08.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:08.431+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:08.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:08.838+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:09.074 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:09.067+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:09.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:09.179+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:09.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:09.412+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:09.453 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:09.445+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:09.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:09.856+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:10.073 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:10.065+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:10.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:10.118+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:10.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:10.230+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:10.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:10.402+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:10.433 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:10.425+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:10.824 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:10.817+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:11.057 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:11.048+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:11.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:11.147+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:11.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:11.210+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:11.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:11.429+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:11.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:11.457+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:11.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:11.787+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:12.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:12.003+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:12.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:12.153+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:12.197 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:12.190+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:12.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:12.451+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:12.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:12.486+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:12.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:12.795+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:13.034 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:13.027+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:13.174 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:13.167+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:13.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:13.237+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:13.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:13.491+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:13.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:13.542+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:13.816 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:13.809+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:14.037 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:14.030+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:14.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:14.125+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:14.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:14.287+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:14.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:14.527+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:14.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:14.554+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:14.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:14.826+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:15.076 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:15.069+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:15.103 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:15.097+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:15.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:15.238+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:15.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:15.241+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:15.495 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:15.489+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:15.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:15.571+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:15.897 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:15.887+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:16.048 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:16.041+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:16.069 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:16.062+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:16.228 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:16.221+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:16.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:16.291+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:16.514 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:16.507+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:16.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:16.563+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:16.927 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:16.920+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:17.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:17.063+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:17.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:17.094+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:17.241 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:17.236+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:17.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:17.327+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:17.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:17.536+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:17.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:17.537+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:17.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:17.897+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:18.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:18.064+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:18.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:18.096+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:18.228 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:18.222+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:18.322 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:18.315+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:18.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:18.514+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:18.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:18.554+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:18.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:18.948+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:19.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:19.076+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:19.115 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:19.109+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:19.275 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:19.269+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:19.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:19.352+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:19.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:19.520+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:19.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:19.563+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:19.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:19.972+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:20.058 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:20.051+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:20.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:20.110+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:20.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:20.304+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:20.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:20.305+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:20.366 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:20.359+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:20.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:20.527+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:20.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:20.563+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:20.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:20.988+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:21.020 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:21.013+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:21.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:21.101+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:21.316 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:21.308+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:21.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:21.311+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:21.367 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:21.360+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:21.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:21.536+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:21.568 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:21.562+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:22.025 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:22.012+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:22.025 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:22.018+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:22.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:22.068+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:22.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:22.280+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:22.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:22.282+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:22.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:22.338+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:22.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:22.509+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:22.611 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:22.604+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:22.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:22.991+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:23.045 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:23.039+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:23.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:23.057+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:23.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:23.280+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:23.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:23.285+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:23.359 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:23.347+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:23.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:23.475+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:23.643 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:23.636+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:24.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:24.029+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:24.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:24.030+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:24.076 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:24.069+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:24.258 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:24.252+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:24.258 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:24.253+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:24.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:24.383+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:24.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:24.480+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:24.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:24.619+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:24.998 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:24.992+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:25.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:25.005+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:25.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:25.059+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:25.248 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:25.239+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:25.249 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:25.242+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:25.381 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:25.373+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:25.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:25.453+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:25.666 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:25.658+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:25.991 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:25.984+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:26.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:26.039+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:26.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:26.042+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:26.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:26.280+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:26.290 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:26.283+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:26.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:26.397+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:26.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:26.501+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:26.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:26.703+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:27.033 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:27.027+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:27.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:27.062+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:27.086 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:27.076+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:27.268 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:27.261+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:27.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:27.263+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:27.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:27.418+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:27.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:27.520+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:27.722 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:27.715+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:28.014 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:28.007+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:28.045 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:28.038+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:28.068 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:28.062+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:28.280 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:28.270+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:28.281 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:28.273+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:28.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:28.440+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:28.482 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:28.475+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:28.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:28.717+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:29.049 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:29.042+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:29.090 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:29.083+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:29.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:29.088+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:29.251 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:29.244+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:29.253 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:29.247+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:29.488 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:29.481+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:29.507 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:29.501+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:29.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:29.704+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:30.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:30.004+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:30.059 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:30.052+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:30.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:30.094+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:30.271 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:30.262+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:30.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:30.265+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:30.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:30.490+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:30.519 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:30.513+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:30.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:30.724+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:30.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:30.963+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:31.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:31.040+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:31.059 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:31.052+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:31.315 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:31.308+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:31.316 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:31.310+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:31.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:31.454+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:31.549 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:31.543+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:31.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:31.703+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:31.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:31.968+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:32.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:32.092+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:32.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:32.094+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:32.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:32.356+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:32.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:32.360+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:32.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:32.481+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:32.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:32.531+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:32.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:32.698+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:33.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:33.008+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:33.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:33.087+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:33.111 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:33.104+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:33.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:33.410+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:33.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:33.413+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:33.500 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:33.493+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:33.522 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:33.516+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:33.692 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:33.685+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:33.984 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:33.977+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:34.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:34.120+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:34.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:34.138+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:34.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:34.412+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:34.420 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:34.413+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:34.454 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:34.448+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:34.525 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:34.517+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:34.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:34.676+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:35.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:34.995+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:35.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:35.098+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:35.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:35.126+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:35.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:35.417+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:35.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:35.420+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:35.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:35.430+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:35.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:35.539+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:35.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:35.717+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:36.056 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:36.048+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:36.104 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:36.096+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:36.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:36.110+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:36.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:36.428+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:36.437 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:36.430+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:36.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:36.473+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:36.594 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:36.588+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:36.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:36.733+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:37.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:37.094+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:37.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:37.102+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:37.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:37.135+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:37.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:37.451+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:37.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:37.454+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:37.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:37.522+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:37.602 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:37.594+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:37.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:37.779+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:38.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:38.077+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:38.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:38.154+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:38.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:38.188+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:38.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:38.474+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:38.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:38.476+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:38.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:38.518+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:38.562 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:38.555+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:38.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:38.827+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:39.076 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:47:39.067+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e624 v624) 2019-11-29T18:47:39.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:39.101+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:39.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:39.148+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:39.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:39.155+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:39.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:39.478+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:39.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:39.479+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:39.541 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:39.535+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:39.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:39.536+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:39.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:39.850+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:40.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:40.131+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:40.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:40.143+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:40.210 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:40.203+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:40.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:40.460+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:40.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:40.462+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:40.503 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:40.495+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:40.514 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:40.508+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:40.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:40.864+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:41.110 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:41.102+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:41.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:41.108+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:41.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:41.249+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:41.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:41.475+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:41.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:41.478+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:41.521 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:41.515+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:41.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:41.542+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:41.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:41.890+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:42.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:42.088+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:42.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:42.089+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:42.306 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:42.299+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:42.462 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:42.454+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:42.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:42.456+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:42.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:42.484+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:42.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:42.500+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:42.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:42.917+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:43.072 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:43.065+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:43.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:43.122+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:43.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:43.301+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:43.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:43.465+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:43.486 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:43.478+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:43.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:43.480+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:43.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:43.484+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:43.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:43.932+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:44.090 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:44.083+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:44.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:44.086+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:44.100 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:47:44.092+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e624 v624) 2019-11-29T18:47:44.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:44.348+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:44.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:44.479+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:44.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:44.502+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:44.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:44.504+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:44.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:44.508+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:44.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:44.975+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:45.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:45.087+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:45.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:45.103+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:45.347 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:45.340+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:45.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:45.514+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:45.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:45.517+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:45.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:45.528+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:45.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:45.559+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:46.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:46.007+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:46.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:46.076+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:46.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:46.144+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:46.312 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:46.305+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:46.524 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:46.516+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:46.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:46.556+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:46.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:46.559+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:46.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:46.559+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:47.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:47.033+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:47.067 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:47.059+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:47.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:47.129+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:47.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:47.296+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:47.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:47.553+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:47.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:47.555+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:47.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:47.556+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:47.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:47.563+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:48.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:48.006+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:48.045 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:48.037+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:48.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:48.154+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:48.275 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:48.267+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:48.526 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:48.517+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:48.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:48.521+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:48.599 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:48.592+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:48.612 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:48.603+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:49.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:49.005+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:49.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:49.048+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:49.114 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:47:49.107+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e624 v624) 2019-11-29T18:47:49.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:49.133+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:49.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:49.252+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:49.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:49.505+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:49.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:49.507+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:49.566 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:49.560+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:49.606 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:49.599+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:49.992 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:49.984+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:50.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:50.061+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:50.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:50.123+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:50.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:50.220+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:50.531 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:50.524+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:50.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:50.546+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:50.554 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:50.549+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:50.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:50.614+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:50.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:50.967+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:51.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:51.112+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:51.161 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:51.153+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:51.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:51.248+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:51.518 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:51.511+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:51.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:51.515+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:51.567 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:51.562+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:51.576 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:51.569+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:51.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:51.976+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:52.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:52.123+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:52.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:52.148+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:52.236 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:52.228+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:52.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:52.535+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:52.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:52.537+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:52.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:52.568+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:52.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:52.592+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:53.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:52.995+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:53.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:53.109+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:53.168 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:53.159+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:53.250 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:53.240+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:47:53.593 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:53.586+0000 1694c700 -1 osd.0 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:46:39.976900+0000 (oldest deadline 2019-11-29T18:47:19.976900+0000) 2019-11-29T18:47:53.594 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:47:53.588+0000 1694c700 -1 osd.0 624 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e623) 2019-11-29T18:47:53.602 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:47:53.596+0000 1694c700 -1 osd.1 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:21.654687+0000 front 2019-11-29T18:46:21.650219+0000 (oldest deadline 2019-11-29T18:47:06.944805+0000) 2019-11-29T18:47:53.632 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:47:53.625+0000 1694c700 -1 osd.2 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:22.483976+0000 front 2019-11-29T18:46:22.549268+0000 (oldest deadline 2019-11-29T18:47:07.162946+0000) 2019-11-29T18:47:54.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:47:54.013+0000 1694c700 -1 osd.5 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:25.080852+0000 front 2019-11-29T18:46:25.117179+0000 (oldest deadline 2019-11-29T18:47:07.559949+0000) 2019-11-29T18:47:54.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:47:54.111+0000 1694c700 -1 osd.6 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.934219+0000 front 2019-11-29T18:46:24.695213+0000 (oldest deadline 2019-11-29T18:47:07.214825+0000) 2019-11-29T18:47:54.195 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:47:54.186+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e624 v624) 2019-11-29T18:47:54.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:47:54.208+0000 1694c700 -1 osd.7 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:24.954870+0000 front 2019-11-29T18:46:24.934949+0000 (oldest deadline 2019-11-29T18:47:10.027309+0000) 2019-11-29T18:47:54.242 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:47:54.235+0000 1694c700 -1 osd.4 624 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:46:20.367165+0000 front 2019-11-29T18:46:20.365935+0000 (oldest deadline 2019-11-29T18:47:06.224890+0000) 2019-11-29T18:48:49.641 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:32:57.776 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.665 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:32:57.800 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.722 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:32:57.902 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.726 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:32:57.906 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.729 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:32:57.909 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.742 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:32:57.922 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.826 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:32:57.961 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.843 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:32:58.023 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:48:49.871 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:32:58.051 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:49:20.078 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:20.069+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:20.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:20.499+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:21.061 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:21.055+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:21.195 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:21.188+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:21.517 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:21.509+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:21.873 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:21.863+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:22.063 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:22.050+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:22.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:22.155+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:22.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:22.158+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:22.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:22.481+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:22.826 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:22.818+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:22.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:22.841+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:23.093 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:23.087+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:23.131 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:23.123+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:23.132 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:23.127+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:23.457 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:23.437+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:23.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:23.809+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:23.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:23.870+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:24.051 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:24.045+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:24.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:24.094+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:24.105 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:24.098+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:24.403 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:24.396+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:24.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:24.817+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:24.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:24.840+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:24.997 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:24.989+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:25.027 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:25.020+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:25.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:25.100+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:25.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:25.102+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:25.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:25.425+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:25.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:25.465+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:25.848 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:25.840+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:25.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:25.876+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:25.983 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:25.974+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:26.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:26.035+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:26.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:26.142+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:26.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:26.149+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:26.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:26.466+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:26.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:26.469+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:26.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:26.853+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:26.873 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:26.866+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:26.942 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:26.934+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:27.021 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:27.013+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:27.185 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:27.178+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:27.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:27.182+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:27.470 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:27.464+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:27.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:27.506+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:27.825 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:27.818+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:27.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:27.830+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:27.983 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:27.972+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:27.996 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:27.986+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:28.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:28.142+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:28.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:28.144+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:28.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:28.420+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:28.504 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:28.498+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:28.795 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:28.788+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:28.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:28.839+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:28.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:28.965+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:28.973 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:28.966+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:29.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:29.100+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:29.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:29.103+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:29.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:29.417+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:29.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:29.524+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:29.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:29.779+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:29.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:29.859+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:29.933 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:29.926+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:29.957 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:29.949+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:30.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:30.080+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:30.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:30.083+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:30.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:30.395+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:30.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:30.529+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:30.754 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:30.747+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:30.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:30.851+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:30.938 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:30.930+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:30.968 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:30.961+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:31.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:31.053+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:31.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:31.058+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:31.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:31.408+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:31.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:31.535+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:31.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:31.729+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:31.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:31.849+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:31.951 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:31.943+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:31.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:31.977+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:32.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:32.069+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:32.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:32.074+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:32.465 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:32.452+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:32.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:32.526+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:32.734 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:32.727+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:32.848 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:32.840+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:32.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:32.966+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:32.976 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:32.969+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:33.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:33.094+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:33.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:33.095+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:33.431 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:33.423+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:33.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:33.526+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:33.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:33.776+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:33.802 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:33.795+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:33.962 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:33.954+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:34.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:34.009+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:34.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:34.054+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:34.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:34.057+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:34.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:34.402+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:34.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:34.530+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:34.785 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:34.778+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:34.821 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:34.813+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:34.999 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:34.992+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:35.003 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:34.995+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:35.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:35.013+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:35.024 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:35.016+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:35.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:35.446+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:35.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:35.571+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:35.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:35.794+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:35.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:35.793+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:35.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:35.983+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:35.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:35.988+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:36.022 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:36.014+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:36.043 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:36.037+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:36.479 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:36.472+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:36.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:36.613+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:36.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:36.768+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:36.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:36.782+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:36.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:36.974+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:36.983 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:36.977+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:37.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:37.022+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:37.053 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:37.046+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:37.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:37.509+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:37.597 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:37.589+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:37.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:37.770+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:37.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:37.812+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:38.009 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:38.001+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:38.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:38.018+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:38.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:38.021+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:38.064 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:38.055+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:38.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:38.518+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:38.577 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:38.570+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:38.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:38.744+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:38.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:38.813+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:39.020 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:39.013+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:39.053 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:39.044+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:39.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:39.047+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:39.062 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:39.054+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:39.569 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:39.562+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:39.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:39.587+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:39.781 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:39.770+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:39.817 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:39.809+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:40.020 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:40.010+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:40.062 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:40.054+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:40.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:40.068+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:40.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:40.071+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:40.595 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:40.588+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:40.605 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:40.598+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:40.740 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:40.729+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:40.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:40.794+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:41.016 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:41.009+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:41.064 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:41.056+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:41.130 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:41.122+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:41.130 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:41.125+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:41.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:41.600+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:41.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:41.601+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:41.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:41.705+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:41.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:41.796+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:42.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:42.020+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:42.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:42.062+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:42.138 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:42.129+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:42.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:42.132+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:42.597 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:42.590+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:42.654 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:42.646+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:42.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:42.671+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:42.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:42.761+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:43.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:43.018+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:43.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:43.046+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:43.097 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:43.090+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:43.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:43.094+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:43.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:43.636+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:43.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:43.668+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:43.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:43.718+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:43.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:43.778+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:44.044 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:44.037+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:44.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:44.093+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:44.100 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:44.094+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:44.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:44.097+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:44.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:44.625+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:44.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:44.620+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:44.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:44.685+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:44.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:44.747+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:45.082 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:45.075+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:45.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:45.075+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:45.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:45.080+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:45.106 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:45.097+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:45.621 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:45.611+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:45.621 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:45.606+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:45.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:45.654+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:45.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:45.719+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:46.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:46.059+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:46.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:46.061+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:46.111 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:46.103+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:46.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:46.127+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:46.596 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:46.588+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:46.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:46.651+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:46.664 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:46.656+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:46.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:46.768+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:47.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:47.052+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:47.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:47.055+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:47.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:47.113+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:47.173 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:47.150+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:47.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:47.580+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:47.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:47.613+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:47.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:47.663+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:47.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:47.822+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:48.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:48.080+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:48.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:48.083+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:48.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:48.136+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:48.183 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:48.175+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:48.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:48.600+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:48.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:48.644+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:48.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:48.660+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:48.874 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:48.866+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:49.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:49.090+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:49.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:49.093+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:49.130 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:49.122+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:49.233 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:49.226+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:49.622 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:49.614+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:49.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:49.654+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:49.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:49.665+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:49.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:49.877+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:50.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:50.078+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:50.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:50.103+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:50.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:50.105+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:50.218 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:50.210+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:50.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:50.632+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:50.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:50.652+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:50.704 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:50.696+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:50.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:50.861+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:51.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:51.101+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:51.120 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:51.112+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:51.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:51.115+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:51.218 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:51.210+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:51.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:51.645+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:51.696 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:51.688+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:51.751 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:51.744+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:51.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:51.883+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:52.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:52.117+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:52.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:52.120+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:52.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:52.133+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:52.176 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:52.169+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:52.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:52.695+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:52.736 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:52.728+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:52.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:52.742+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:52.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:52.929+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:53.134 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:53.120+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:53.134 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:53.124+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:53.170 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:53.162+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:53.193 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:53.186+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:53.696 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:53.687+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:53.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:53.697+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:53.757 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:53.745+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:53.910 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:53.902+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:54.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:49:54.152+0000 1694c700 -1 osd.4 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.038764+0000 front 2019-11-29T18:48:39.226122+0000 (oldest deadline 2019-11-29T18:49:24.295367+0000) 2019-11-29T18:49:54.167 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:54.159+0000 1694c700 -1 osd.6 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.512592+0000 front 2019-11-29T18:48:36.343581+0000 (oldest deadline 2019-11-29T18:49:21.544611+0000) 2019-11-29T18:49:54.168 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:54.160+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:54.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:54.162+0000 1694c700 -1 osd.6 631 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:54.708 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:49:54.701+0000 1694c700 -1 osd.1 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:39.046298+0000 front 2019-11-29T18:48:39.044541+0000 (oldest deadline 2019-11-29T18:49:24.905120+0000) 2019-11-29T18:49:54.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:49:54.723+0000 1694c700 -1 osd.7 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:33.770606+0000 front 2019-11-29T18:48:33.768730+0000 (oldest deadline 2019-11-29T18:49:19.635767+0000) 2019-11-29T18:49:54.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:49:54.775+0000 1694c700 -1 osd.2 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:36.515053+0000 front 2019-11-29T18:48:36.391387+0000 (oldest deadline 2019-11-29T18:49:22.276287+0000) 2019-11-29T18:49:54.889 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:49:54.874+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e631 v631) 2019-11-29T18:49:54.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:49:54.908+0000 1694c700 -1 osd.5 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.787244+0000 front 2019-11-29T18:48:39.004385+0000 (oldest deadline 2019-11-29T18:49:21.053375+0000) 2019-11-29T18:49:55.151 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:49:55.136+0000 1694c700 -1 osd.3 631 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:48:38.993650+0000 front 2019-11-29T18:48:38.992449+0000 (oldest deadline 2019-11-29T18:49:19.215374+0000) 2019-11-29T18:49:55.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:55.160+0000 1694c700 -1 osd.6 632 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:49:56.178 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:49:56.131+0000 1694c700 -1 osd.6 632 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81409 7.7 7:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e631) 2019-11-29T18:50:27.430 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.409+0000 32785700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:27.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.456+0000 38f92700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:27.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.530+0000 3778f700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:27.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.581+0000 38791700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:27.815 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.778+0000 3578b700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:27.981 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.870+0000 3578b700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:28.102 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:27.977+0000 38f92700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:28.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:28.369+0000 124ad700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:29.073 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:29.053+0000 33f88700 -1 osd.0 636 build_incremental_map_msg missing incremental map 636 2019-11-29T18:50:46.675 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:34:54.810 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.688 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:34:54.823 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.689 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:34:54.868 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.694 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:34:54.873 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.696 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:34:54.875 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.702 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:34:54.882 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.875 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:34:55.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.886 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:34:55.021 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:46.907 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:34:55.087 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:50:52.475 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:52.466+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:53.527 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:53.518+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:53.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:53.762+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:54.343 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:54.336+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:54.545 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:54.536+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:54.805 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:54.797+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:55.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:55.372+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:55.566 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:55.559+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:55.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:55.795+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:55.806 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:55.799+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:50:55.901 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:50:55.894+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:50:56.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:56.355+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:56.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:50:56.478+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:50:56.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:56.564+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:56.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:56.804+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:56.825 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:56.819+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:50:56.875 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:50:56.861+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:50:57.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:50:56.999+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:50:57.325 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:57.318+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:57.461 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:50:57.454+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:50:57.592 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:57.585+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:57.792 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:57.786+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:57.834 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:50:57.825+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:50:57.842 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:57.836+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:50:58.002 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:50:57.995+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:50:58.308 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:58.301+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:58.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:50:58.483+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:50:58.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:58.576+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:58.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:58.770+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:58.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:50:58.848+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:50:58.886 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:58.880+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:50:59.025 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:50:59.018+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:50:59.329 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:50:59.321+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:50:59.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:50:59.457+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:50:59.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:50:59.546+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:50:59.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:50:59.823+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:50:59.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:50:59.886+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:50:59.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:50:59.886+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:00.032 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:00.025+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:00.316 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:00.310+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:00.435 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:00.429+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:00.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:00.535+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:00.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:00.779+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:00.930 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:00.924+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:00.944 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:00.937+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:01.014 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:01.007+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:01.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:01.311+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:01.447 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:01.441+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:01.526 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:01.519+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:01.746 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:01.738+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:01.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:01.932+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:01.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:01.955+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:02.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:02.010+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:02.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:02.335+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:02.438 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:02.431+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:02.554 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:02.547+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:02.773 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:02.766+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:02.953 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:02.944+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:02.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:02.968+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:03.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:03.011+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:03.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:03.294+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:03.429 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:03.422+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:03.552 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:03.544+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:03.798 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:03.791+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:03.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:03.920+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:03.929 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:03.923+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:03.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:03.983+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:03.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:03.988+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:04.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:04.303+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:04.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:04.435+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:04.558 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:04.551+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:04.804 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:04.796+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:04.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:04.911+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:04.919 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:04.913+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:04.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:04.962+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:05.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:04.996+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:05.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:05.345+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:05.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:05.422+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:05.558 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:05.549+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:05.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:05.793+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:05.893 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:05.884+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:05.896 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:05.886+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:05.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:05.939+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:05.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:05.963+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:06.358 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:06.352+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:06.472 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:06.466+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:06.592 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:06.585+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:06.791 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:06.783+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:06.860 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:06.844+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:06.864 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:06.857+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:06.910 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:06.903+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:07.001 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:06.990+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:07.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:07.398+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:07.483 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:07.475+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:07.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:07.591+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:07.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:07.789+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:07.819 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:07.812+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:07.821 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:07.815+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:07.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:07.914+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:08.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:08.044+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:08.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:08.371+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:08.435 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:08.429+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:08.564 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:08.557+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:08.815 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:08.808+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:08.870 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:08.863+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:08.873 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:08.868+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:08.925 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:08.918+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:09.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:09.044+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:09.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:09.412+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:09.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:09.401+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:09.533 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:09.526+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:09.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:09.813+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:09.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:09.823+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:09.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:09.825+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:09.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:09.931+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:10.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:10.079+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:10.390 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:10.383+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:10.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:10.410+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:10.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:10.532+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:10.847 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:10.840+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:10.848 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:10.842+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:10.866 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:10.859+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:10.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:10.894+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:11.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:11.038+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:11.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:11.407+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:11.450 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:11.444+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:11.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:11.566+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:11.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:11.826+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:11.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:11.877+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:11.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:11.881+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:11.950 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:11.943+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:12.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:12.045+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:12.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:12.405+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:12.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:12.413+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:12.545 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:12.539+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:12.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:12.835+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:12.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:12.904+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:12.939 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:12.931+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:12.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:12.933+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:13.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:13.009+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:13.385 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:13.378+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:13.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:13.394+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:13.573 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:13.563+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:13.885 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:13.878+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:13.914 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:13.903+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:13.914 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:13.905+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:13.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:13.908+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:14.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:14.027+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:14.402 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:14.395+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:14.440 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:14.433+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:14.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:14.616+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:14.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:14.839+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:14.890 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:14.880+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:14.933 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:14.924+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:14.934 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:14.926+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:15.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:15.069+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:15.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:15.398+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:15.444 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:15.437+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:15.591 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:15.584+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:15.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:15.856+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:15.890 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:15.882+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:15.955 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:15.949+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:15.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:15.951+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:16.056 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:16.049+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:16.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:16.414+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:16.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:16.438+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:16.613 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:16.607+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:16.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:16.826+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:16.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:16.911+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:16.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:16.979+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:16.987 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:16.980+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:17.085 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:17.078+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:17.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:17.457+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:17.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:17.468+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:17.590 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:17.565+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:17.842 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:17.835+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:17.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:17.930+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:17.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:17.978+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:17.989 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:17.983+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:18.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:18.106+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:18.436 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:18.429+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:18.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:18.490+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:18.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:18.591+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:18.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:18.804+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:18.960 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:18.954+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:18.961 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:18.955+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:18.976 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:18.968+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:19.101 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:19.094+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:19.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:19.420+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:19.540 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:19.531+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:19.589 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:19.577+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:19.794 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:19.787+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:19.947 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:19.940+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:19.948 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:19.941+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:19.948 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:19.942+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:20.118 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:20.105+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:20.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:20.396+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:20.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:20.511+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:20.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:20.567+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:20.754 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:20.747+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:20.932 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:20.923+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:20.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:20.948+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:20.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:20.952+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:21.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:21.102+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:21.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:21.444+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:21.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:21.517+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:21.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:21.528+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:21.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:21.769+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:21.902 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:21.895+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:21.966 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:21.959+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:21.966 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:21.960+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:22.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:22.122+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:22.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:22.440+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:22.479 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:22.473+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:22.538 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:22.529+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:22.790 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:22.783+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:22.908 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:22.887+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:22.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:22.919+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:22.928 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:22.920+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:23.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:23.175+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:23.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:23.432+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:23.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:23.518+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:23.588 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:23.580+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:23.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:23.768+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:23.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:23.871+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:23.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:23.945+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:23.953 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:23.948+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:24.213 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:24.203+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:24.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:24.442+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:24.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:24.483+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:24.606 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:24.600+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:24.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:24.810+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:24.916 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:24.908+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:24.917 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:24.910+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:24.929 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:24.919+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:25.179 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:51:25.170+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e637 v637) 2019-11-29T18:51:25.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:25.250+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:25.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:25.446+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:25.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:25.511+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:25.641 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:25.635+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:25.870 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:25.863+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:25.906 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:25.899+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:25.907 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:25.900+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:25.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:25.944+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:26.238 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:26.213+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:26.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:26.466+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:26.507 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:26.500+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:26.676 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:26.669+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:26.898 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:26.892+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:26.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:26.897+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:26.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:26.898+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:26.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:26.913+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:27.235 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:27.228+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:27.467 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:27.461+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:27.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:27.531+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:27.730 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:27.721+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:27.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:27.876+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:27.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:27.929+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:27.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:27.931+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:27.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:27.962+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:28.243 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:28.236+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:28.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:28.437+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:28.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:28.494+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:28.753 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:28.741+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:28.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:28.897+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:28.931 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:28.924+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:28.932 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:28.926+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:29.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:28.988+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:29.243 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:29.236+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:29.475 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:29.468+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:29.528 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:29.521+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:29.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:29.708+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:29.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:29.933+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:29.979 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:29.972+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:29.980 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:29.974+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:30.001 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:29.987+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:30.196 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:51:30.189+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e637 v637) 2019-11-29T18:51:30.237 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:30.230+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:30.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:30.442+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:30.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:30.552+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:30.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:30.669+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:30.915 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:30.908+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:30.997 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:30.990+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:30.998 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:30.992+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:31.029 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:31.021+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:31.279 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:31.273+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:31.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:31.439+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:31.555 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:31.548+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:31.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:31.716+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:31.925 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:31.918+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:31.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:31.943+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:31.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:31.945+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:32.040 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:32.033+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:32.296 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:32.283+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:32.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:32.479+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:32.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:32.506+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:32.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:32.695+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:32.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:32.902+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:32.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:32.950+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:32.958 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:32.952+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:33.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:33.075+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:33.321 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:33.314+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:33.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:33.444+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:33.551 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:33.543+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:33.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:33.666+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:33.926 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:33.919+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:33.928 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:33.923+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:33.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:33.941+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:34.091 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:34.081+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:34.341 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:34.327+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:34.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:51:34.478+0000 1694c700 -1 osd.6 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.639141+0000 front 2019-11-29T18:50:08.526928+0000 (oldest deadline 2019-11-29T18:50:53.782885+0000) 2019-11-29T18:51:34.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:51:34.581+0000 1694c700 -1 osd.7 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.485358+0000 front 2019-11-29T18:50:10.571430+0000 (oldest deadline 2019-11-29T18:50:56.281526+0000) 2019-11-29T18:51:34.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:34.667+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:34.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:51:34.938+0000 1694c700 -1 osd.2 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:11.027057+0000 front 2019-11-29T18:50:11.338818+0000 (oldest deadline 2019-11-29T18:50:53.223395+0000) 2019-11-29T18:51:34.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:34.954+0000 1694c700 -1 osd.0 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:50:22.982015+0000 (oldest deadline 2019-11-29T18:51:02.982015+0000) 2019-11-29T18:51:34.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:34.956+0000 1694c700 -1 osd.0 637 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e635) 2019-11-29T18:51:35.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:35.090+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:51:35.282 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:51:35.269+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e637 v637) 2019-11-29T18:51:35.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:51:35.325+0000 1694c700 -1 osd.1 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.613141+0000 front 2019-11-29T18:50:10.641509+0000 (oldest deadline 2019-11-29T18:50:55.189641+0000) 2019-11-29T18:51:35.636 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:51:35.629+0000 1694c700 -1 osd.5 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:08.942267+0000 front 2019-11-29T18:50:08.922569+0000 (oldest deadline 2019-11-29T18:50:52.403869+0000) 2019-11-29T18:51:35.960 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:51:35.932+0000 34f8a700 -1 osd.0 638 build_incremental_map_msg missing incremental map 636 2019-11-29T18:51:36.092 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:51:36.080+0000 1694c700 -1 osd.4 637 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:50:10.748162+0000 front 2019-11-29T18:50:11.265662+0000 (oldest deadline 2019-11-29T18:50:56.497941+0000) 2019-11-29T18:52:00.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:52:00.894+0000 2144f700 -1 reset not still connected to 0x10222d30 2019-11-29T18:53:03.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:03.880+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:04.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:04.521+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:04.870 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:04.861+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:05.337 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:05.327+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:05.492 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:05.478+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:05.910 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:05.901+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:06.105 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:06.096+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:06.323 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:06.316+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:06.466 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:06.457+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:06.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:06.880+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:07.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:07.055+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:07.319 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:07.310+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:07.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:07.430+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:07.445 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:07.438+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:07.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:07.878+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:08.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:08.059+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:08.275 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:08.267+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:08.465 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:08.458+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:08.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:08.488+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:08.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:08.826+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:08.910 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:08.902+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:09.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:09.108+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:09.248 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:09.240+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:09.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:09.414+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:09.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:09.504+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:09.799 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:09.791+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:09.873 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:09.865+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:10.078 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:10.071+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:10.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:10.261+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:10.425 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:10.418+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:10.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:10.466+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:10.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:10.819+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:10.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:10.844+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:11.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:11.126+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:11.267 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:11.259+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:11.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:11.393+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:11.428 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:11.420+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:11.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:11.813+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:11.865 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:11.855+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:12.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:12.120+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:12.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:12.220+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:12.444 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:12.437+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:12.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:12.469+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:12.786 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:12.775+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:12.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:12.906+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:13.090 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:13.083+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:13.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:13.186+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:13.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:13.405+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:13.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:13.428+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:13.826 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:13.819+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:13.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:13.898+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:14.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:14.090+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:14.223 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:14.215+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:14.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:14.408+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:14.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:14.438+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:14.790 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:14.781+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:14.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:14.895+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:15.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:15.135+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:15.190 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:15.183+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:15.411 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:15.397+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:15.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:15.417+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:15.835 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:15.828+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:15.895 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:15.888+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:16.147 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:16.141+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:16.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:16.150+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:16.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:16.404+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:16.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:16.465+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:16.846 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:16.839+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:16.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:16.896+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:17.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:17.108+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:17.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:17.141+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:17.460 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:17.452+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:17.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:17.454+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:17.818 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:17.811+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:17.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:17.875+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:18.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:18.100+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:18.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:18.134+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:18.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:18.478+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:18.511 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:18.504+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:18.832 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:18.824+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:18.919 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:18.911+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:19.132 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:19.125+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:19.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:19.154+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:19.486 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:19.477+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:19.544 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:19.531+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:19.870 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:19.863+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:19.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:19.896+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:20.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:20.115+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:20.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:20.134+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:20.446 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:20.438+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:20.498 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:20.491+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:20.876 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:20.865+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:20.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:20.949+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:21.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:21.075+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:21.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:21.151+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:21.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:21.489+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:21.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:21.499+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:21.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:21.842+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:21.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:21.949+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:22.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:22.085+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:22.166 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:22.158+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:22.385 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:22.377+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:22.459 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:22.450+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:22.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:22.537+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:22.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:22.801+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:22.943 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:22.937+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:23.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:23.067+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:23.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:23.186+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:23.357 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:23.349+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:23.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:23.444+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:23.561 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:23.553+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:23.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:23.846+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:23.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:23.906+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:24.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:24.041+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:24.218 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:24.211+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:24.330 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:24.322+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:24.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:24.467+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:24.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:24.603+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:24.848 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:24.841+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:24.901 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:24.895+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:25.092 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:25.084+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:25.229 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:25.222+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:25.359 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:25.352+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:25.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:25.464+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:25.627 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:25.620+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:25.814 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:25.806+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:25.949 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:25.943+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:26.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:26.083+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:26.226 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:26.215+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:26.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:26.323+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:26.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:26.434+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:26.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:26.650+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:26.769 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:26.761+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:26.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:26.923+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:27.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:27.124+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:27.224 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:27.217+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:27.307 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:27.298+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:27.427 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:27.420+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:27.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:27.654+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:27.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:27.771+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:27.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:27.897+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:28.136 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:28.129+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:28.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:28.205+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:28.353 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:28.346+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:28.402 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:28.394+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:28.644 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:28.636+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:28.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:28.814+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:28.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:28.885+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:29.173 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:29.166+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:29.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:29.252+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:29.394 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:29.386+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:29.439 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:29.432+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:29.644 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:29.636+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:29.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:29.841+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:29.873 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:29.861+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:30.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:30.143+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:30.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:30.239+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:30.365 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:30.358+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:30.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:30.388+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:30.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:30.628+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:30.827 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:30.814+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:30.856 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:30.849+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:31.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:31.156+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:31.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:31.220+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:31.350 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:31.343+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:31.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:31.393+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:31.599 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:31.591+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:31.805 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:31.795+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:31.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:31.883+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:32.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:32.156+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:32.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:32.181+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:32.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:32.358+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:32.376 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:32.370+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:32.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:32.582+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:32.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:32.755+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:32.944 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:32.933+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:33.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:33.143+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:33.221 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:33.213+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:33.364 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:33.358+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:33.419 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:33.412+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:33.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:33.543+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:33.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:33.792+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:33.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:33.946+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:34.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:34.156+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:34.191 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:34.184+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:34.400 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:34.386+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:34.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:34.410+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:34.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:34.587+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:34.841 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:34.834+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:34.957 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:34.948+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:35.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:35.134+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:35.196 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:35.183+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:35.390 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:35.380+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:35.409 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:35.402+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:35.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:35.574+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:35.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:35.814+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:35.823 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:53:35.815+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e642 v642) 2019-11-29T18:53:35.978 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:35.971+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:36.128 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:36.120+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:36.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:36.141+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:36.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:36.403+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:36.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:36.441+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:36.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:36.535+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:36.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:36.858+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:37.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:37.001+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:37.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:37.105+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:37.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:37.178+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:37.421 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:37.413+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:37.448 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:37.437+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:37.501 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:37.493+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:37.893 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:37.885+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:37.966 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:37.956+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:38.103 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:38.086+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:38.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:38.207+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:38.402 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:38.392+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:38.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:38.422+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:38.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:38.449+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:38.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:38.851+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:39.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:39.010+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:39.136 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:39.129+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:39.269 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:39.254+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:39.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:39.389+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:39.408 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:39.402+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:39.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:39.482+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:39.844 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:39.836+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:40.044 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:40.036+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:40.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:53:40.150+0000 1694c700 -1 osd.6 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:20.703235+0000 front 2019-11-29T18:52:20.589915+0000 (oldest deadline 2019-11-29T18:53:05.228223+0000) 2019-11-29T18:53:40.311 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:53:40.303+0000 1694c700 -1 osd.5 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.490303+0000 front 2019-11-29T18:52:24.244786+0000 (oldest deadline 2019-11-29T18:53:04.573209+0000) 2019-11-29T18:53:40.383 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:53:40.375+0000 1694c700 -1 osd.3 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:21.823747+0000 front 2019-11-29T18:52:22.115958+0000 (oldest deadline 2019-11-29T18:53:21.634342+0000) 2019-11-29T18:53:40.439 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:53:40.432+0000 1694c700 -1 osd.1 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.197005+0000 front 2019-11-29T18:52:23.314222+0000 (oldest deadline 2019-11-29T18:53:06.681982+0000) 2019-11-29T18:53:40.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:40.439+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:53:40.870 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:53:40.863+0000 1694c700 -1 osd.7 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:23.649157+0000 front 2019-11-29T18:52:22.422157+0000 (oldest deadline 2019-11-29T18:53:03.502289+0000) 2019-11-29T18:53:40.899 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:53:40.886+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e642 v642) 2019-11-29T18:53:41.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:53:41.073+0000 1694c700 -1 osd.2 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:22.076247+0000 front 2019-11-29T18:52:22.117983+0000 (oldest deadline 2019-11-29T18:53:07.947385+0000) 2019-11-29T18:53:41.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:53:41.446+0000 1694c700 -1 osd.4 642 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:52:18.765473+0000 front 2019-11-29T18:52:18.340096+0000 (oldest deadline 2019-11-29T18:53:04.111607+0000) 2019-11-29T18:54:40.039 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:40.030+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:40.157 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:40.148+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:40.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:40.241+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:40.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:40.520+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:41.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:41.014+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:41.179 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:41.172+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:41.250 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:41.244+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:41.517 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:41.509+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:42.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:42.010+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:42.186 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:42.179+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:42.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:42.202+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:42.516 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:42.509+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:42.878 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:42.870+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:42.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:42.986+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:43.172 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:43.165+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:43.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:43.226+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:43.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:43.511+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:43.672 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:43.666+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:43.922 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:43.916+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:43.940 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:43.933+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:43.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:43.972+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:44.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:44.138+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:44.210 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:44.202+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:44.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:44.489+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:44.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:44.637+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:44.884 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:44.877+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:44.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:44.972+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:45.014 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:45.007+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:45.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:45.174+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:45.184 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:45.176+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:45.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:45.531+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:45.660 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:45.653+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:45.870 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:38:54.005 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:45.874+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:45.882 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:38:54.017 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.889 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:38:54.069 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.895 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:38:54.075 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.899 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:38:54.079 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.900 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:38:54.080 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:45.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:45.959+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:46.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:46.038+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:46.124 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:38:54.304 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:46.128 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:38:54.263 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:46.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:38:54.323 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:54:46.223 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:46.215+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:46.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:46.220+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:46.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:46.506+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:46.711 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:46.703+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:46.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:46.900+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:46.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:46.970+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:47.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:47.073+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:47.227 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:47.219+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:47.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:47.248+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:47.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:47.460+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:47.679 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:47.672+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:47.957 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:47.950+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:48.019 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:48.014+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:48.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:48.109+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:48.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:48.185+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:48.254 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:48.247+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:48.452 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:48.445+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:48.720 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:48.714+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:49.003 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:48.997+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:49.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:49.001+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:49.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:49.092+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:49.210 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:49.203+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:49.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:49.259+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:49.457 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:49.449+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:49.727 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:49.721+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:49.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:49.724+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:49.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:49.967+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:50.019 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:50.011+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:50.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:50.063+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:50.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:50.205+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:50.248 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:50.241+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:50.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:50.465+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:50.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:50.767+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:50.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:50.768+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:50.989 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:50.982+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:51.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:51.005+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:51.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:51.044+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:51.242 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:51.235+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:51.248 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:51.241+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:51.512 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:51.505+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:51.795 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:51.788+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:51.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:51.792+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:51.994 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:51.987+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:52.003 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:51.996+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:52.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:52.096+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:52.229 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:52.222+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:52.286 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:52.278+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:52.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:52.526+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:52.778 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:52.770+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:52.778 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:52.772+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:52.979 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:52.973+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:52.980 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:52.973+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:53.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:53.072+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:53.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:53.210+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:53.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:53.309+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:53.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:53.485+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:53.758 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:53.751+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:53.759 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:53.754+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:54.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:54.010+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:54.020 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:54.014+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:54.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:54.048+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:54.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:54.191+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:54.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:54.334+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:54.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:54.494+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:54.717 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:54.709+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:54.717 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:54.712+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:55.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:55.020+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:55.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:55.036+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:55.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:55.064+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:55.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:55.237+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:55.373 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:55.366+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:55.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:55.479+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:55.674 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:55.667+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:55.675 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:55.669+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:56.024 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:56.017+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:56.039 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:56.032+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:56.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:56.091+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:56.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:56.281+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:56.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:56.416+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:56.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:56.497+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:56.703 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:56.696+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:56.704 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:56.698+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:57.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:57.028+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:57.050 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:57.043+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:57.089 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:57.082+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:57.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:57.295+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:57.435 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:57.428+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:57.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:57.540+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:57.693 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:57.685+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:57.694 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:57.687+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:58.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:58.064+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:58.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:58.068+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:58.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:58.123+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:58.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:58.265+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:58.408 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:58.402+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:58.581 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:58.574+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:58.733 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:58.725+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:58.733 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:58.727+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:54:59.044 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:54:59.037+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:54:59.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:54:59.085+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:54:59.116 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:54:59.108+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:54:59.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:54:59.224+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:54:59.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:54:59.430+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:54:59.574 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:54:59.567+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:54:59.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:59.731+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:54:59.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:54:59.734+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:00.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:00.049+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:00.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:00.088+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:00.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:00.130+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:00.269 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:00.262+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:00.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:00.389+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:00.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:00.531+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:00.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:00.740+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:00.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:00.742+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:01.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:01.050+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:01.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:01.087+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:01.174 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:01.165+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:01.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:01.250+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:01.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:01.373+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:01.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:01.539+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:01.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:01.781+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:01.792 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:01.786+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:02.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:02.045+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:02.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:02.092+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:02.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:02.146+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:02.220 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:02.212+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:02.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:02.386+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:02.560 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:02.547+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:02.813 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:02.806+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:02.817 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:02.811+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:03.042 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:03.037+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:03.095 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:03.087+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:03.118 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:03.106+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:03.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:03.179+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:03.370 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:03.364+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:03.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:03.540+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:03.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:03.843+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:03.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:03.846+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:04.005 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:03.998+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:04.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:04.076+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:04.135 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:04.128+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:04.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:04.229+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:04.343 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:04.336+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:04.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:04.529+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:04.878 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:04.871+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:04.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:04.873+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:04.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:04.973+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:05.037 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:05.030+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:05.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:05.101+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:05.236 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:05.228+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:05.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:05.353+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:05.545 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:05.533+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:05.858 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:05.851+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:05.858 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:05.853+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:05.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:05.957+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:06.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:06.049+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:06.078 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:06.071+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:06.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:06.238+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:06.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:06.401+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:06.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:06.537+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:06.900 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:06.893+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:06.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:06.894+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:06.931 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:06.925+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:07.062 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:07.055+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:07.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:07.097+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:07.296 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:07.290+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:07.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:07.398+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:07.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:07.559+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:07.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:07.895+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:07.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:07.897+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:07.972 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:07.965+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:08.057 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:08.050+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:08.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:08.111+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:08.296 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:08.288+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:08.378 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:08.371+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:08.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:08.576+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:08.930 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:08.923+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:08.931 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:08.926+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:09.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:09.002+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:09.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:09.096+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:09.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:09.096+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:09.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:09.324+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:09.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:09.409+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:09.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:09.598+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:09.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:09.911+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:09.919 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:09.913+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:10.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:10.049+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:10.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:10.050+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:10.155 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:10.148+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:10.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:10.378+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:10.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:10.403+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:10.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:10.614+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:10.934 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:10.926+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:10.935 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:10.928+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:11.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:11.040+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:11.063 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:11.055+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:11.206 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:11.198+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:11.355 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:11.349+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:11.420 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:11.412+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:11.611 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:11.603+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:11.722 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:55:11.713+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 49sec e650 v650) 2019-11-29T18:55:11.979 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:11.972+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:11.980 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:11.973+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:12.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:12.034+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:12.059 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:12.053+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:12.242 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:12.235+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:12.347 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:12.340+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:12.390 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:12.383+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:12.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:12.618+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:13.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:12.997+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:13.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:12.998+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:13.030 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:13.023+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:13.053 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:13.046+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:13.251 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:13.245+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:13.312 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:13.303+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:13.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:13.383+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:13.614 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:13.607+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:13.968 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:13.962+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:13.971 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:13.965+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:14.003 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:13.997+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:14.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:14.044+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:14.225 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:14.217+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:14.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:14.325+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:14.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:14.408+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:14.569 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:14.562+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:14.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:14.934+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:14.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:14.935+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:14.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:14.962+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:15.044 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:15.037+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:15.223 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:15.216+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:15.360 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:15.352+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:15.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:15.392+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:15.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:15.599+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:15.907 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:15.899+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:15.907 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:15.902+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:15.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:15.988+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:16.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:16.004+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:16.232 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:16.223+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:16.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:16.397+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:16.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:16.405+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:16.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:16.650+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:16.784 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:55:16.778+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 49sec e650 v650) 2019-11-29T18:55:16.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:16.943+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:16.951 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:16.945+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:17.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:17.033+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:17.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:17.039+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:17.268 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:17.260+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:17.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:17.386+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:17.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:17.415+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:17.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:17.683+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:17.933 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:17.925+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:17.933 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:17.927+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:18.029 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:18.022+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:18.038 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:18.030+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:18.292 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:18.283+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:18.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:18.402+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:18.418 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:18.410+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:18.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:18.673+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:18.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:18.945+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:18.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:18.949+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:19.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:19.006+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:19.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:19.042+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:19.307 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:19.298+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:19.375 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:19.368+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:19.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:19.386+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:19.719 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:19.706+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:19.935 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:19.928+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:19.935 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:19.929+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:20.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:20.008+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:20.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:20.071+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:20.311 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:20.304+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:20.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:20.403+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:20.436 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:20.428+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:20.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:20.678+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:20.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:20.884+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:20.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:20.885+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:21.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:21.020+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:21.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:21.106+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:21.328 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:55:21.320+0000 1694c700 -1 osd.4 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.467459+0000 front 2019-11-29T18:53:57.481886+0000 (oldest deadline 2019-11-29T18:54:42.602798+0000) 2019-11-29T18:55:21.403 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:55:21.397+0000 1694c700 -1 osd.1 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.463712+0000 front 2019-11-29T18:53:57.330670+0000 (oldest deadline 2019-11-29T18:54:39.587187+0000) 2019-11-29T18:55:21.472 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:21.462+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:21.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:55:21.657+0000 1694c700 -1 osd.7 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.266170+0000 front 2019-11-29T18:53:57.267944+0000 (oldest deadline 2019-11-29T18:54:39.529175+0000) 2019-11-29T18:55:21.861 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:55:21.854+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 49sec e650 v650) 2019-11-29T18:55:21.883 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:21.876+0000 1694c700 -1 osd.0 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:54:09.152227+0000 (oldest deadline 2019-11-29T18:54:49.152227+0000) 2019-11-29T18:55:21.892 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:55:21.880+0000 1694c700 -1 osd.0 650 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:116864 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e647) 2019-11-29T18:55:22.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:55:21.993+0000 1694c700 -1 osd.6 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:57.139269+0000 front 2019-11-29T18:53:57.145707+0000 (oldest deadline 2019-11-29T18:54:42.984102+0000) 2019-11-29T18:55:22.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:55:22.075+0000 1694c700 -1 osd.2 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:51.190997+0000 front 2019-11-29T18:53:50.819142+0000 (oldest deadline 2019-11-29T18:54:39.613281+0000) 2019-11-29T18:55:22.515 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:55:22.508+0000 1694c700 -1 osd.5 650 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:53:55.589775+0000 front 2019-11-29T18:53:55.581736+0000 (oldest deadline 2019-11-29T18:54:39.663355+0000) 2019-11-29T18:55:47.234 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:55:47.228+0000 2144f700 -1 reset not still connected to 0x15885910 2019-11-29T18:56:32.498 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:40:40.632 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.513 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:40:40.647 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.577 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:40:40.758 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.580 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:40:40.760 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.587 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:40:40.767 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.624 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:40:40.803 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.697 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:40:40.832 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.713 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:40:40.893 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:32.745 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:40:40.925 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:56:45.854 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:45.847+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:46.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:46.812+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:47.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:47.831+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:48.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:48.832+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:49.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:49.860+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:50.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:50.827+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:51.810 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:51.804+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:52.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:52.787+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:52.799 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:52.792+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:52.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:52.936+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:52.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:52.937+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:53.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:53.526+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:53.758 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:53.750+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:53.762 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:53.755+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:53.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:53.910+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:53.984 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:53.974+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:54.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:54.561+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:54.728 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:54.720+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:54.729 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:54.722+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:54.906 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:54.896+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:54.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:54.946+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:54.970 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:54.960+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:55.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:55.552+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:55.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:55.688+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:55.698 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:55.690+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:55.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:55.903+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:55.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:55.908+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:56.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:55.999+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:56.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:56:56.321+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:56:56.558 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:56.550+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:56.655 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:56.647+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:56.656 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:56.650+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:56.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:56.888+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:56.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:56.945+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:56.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:56:56.959+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:56:57.010 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:57.004+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:57.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:56:57.314+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:56:57.603 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:57.595+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:57.643 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:57.635+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:57.644 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:57.636+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:57.865 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:57.857+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:57.967 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:56:57.959+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:56:57.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:57.979+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:58.063 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:58.055+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:58.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:56:58.358+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:56:58.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:58.640+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:58.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:58.669+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:58.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:58.671+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:58.874 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:58.866+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:58.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:58.951+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:56:58.959 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:56:58.947+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:56:59.055 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:56:59.048+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:56:59.370 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:56:59.361+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:56:59.676 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:56:59.666+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:56:59.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:59.685+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:56:59.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:56:59.690+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:56:59.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:56:59.855+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:56:59.946 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:56:59.938+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:56:59.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:56:59.984+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:00.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:00.100+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:00.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:00.368+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:00.676 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:00.669+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:00.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:00.671+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:00.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:00.678+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:00.854 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:00.847+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:00.935 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:00.927+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:01.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:00.999+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:01.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:01.143+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:01.382 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:01.375+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:01.665 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:01.657+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:01.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:01.660+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:01.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:01.700+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:01.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:01.873+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:01.949 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:01.941+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:02.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:02.040+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:02.130 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:02.122+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:02.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:02.421+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:02.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:02.650+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:02.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:02.652+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:02.744 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:02.737+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:02.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:02.892+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:02.912 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:02.905+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:03.038 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:03.031+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:03.153 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:03.145+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:03.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:03.455+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:03.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:03.681+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:03.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:03.687+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:03.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:03.781+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:03.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:03.876+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:03.913 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:03.906+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:04.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:04.034+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:04.187 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:04.179+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:04.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:04.504+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:04.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:04.734+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:04.743 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:04.737+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:04.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:04.822+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:04.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:04.901+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:04.911 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:04.905+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:05.029 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:05.022+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:05.182 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:05.175+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:05.567 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:05.558+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:05.790 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:05.783+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:05.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:05.788+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:05.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:05.792+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:05.900 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:05.893+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:05.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:05.935+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:05.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:05.980+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:06.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:06.188+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:06.567 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:06.560+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:06.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:06.760+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:06.809 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:06.801+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:06.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:06.806+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:06.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:06.921+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:06.934 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:06.928+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:06.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:06.970+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:07.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:07.199+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:07.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:07.581+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:07.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:07.765+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:07.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:07.854+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:07.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:07.856+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:07.921 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:07.894+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:07.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:07.972+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:08.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:08.002+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:08.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:08.217+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:08.599 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:08.591+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:08.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:08.775+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:08.882 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:08.874+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:08.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:08.877+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:08.951 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:08.945+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:09.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:09.002+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:09.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:09.028+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:09.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:09.258+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:09.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:09.619+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:09.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:09.792+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:09.857 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:09.849+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:09.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:09.852+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:09.950 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:09.943+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:09.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:09.981+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:10.008 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:10.001+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:10.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:10.288+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:10.593 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:10.586+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:10.762 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:10.752+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:10.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:10.879+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:10.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:10.881+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:10.939 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:10.932+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:10.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:10.956+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:11.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:10.997+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:11.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:11.309+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:11.638 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:11.630+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:11.784 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:11.777+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:11.923 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:11.916+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:11.927 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:11.917+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:11.947 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:11.939+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:11.960 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:11.952+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:12.001 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:11.995+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:12.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:12.333+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:12.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:12.621+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:12.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:12.747+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:12.772 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:41:20.905 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.785 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:41:20.917 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.813 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:41:20.992 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.827 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:41:21.006 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.827 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:41:21.006 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.843 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:41:21.023 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.884 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:41:21.063 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.891 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:41:21.071 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.893 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:41:21.027 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:57:12.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:12.921+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:12.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:12.955+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:12.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:12.958+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:12.972 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:12.965+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:12.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:12.983+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:13.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:13.297+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:13.598 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:13.592+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:13.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:13.767+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:13.888 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:13.880+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:13.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:13.937+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:13.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:13.940+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:13.968 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:13.962+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:14.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:14.008+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:14.317 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:14.311+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:14.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:14.620+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:14.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:14.801+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:14.882 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:14.875+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:14.947 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:14.940+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:14.989 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:14.983+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:14.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:14.984+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:15.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:15.012+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:15.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:15.297+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:15.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:15.637+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:15.768 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:15.761+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:15.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:15.830+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:15.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:15.959+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:16.013 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:16.005+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:16.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:16.029+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:16.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:16.034+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:16.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:16.267+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:16.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:16.643+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:16.798 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:16.791+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:16.885 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:16.878+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:16.977 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:16.969+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:17.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:17.014+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:17.023 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:17.017+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:17.056 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:17.049+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:17.250 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:17.242+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:17.661 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:17.652+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:17.798 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:17.791+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:17.937 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:17.924+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:18.024 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:18.016+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:18.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:18.018+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:18.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:18.022+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:18.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:18.064+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:18.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:18.277+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:18.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:18.664+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:18.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:18.748+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:18.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:18.966+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:18.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:18.976+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:18.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:18.980+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:19.051 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:19.044+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:19.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:19.062+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:19.253 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:19.241+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:19.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:19.680+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:19.770 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:19.762+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:19.973 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:19.966+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:20.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:20.029+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:20.038 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:20.031+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:20.052 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:20.044+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:20.104 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:20.096+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:20.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:20.208+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:20.659 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:20.650+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:20.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:20.750+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:20.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:20.989+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:20.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:20.992+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:21.015 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:21.005+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:21.021 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:21.013+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:21.139 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:21.132+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:21.207 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:21.199+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:21.650 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:21.643+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:21.795 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:21.787+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:22.025 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:22.017+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:22.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:22.019+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:22.044 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:22.037+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:22.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:22.044+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:22.118 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:22.111+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:22.190 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:22.183+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:22.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:22.628+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:22.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:22.816+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:22.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:22.981+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:22.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:22.984+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:23.008 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:23.001+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:23.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:23.012+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:23.124 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:23.116+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:23.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:23.213+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:23.670 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:23.663+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:23.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:23.856+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:23.957 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:23.950+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:23.973 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:23.963+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:23.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:23.954+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:23.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:23.986+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:24.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:24.164+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:24.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:24.211+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:24.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:24.659+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:24.904 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:24.896+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:24.927 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:24.920+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:24.928 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:24.922+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:24.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:24.954+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:25.017 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:25.009+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:25.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:25.176+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:25.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:25.211+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:25.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:25.620+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:25.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:25.897+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:25.939 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:25.932+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:25.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:25.937+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:26.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:26.006+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:26.024 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:26.016+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:26.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:26.172+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:26.203 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:26.194+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:26.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:26.615+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:26.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:26.911+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:26.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:26.987+0000 1694c700 -1 osd.6 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.135982+0000 front 2019-11-29T18:56:11.087318+0000 (oldest deadline 2019-11-29T18:56:52.742723+0000) 2019-11-29T18:57:26.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:26.988+0000 1694c700 -1 osd.6 656 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:27.050 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T18:57:27.044+0000 1694c700 -1 osd.3 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.415088+0000 front 2019-11-29T18:56:11.328990+0000 (oldest deadline 2019-11-29T18:56:56.552975+0000) 2019-11-29T18:57:27.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:57:27.048+0000 1694c700 -1 osd.2 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:11.099111+0000 front 2019-11-29T18:56:11.125187+0000 (oldest deadline 2019-11-29T18:56:54.396911+0000) 2019-11-29T18:57:27.177 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:27.170+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:27.188 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:57:27.179+0000 1694c700 -1 osd.1 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.846593+0000 front 2019-11-29T18:56:10.899414+0000 (oldest deadline 2019-11-29T18:56:52.506317+0000) 2019-11-29T18:57:27.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:57:27.626+0000 1694c700 -1 osd.7 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:10.394406+0000 front 2019-11-29T18:56:10.411102+0000 (oldest deadline 2019-11-29T18:56:55.658756+0000) 2019-11-29T18:57:27.821 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:57:27.814+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e656 v656) 2019-11-29T18:57:27.894 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:57:27.888+0000 1694c700 -1 osd.5 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.479980+0000 front 2019-11-29T18:56:08.553528+0000 (oldest deadline 2019-11-29T18:56:53.134207+0000) 2019-11-29T18:57:28.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:27.999+0000 1694c700 -1 osd.6 657 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:57:28.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:57:28.205+0000 1694c700 -1 osd.4 656 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:56:08.814044+0000 front 2019-11-29T18:56:08.737413+0000 (oldest deadline 2019-11-29T18:56:51.970292+0000) 2019-11-29T18:57:29.074 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:57:29.027+0000 1694c700 -1 osd.6 657 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117979 7.7 7:ea2a455c:::2019-11-29-18-9baad822-b080-4db2-b995-bf7cc78f9da0.4528.654-7eeb030aa37f41e4a15304a3509f218b:head [append 0~395 in=395b] snapc 0=[] ondisk+write+known_if_redirected e656) 2019-11-29T18:58:04.121 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:04.110+0000 37f90700 -1 osd.0 662 build_incremental_map_msg missing incremental map 662 2019-11-29T18:58:05.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:05.265+0000 38f92700 -1 osd.0 663 build_incremental_map_msg missing incremental map 662 2019-11-29T18:58:25.351 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:25.343+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:26.388 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:26.381+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:26.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:26.667+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:27.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:27.055+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:27.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:27.326+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:27.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:27.414+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:27.656 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:27.638+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:28.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:28.050+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:28.298 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:28.289+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:28.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:28.366+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:28.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:28.378+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:28.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:28.677+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:29.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:29.044+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:29.285 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:29.278+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:29.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:29.346+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:29.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:29.375+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:29.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:29.436+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:29.701 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:29.694+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:30.035 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:30.027+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:30.286 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:30.279+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:30.321 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:30.314+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:30.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:30.366+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:30.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:30.460+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:30.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:30.649+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:31.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:31.009+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:31.282 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:31.275+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:31.313 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:31.306+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:31.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:31.345+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:31.486 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:31.478+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:31.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:31.657+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:31.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:31.971+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:32.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:32.317+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:32.327 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:32.320+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:32.362 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:32.354+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:32.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:32.469+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:32.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:32.677+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:32.730 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:32.724+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:33.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:33.021+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:33.309 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:33.302+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:33.334 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:33.326+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:33.366 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:33.358+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:33.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:33.511+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:33.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:33.633+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:33.701 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:33.696+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:34.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:34.039+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:34.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:34.277+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:34.347 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:34.340+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:34.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:34.380+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:34.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:34.520+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:34.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:34.598+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:34.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:34.653+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:34.963 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:42:43.097 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:34.969 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:42:43.104 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:34.980 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:42:43.156 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:34.980 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:42:43.159 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:34.985 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:42:43.164 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:34.985 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:42:43.166 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:35.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:35.049+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:35.098 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:42:43.277 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:35.099 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:42:43.279 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:35.122 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:42:43.256 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T18:58:35.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:35.240+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:35.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:35.326+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:35.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:35.400+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:35.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:35.488+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:35.615 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:35.607+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:35.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:35.653+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:36.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:36.036+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:36.213 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:36.205+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:36.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:36.377+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:36.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:36.431+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:36.493 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:36.486+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:36.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:36.656+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:36.677 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:36.671+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:37.051 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:37.043+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:37.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:37.195+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:37.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:37.427+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:37.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:37.459+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:37.493 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:37.485+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:37.651 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:37.644+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:37.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:37.650+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:38.065 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:38.057+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:38.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:38.211+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:38.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:38.429+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:38.490 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:38.480+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:38.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:38.493+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:38.625 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:38.618+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:38.634 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:38.619+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:38.680 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:38.672+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:39.035 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:39.028+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:39.193 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:39.186+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:39.420 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:39.414+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:39.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:39.507+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:39.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:39.522+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:39.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:39.572+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:39.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:39.573+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:39.667 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:39.660+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:40.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:40.001+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:40.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:40.143+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:40.414 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:40.407+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:40.542 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:40.534+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:40.546 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:40.538+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:40.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:40.622+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:40.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:40.625+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:40.656 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:40.649+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:41.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:41.003+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:41.179 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:41.169+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:41.428 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:41.421+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:41.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:41.505+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:41.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:41.561+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:41.643 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:41.624+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:41.644 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:41.626+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:41.717 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:41.709+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:42.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:42.003+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:42.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:42.123+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:42.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:42.386+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:42.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:42.499+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:42.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:42.549+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:42.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:42.586+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:42.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:42.590+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:42.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:42.680+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:42.991 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:42.985+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:43.175 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:43.168+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:43.413 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:43.406+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:43.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:43.498+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:43.560 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:43.553+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:43.641 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:43.632+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:43.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:43.636+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:43.662 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:43.655+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:43.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:43.957+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:44.135 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:44.127+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:44.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:44.428+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:44.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:44.467+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:44.584 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:44.576+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:44.639 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:44.632+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:44.639 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:44.633+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:44.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:44.647+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:44.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:44.939+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:45.111 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:45.102+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:45.399 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:45.392+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:45.433 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:45.426+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:45.588 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:45.580+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:45.602 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:45.595+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:45.603 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:45.597+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:45.701 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:45.695+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:45.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:45.954+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:46.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:46.085+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:46.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:46.374+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:46.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:46.411+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:46.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:46.577+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:46.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:46.579+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:46.624 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:46.617+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:46.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:46.739+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:46.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:46.964+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:47.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:47.067+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:47.375 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:47.368+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:47.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:47.373+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:47.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:47.565+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:47.574 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:47.567+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:47.611 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:47.605+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:47.770 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:47.762+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:48.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:48.002+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:48.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:48.036+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:48.344 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:48.337+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:48.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:48.427+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:48.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:48.578+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:48.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:48.580+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:48.590 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:48.582+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:48.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:48.816+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:49.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:49.043+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:49.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:49.049+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:49.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:49.299+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:49.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:49.385+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:49.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:49.558+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:49.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:49.559+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:49.617 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:49.611+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:49.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:49.832+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:50.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:50.066+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:50.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:50.091+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:50.328 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:50.322+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:50.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:50.390+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:50.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:50.552+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:50.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:50.556+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:50.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:50.588+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:50.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:50.880+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:51.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:51.049+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:51.131 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:51.124+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:51.360 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:51.351+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:51.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:51.425+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:51.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:51.590+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:51.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:51.601+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:51.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:51.603+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:51.922 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:51.915+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:52.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:52.086+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:52.116 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:52.109+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:52.403 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:52.396+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:52.445 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:52.438+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:52.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:52.550+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:52.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:52.642+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:52.649 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:52.644+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:52.907 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:52.897+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:53.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:53.042+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:53.114 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:53.108+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:53.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:53.366+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:53.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:53.443+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:53.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:53.548+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:53.696 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:53.689+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:53.697 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:53.691+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:53.911 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:53.904+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:54.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:54.047+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:54.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:54.161+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:54.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:54.326+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:54.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:54.429+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:54.540 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:54.532+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:54.691 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:54.684+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:54.692 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:54.686+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:54.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:54.891+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:55.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:55.083+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:55.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:55.181+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:55.299 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:55.292+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:55.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:55.399+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:55.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:55.545+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:55.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:55.705+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:55.714 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:55.707+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:55.900 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:55.892+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:56.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:56.078+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:56.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:56.196+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:56.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:56.272+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:56.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:56.418+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:56.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:56.506+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:56.746 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:56.739+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:56.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:56.741+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:56.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:56.871+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:57.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:57.079+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:57.224 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:57.216+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:57.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:57.273+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:57.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:57.380+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:57.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:57.487+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:57.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:57.734+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:57.743 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:57.738+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:57.900 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:57.893+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:58.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:58.039+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:58.128 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:58:58.122+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e663 v663) 2019-11-29T18:58:58.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:58.209+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:58.329 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:58.322+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:58.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:58.395+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:58.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:58.462+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:58.734 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:58.727+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:58.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:58.730+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:58.889 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:58.881+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:58:59.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:58:59.050+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:58:59.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:58:59.168+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:58:59.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:58:59.296+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:58:59.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:58:59.357+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:58:59.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:58:59.512+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:58:59.746 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:59.740+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:58:59.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:58:59.742+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:58:59.904 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:58:59.897+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:00.077 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:00.070+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:00.180 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:00.172+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:00.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:00.294+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:00.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:00.366+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:00.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:00.494+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:00.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:00.791+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:00.801 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:00.795+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:00.872 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:00.864+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:01.055 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:01.048+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:01.181 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:01.174+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:01.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:01.298+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:01.379 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:01.372+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:01.462 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:01.455+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:01.813 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:01.805+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:01.813 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:01.807+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:01.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:01.895+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:02.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:02.075+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:02.237 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:02.229+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:02.313 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:02.294+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:02.408 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:02.400+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:02.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:02.469+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:02.850 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:02.842+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:02.851 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:02.844+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:02.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:02.885+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:03.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:03.035+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:03.136 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:59:03.130+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e663 v663) 2019-11-29T18:59:03.250 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:03.242+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:03.282 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:03.274+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:03.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:03.424+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:03.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:03.519+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:03.814 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:03.806+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:03.817 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:03.811+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:03.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:03.861+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:04.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:04.085+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:04.229 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:04.221+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:04.329 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:04.316+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:04.422 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:04.405+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:04.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:04.541+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:04.830 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:04.823+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:04.830 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:04.824+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:04.880 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:04.872+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:05.118 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:05.110+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:05.233 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:05.224+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:05.282 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:05.274+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:05.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:05.389+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:05.576 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:05.568+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:05.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:05.790+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:05.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:05.793+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:05.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:05.848+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:06.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:06.074+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:06.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:06.271+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:06.285 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:06.274+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:06.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:06.439+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:06.606 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:06.598+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:06.791 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:06.784+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:06.791 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:06.785+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:06.860 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:06.849+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:07.059 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:07.052+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:07.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:07.318+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:07.326 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:07.318+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:07.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T18:59:07.467+0000 1694c700 -1 osd.4 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:44.261986+0000 front 2019-11-29T18:57:44.364504+0000 (oldest deadline 2019-11-29T18:58:27.726521+0000) 2019-11-29T18:59:07.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T18:59:07.603+0000 1694c700 -1 osd.1 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.690264+0000 front 2019-11-29T18:57:42.670483+0000 (oldest deadline 2019-11-29T18:58:28.489359+0000) 2019-11-29T18:59:07.762 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:07.755+0000 1694c700 -1 osd.0 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T18:57:58.054120+0000 (oldest deadline 2019-11-29T18:58:38.054120+0000) 2019-11-29T18:59:07.762 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:07.756+0000 1694c700 -1 osd.0 663 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T18:59:07.852 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T18:59:07.844+0000 1694c700 -1 osd.7 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:42.372619+0000 front 2019-11-29T18:57:42.320411+0000 (oldest deadline 2019-11-29T18:58:25.800706+0000) 2019-11-29T18:59:08.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T18:59:08.071+0000 1694c700 -1 osd.2 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.534590+0000 front 2019-11-29T18:57:41.392487+0000 (oldest deadline 2019-11-29T18:58:27.202228+0000) 2019-11-29T18:59:08.218 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T18:59:08.207+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e663 v663) 2019-11-29T18:59:08.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T18:59:08.281+0000 1694c700 -1 osd.6 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:41.963711+0000 front 2019-11-29T18:57:41.952156+0000 (oldest deadline 2019-11-29T18:58:25.085015+0000) 2019-11-29T18:59:08.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T18:59:08.359+0000 1694c700 -1 osd.5 663 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T18:57:43.419592+0000 front 2019-11-29T18:57:43.463824+0000 (oldest deadline 2019-11-29T18:58:26.268974+0000) 2019-11-29T18:59:08.882 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T18:59:08.825+0000 1694c700 -1 osd.0 664 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e660) 2019-11-29T19:00:39.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:39.757+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:40.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:40.119+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:40.247 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:40.235+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:40.387 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:40.377+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:40.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:40.774+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:41.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:41.111+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:41.257 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:41.247+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:41.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:41.377+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:41.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:41.787+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:42.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:42.060+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:42.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:42.083+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:42.234 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:42.226+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:42.343 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:42.335+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:42.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:42.838+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:43.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:43.025+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:43.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:43.110+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:43.279 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:43.270+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:43.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:43.347+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:43.696 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:43.688+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:43.779 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:43.772+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:43.849 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:43.842+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:44.039 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:44.028+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:44.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:44.164+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:44.284 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:44.273+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:44.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:44.387+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:44.695 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:44.687+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:44.743 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:44.736+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:44.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:44.863+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:45.064 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:45.057+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:45.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:45.191+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:45.334 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:45.325+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:45.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:45.406+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:45.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:45.664+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:45.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:45.770+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:45.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:45.846+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:46.019 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:46.011+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:46.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:46.210+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:46.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:46.285+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:46.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:46.412+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:46.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:46.618+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:46.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:46.807+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:46.892 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:46.885+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:47.045 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:47.038+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:47.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:47.200+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:47.299 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:47.291+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:47.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:47.392+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:47.615 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:47.607+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:47.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:47.837+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:47.929 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:47.921+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:48.052 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:48.046+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:48.206 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:48.198+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:48.264 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:48.255+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:48.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:48.372+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:48.605 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:48.597+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:48.878 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:48.872+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:48.915 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:48.906+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:49.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:49.071+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:49.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:49.183+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:49.235 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:49.225+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:49.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:49.342+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:49.619 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:49.611+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:49.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:49.833+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:49.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:49.953+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:50.073 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:50.059+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:50.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:50.167+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:50.224 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:50.212+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:50.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:50.379+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:50.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:50.597+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:50.796 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:50.788+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:50.954 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:50.947+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:51.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:51.104+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:51.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:51.161+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:51.192 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:51.181+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:51.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:51.384+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:51.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:51.643+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:51.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:51.817+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:51.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:51.979+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:52.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:52.134+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:52.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:52.142+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:52.213 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:52.205+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:52.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:52.409+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:52.628 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:52.605+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:52.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:52.793+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:53.015 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:52.993+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:53.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:53.114+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:53.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:53.121+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:53.179 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:53.170+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:53.465 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:53.456+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:53.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:53.644+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:53.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:53.770+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:54.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:54.023+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:54.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:54.114+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:54.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:54.126+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:54.178 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:54.171+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:54.479 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:54.471+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:54.679 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:54.672+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:54.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:54.780+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:55.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:55.005+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:55.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:55.094+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:55.120 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:55.113+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:55.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:55.148+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:55.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:55.478+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:55.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:55.663+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:55.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:55.804+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:56.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:56.027+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:56.080 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:56.073+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:56.132 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:56.125+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:56.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:56.149+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:56.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:56.473+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:56.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:56.709+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:56.780 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:56.773+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:56.995 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:56.988+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:57.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:57.075+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:57.145 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:57.138+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:57.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:57.144+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:57.507 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:57.499+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:57.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:57.664+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:57.824 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:57.815+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:57.969 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:57.962+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:58.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:58.034+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:58.178 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:58.158+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:58.350 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:58.190+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:58.468 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:58.460+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:58.638 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:58.630+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:58.854 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:58.846+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:00:58.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:00:58.968+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:00:59.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:00:59.037+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:00:59.133 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:00:59.126+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:00:59.162 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:00:59.155+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:00:59.505 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:00:59.497+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:00:59.634 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:00:59.627+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:00:59.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:00:59.803+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:00.013 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:00.002+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:00.034 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:00.026+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:00.135 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:00.128+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:00.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:00.191+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:00.560 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:00.550+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:00.652 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:00.646+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:00.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:00.851+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:01.034 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:01.018+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:01.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:01.035+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:01.096 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:01.089+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:01.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:01.197+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:01.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:01.523+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:01.615 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:01.608+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:01.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:01.882+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:02.013 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:02.005+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:02.014 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:02.006+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:02.103 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:02.097+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:02.222 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:02.214+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:02.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:02.516+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:02.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:02.568+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:02.864 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:02.857+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:03.054 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:03.046+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:03.061 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:03.053+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:03.126 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:03.119+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:03.216 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:03.208+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:03.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:03.513+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:03.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:03.592+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:03.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:03.854+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:04.055 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:04.044+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:04.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:04.092+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:04.180 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:04.173+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:04.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:04.216+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:04.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:04.560+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:04.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:04.589+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:04.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:04.837+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:05.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:05.054+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:05.077 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:05.070+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:05.152 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:05.143+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:05.233 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:05.226+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:05.576 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:05.569+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:05.617 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:05.610+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:05.882 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:05.876+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:06.044 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:06.037+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:06.108 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:06.100+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:06.139 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:06.132+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:06.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:06.192+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:06.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:06.535+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:06.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:06.576+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:06.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:06.863+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:07.082 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:07.075+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:07.096 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:07.087+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:07.150 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:07.142+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:07.227 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:07.220+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:07.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:07.568+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:07.578 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:07.571+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:07.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:07.817+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:08.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:08.107+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:08.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:08.110+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:08.128 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:08.121+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:08.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:08.232+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:08.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:08.562+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:08.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:08.595+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:08.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:08.852+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:09.100 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:09.087+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:09.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:09.090+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:09.131 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:09.124+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:09.214 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:09.206+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:09.563 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:09.555+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:09.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:09.595+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:09.847 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:09.840+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:10.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:10.106+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:10.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:10.114+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:10.171 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:10.163+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:10.217 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:10.209+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:10.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:10.588+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:10.621 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:10.613+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:10.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:10.815+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:11.085 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:11.078+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:11.120 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:11.112+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:11.171 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:11.164+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:11.214 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:11.206+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:11.559 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:11.550+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:11.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:11.641+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:11.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:11.838+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:12.073 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:12.066+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:12.131 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:12.125+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:12.167 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:12.159+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:12.254 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:12.245+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:12.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:12.587+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:12.673 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:12.665+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:12.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:12.804+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:13.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:01:13.091+0000 1694c700 -1 osd.4 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.419943+0000 front 2019-11-29T18:59:56.150870+0000 (oldest deadline 2019-11-29T19:00:39.002569+0000) 2019-11-29T19:01:13.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:01:13.152+0000 1694c700 -1 osd.6 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:56.126823+0000 front 2019-11-29T18:59:56.063570+0000 (oldest deadline 2019-11-29T19:00:41.934590+0000) 2019-11-29T19:01:13.175 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:13.169+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:13.281 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:01:13.272+0000 1694c700 -1 osd.3 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.943019+0000 front 2019-11-29T18:59:54.921126+0000 (oldest deadline 2019-11-29T19:00:39.428797+0000) 2019-11-29T19:01:13.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:01:13.564+0000 1694c700 -1 osd.5 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:58.352752+0000 front 2019-11-29T18:59:59.130984+0000 (oldest deadline 2019-11-29T19:00:43.549343+0000) 2019-11-29T19:01:13.642 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:01:13.635+0000 1694c700 -1 osd.1 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.534160+0000 front 2019-11-29T18:59:57.523214+0000 (oldest deadline 2019-11-29T19:00:39.772527+0000) 2019-11-29T19:01:13.726 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:01:13.707+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e668 v668) 2019-11-29T19:01:13.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:01:13.795+0000 1694c700 -1 osd.2 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:57.760480+0000 front 2019-11-29T18:59:57.414261+0000 (oldest deadline 2019-11-29T19:00:43.271297+0000) 2019-11-29T19:01:14.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:01:14.196+0000 1694c700 -1 osd.7 668 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T18:59:54.525205+0000 front 2019-11-29T18:59:54.686592+0000 (oldest deadline 2019-11-29T19:00:39.199654+0000) 2019-11-29T19:01:49.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:49.158+0000 31783700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:49.290 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:49.200+0000 35f8c700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:49.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:49.276+0000 31783700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:49.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:49.398+0000 31783700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:49.576 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:49.534+0000 31f84700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:50.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:50.048+0000 3778f700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:01:50.644 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:01:50.638+0000 33f88700 -1 osd.0 673 build_incremental_map_msg missing incremental map 673 2019-11-29T19:02:11.706 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:11.699+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:11.835 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:11.828+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:12.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:12.677+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:12.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:12.836+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:13.400 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:13.393+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:13.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:13.679+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:13.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:13.782+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:13.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:13.827+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:14.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:14.215+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:14.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:14.442+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:14.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:14.619+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:14.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:14.684+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:14.778 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:14.771+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:14.805 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:14.797+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:15.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:15.233+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:15.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:15.445+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:15.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:15.629+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:15.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:15.713+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:15.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:15.799+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:15.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:15.835+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:16.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:16.190+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:16.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:16.429+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:16.675 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:16.668+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:16.730 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:16.721+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:16.844 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:16.836+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:16.852 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:16.846+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:17.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:17.205+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:17.427 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:17.421+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:17.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:17.684+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:17.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:17.775+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:17.843 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:17.835+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:17.864 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:17.857+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:18.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:18.186+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:18.457 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:18.451+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:18.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:18.679+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:18.762 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:18.755+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:18.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:18.805+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:18.847 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:18.840+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:19.220 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:19.213+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:19.440 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:19.433+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:19.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:19.638+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:19.695 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:19.689+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:19.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:19.742+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:19.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:19.781+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:19.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:19.885+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:20.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:20.225+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:20.480 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:20.473+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:20.609 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:20.602+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:20.652 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:20.646+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:20.729 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:20.722+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:20.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:20.766+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:20.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:20.905+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:21.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:21.197+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:21.495 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:21.488+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:21.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:21.585+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:21.624 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:21.618+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:21.697 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:21.690+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:21.731 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:21.724+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:21.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:21.874+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:22.167 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:22.160+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:22.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:22.477+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:22.576 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:22.568+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:22.674 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:22.669+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:22.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:22.718+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:22.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:22.755+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:22.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:22.839+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:23.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:23.133+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:23.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:23.480+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:23.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:23.547+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:23.643 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:23.633+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:23.763 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:23.756+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:23.815 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:23.807+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:23.875 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:23.868+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:24.157 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:24.149+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:24.537 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:24.530+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:24.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:24.570+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:24.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:24.640+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:24.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:24.720+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:24.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:24.829+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:24.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:24.852+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:25.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:25.134+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:25.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:25.556+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:25.623 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:25.617+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:25.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:25.622+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:25.706 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:25.695+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:25.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:25.830+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:25.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:25.851+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:26.125 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:26.118+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:26.532 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:26.524+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:26.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:26.572+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:26.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:26.611+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:26.671 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:26.665+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:26.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:26.816+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:26.870 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:26.864+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:27.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:27.123+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:27.567 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:27.559+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:27.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:27.568+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:27.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:27.642+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:27.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:27.685+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:27.783 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:27.776+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:27.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:27.877+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:28.156 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:28.149+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:28.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:28.541+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:28.600 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:28.594+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:28.609 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:28.602+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:28.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:28.692+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:28.763 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:28.755+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:28.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:28.857+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:29.170 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:29.164+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:29.590 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:29.583+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:29.602 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:29.595+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:29.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:29.650+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:29.712 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:29.705+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:29.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:29.768+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:29.912 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:29.905+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:30.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:30.137+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:30.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:30.620+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:30.633 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:30.624+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:30.653 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:30.646+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:30.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:30.735+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:30.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:30.815+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:30.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:30.918+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:31.142 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:31.135+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:31.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:31.594+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:31.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:31.643+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:31.666 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:31.660+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:31.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:31.734+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:31.777 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:31.770+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:31.954 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:31.947+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:32.097 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:32.090+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:32.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:32.624+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:32.655 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:32.648+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:32.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:32.652+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:32.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:32.716+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:32.757 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:32.750+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:32.932 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:32.924+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:33.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:33.046+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:33.657 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:33.650+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:33.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:33.663+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:33.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:33.675+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:33.717 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:33.710+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:33.758 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:33.752+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:33.907 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:33.899+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:34.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:34.022+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:34.622 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:34.615+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:34.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:34.640+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:34.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:34.640+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:34.755 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:34.749+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:34.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:34.758+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:34.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:34.955+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:35.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:35.002+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:35.591 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:35.585+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:35.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:35.636+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:35.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:35.685+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:35.720 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:35.712+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:35.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:35.742+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:35.936 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:35.929+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:36.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:36.038+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:36.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:36.624+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:36.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:36.635+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:36.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:36.684+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:36.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:36.700+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:36.708 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:36.697+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:36.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:36.902+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:37.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:37.046+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:37.167 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:46:45.301 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.187 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:46:45.321 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.188 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:46:45.367 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.189 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:46:45.369 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.192 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:46:45.372 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.193 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:46:45.373 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.476 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:46:45.656 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.478 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:46:45.658 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.493 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:46:45.628 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:02:37.600 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:37.595+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:37.648 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:37.642+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:37.669 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:37.662+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:37.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:37.664+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:37.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:37.727+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:37.924 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:37.917+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:38.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:38.043+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:38.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:38.578+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:38.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:02:38.618+0000 1694c700 -1 osd.4 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:30.584312+0000 front 2019-11-29T19:01:30.449691+0000 (oldest deadline 2019-11-29T19:02:14.495696+0000) 2019-11-29T19:02:38.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:02:38.664+0000 1694c700 -1 osd.2 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:27.316137+0000 front 2019-11-29T19:01:27.250301+0000 (oldest deadline 2019-11-29T19:02:11.309200+0000) 2019-11-29T19:02:38.719 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:38.713+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:38.778 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:38.772+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:38.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:02:38.969+0000 1694c700 -1 osd.1 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.508587+0000 front 2019-11-29T19:01:29.038772+0000 (oldest deadline 2019-11-29T19:02:13.184747+0000) 2019-11-29T19:02:39.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:02:39.058+0000 1694c700 -1 osd.5 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.631456+0000 front 2019-11-29T19:01:28.968167+0000 (oldest deadline 2019-11-29T19:02:13.552609+0000) 2019-11-29T19:02:39.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:39.615+0000 1694c700 -1 osd.0 674 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:117985 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e672) 2019-11-29T19:02:39.682 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:02:39.675+0000 1694c700 -1 osd.7 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:28.216298+0000 front 2019-11-29T19:01:28.411742+0000 (oldest deadline 2019-11-29T19:02:13.090692+0000) 2019-11-29T19:02:39.791 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:02:39.785+0000 1694c700 -1 osd.6 674 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:01:29.614117+0000 front 2019-11-29T19:01:29.366940+0000 (oldest deadline 2019-11-29T19:02:10.948053+0000) 2019-11-29T19:02:40.180 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:02:40.150+0000 34f8a700 -1 osd.0 675 build_incremental_map_msg missing incremental map 673 2019-11-29T19:03:09.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:03:09.468+0000 1694c700 -1 osd.1 676 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:118591 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821331152 gen 133] snapc 0=[] ondisk+write+known_if_redirected e675) 2019-11-29T19:03:10.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:03:10.438+0000 1694c700 -1 osd.1 676 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:118591 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821331152 gen 133] snapc 0=[] ondisk+write+known_if_redirected e675) 2019-11-29T19:04:27.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:27.662+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:28.261 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:28.253+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:28.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:28.392+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:28.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:28.685+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:29.263 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:29.256+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:29.453 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:29.445+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:29.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:29.639+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:29.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:29.642+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:30.247 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:30.239+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:30.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:30.365+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:30.494 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:30.486+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:30.551 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:30.543+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:30.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:30.626+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:30.708 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:30.696+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:31.245 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:31.234+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:31.353 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:31.343+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:31.503 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:31.496+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:31.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:31.574+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:31.610 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:31.601+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:31.736 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:31.727+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:32.265 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:32.257+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:32.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:32.316+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:32.460 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:32.452+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:32.574 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:32.566+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:32.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:32.580+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:32.649 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:32.640+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:32.723 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:32.716+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:33.304 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:33.296+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:33.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:33.341+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:33.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:33.486+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:33.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:33.569+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:33.613 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:33.607+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:33.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:33.681+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:33.777 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:33.769+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:34.302 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:34.293+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:34.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:34.309+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:34.474 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:34.466+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:34.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:34.546+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:34.613 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:34.600+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:34.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:34.731+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:34.803 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:34.795+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:35.341 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:35.335+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:35.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:35.344+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:35.442 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:35.434+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:35.550 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:35.542+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:35.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:35.597+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:35.717 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:35.709+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:35.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:35.800+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:36.332 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:36.323+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:36.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:36.330+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:36.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:36.486+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:36.598 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:36.588+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:36.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:36.605+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:36.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:36.725+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:36.793 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:36.786+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:37.320 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:37.313+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:37.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:37.354+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:37.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:37.477+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:37.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:37.602+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:37.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:37.622+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:37.752 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:37.745+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:37.786 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:37.779+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:38.341 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:38.333+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:38.355 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:38.344+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:38.498 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:38.491+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:38.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:38.592+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:38.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:38.646+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:38.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:38.776+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:38.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:38.814+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:39.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:39.300+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:39.343 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:39.336+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:39.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:39.527+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:39.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:39.641+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:39.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:39.646+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:39.781 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:39.774+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:39.850 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:39.842+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:40.361 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:40.354+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:40.373 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:40.366+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:40.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:40.527+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:40.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:40.632+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:40.698 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:40.690+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:40.781 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:40.775+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:40.825 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:40.817+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:41.381 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:41.373+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:41.402 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:41.395+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:41.562 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:41.551+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:41.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:41.650+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:41.715 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:41.704+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:41.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:41.739+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:41.852 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:41.844+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:42.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:42.376+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:42.411 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:42.402+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:42.546 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:42.539+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:42.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:42.670+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:42.711 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:42.704+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:42.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:42.758+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:42.879 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:42.872+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:43.353 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:43.343+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:43.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:43.439+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:43.530 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:43.522+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:43.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:43.712+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:43.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:43.716+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:43.729 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:43.722+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:43.907 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:43.899+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:44.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:44.346+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:44.417 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:44.410+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:44.527 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:44.520+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:44.679 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:44.672+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:44.737 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:44.729+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:44.749 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:44.743+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:44.868 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:44.861+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:45.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:45.316+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:45.434 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:45.427+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:45.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:45.566+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:45.722 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:45.713+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:45.738 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:45.719+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:45.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:45.775+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:45.848 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:45.840+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:46.381 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:46.367+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:46.465 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:46.458+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:46.533 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:46.525+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:46.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:46.737+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:46.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:46.744+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:46.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:46.751+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:46.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:46.853+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:47.347 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:47.340+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:47.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:47.464+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:47.530 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:47.522+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:47.735 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:47.728+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:47.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:47.763+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:47.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:47.800+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:47.883 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:47.877+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:48.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:48.297+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:48.472 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:48.465+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:48.519 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:48.505+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:48.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:48.696+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:48.779 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:48.772+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:48.845 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:48.837+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:48.927 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:48.920+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:49.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:49.265+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:49.495 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:49.488+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:49.504 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:49.499+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:49.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:49.728+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:49.766 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:49.759+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:49.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:49.885+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:49.956 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:49.949+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:50.293 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:50.285+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:50.530 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:50.522+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:50.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:50.528+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:50.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:50.715+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:50.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:50.762+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:50.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:50.938+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:50.990 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:50.983+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:51.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:51.335+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:51.537 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:51.529+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:51.566 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:51.558+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:51.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:51.723+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:51.816 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:51.808+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:51.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:51.913+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:51.992 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:51.985+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:52.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:52.330+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:52.529 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:52.520+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:52.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:52.533+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:52.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:52.745+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:52.799 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:52.791+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:52.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:52.870+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:53.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:53.037+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:53.351 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:53.343+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:53.513 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:53.505+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:53.578 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:53.571+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:53.740 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:53.733+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:53.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:53.779+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:53.868 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:53.861+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:54.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:54.027+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:54.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:54.391+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:54.500 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:54.493+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:54.558 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:54.551+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:54.707 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:54.700+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:54.772 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:54.764+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:54.861 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:54.852+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:55.015 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:55.008+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:55.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:55.422+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:55.503 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:55.497+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:55.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:55.591+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:55.685 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:55.678+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:55.734 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:55.727+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:55.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:55.889+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:55.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:55.962+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:56.455 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:56.448+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:56.504 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:56.497+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:56.600 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:56.593+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:56.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:56.723+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:56.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:56.722+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:56.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:56.912+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:56.992 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:56.980+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:57.424 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:57.416+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:57.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:57.461+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:57.564 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:57.547+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:57.699 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:57.692+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:57.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:57.709+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:57.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:57.873+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:58.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:57.991+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:58.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:58.393+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:58.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:58.435+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:58.591 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:58.584+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:58.668 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:58.661+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:58.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:58.683+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:58.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:58.842+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:04:59.018 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:04:59.010+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:04:59.385 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:04:59.378+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:04:59.409 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:04:59.402+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:04:59.576 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:04:59.568+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:04:59.596 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:04:59.591+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e679 v679) 2019-11-29T19:04:59.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:04:59.682+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:04:59.709 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:04:59.702+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:04:59.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:04:59.858+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:00.027 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:05:00.019+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:05:00.386 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:05:00.379+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:05:00.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:05:00.406+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:05:00.594 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:05:00.586+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:05:00.725 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:05:00.718+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:05:00.739 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:05:00.731+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:05:00.834 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:05:00.828+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:01.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:05:01.014+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:05:01.344 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:05:01.336+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:05:01.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:05:01.426+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:05:01.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:05:01.563+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:05:01.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:05:01.690+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:05:01.734 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:05:01.723+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:05:01.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:05:01.816+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:02.068 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:05:02.057+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:05:02.356 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:05:02.347+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:05:02.457 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:05:02.448+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:05:02.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:05:02.549+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:05:02.719 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:05:02.709+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:05:02.754 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:05:02.732+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:05:02.828 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:05:02.820+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:03.102 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:05:03.089+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:05:03.344 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:05:03.334+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:05:03.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:05:03.480+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:05:03.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:05:03.542+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:05:03.731 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:05:03.724+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:05:03.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:05:03.773+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:05:03.838 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:05:03.829+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:04.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:05:04.085+0000 1694c700 -1 osd.7 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:43.789717+0000 front 2019-11-29T19:03:43.666856+0000 (oldest deadline 2019-11-29T19:04:29.384358+0000) 2019-11-29T19:05:04.320 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:05:04.307+0000 1694c700 -1 osd.3 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:44.892719+0000 front 2019-11-29T19:03:44.064949+0000 (oldest deadline 2019-11-29T19:04:28.131645+0000) 2019-11-29T19:05:04.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:05:04.509+0000 1694c700 -1 osd.6 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:47.348871+0000 front 2019-11-29T19:03:46.947031+0000 (oldest deadline 2019-11-29T19:04:30.175735+0000) 2019-11-29T19:05:04.593 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:05:04.583+0000 1694c700 -1 osd.5 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:42.629061+0000 front 2019-11-29T19:03:42.760125+0000 (oldest deadline 2019-11-29T19:04:27.479454+0000) 2019-11-29T19:05:04.675 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:05:04.661+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e679 v679) 2019-11-29T19:05:04.718 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:05:04.711+0000 1694c700 -1 osd.2 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.409898+0000 front 2019-11-29T19:03:46.201060+0000 (oldest deadline 2019-11-29T19:04:30.283638+0000) 2019-11-29T19:05:04.815 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:05:04.807+0000 1694c700 -1 osd.1 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:41.820439+0000 front 2019-11-29T19:03:41.776374+0000 (oldest deadline 2019-11-29T19:04:27.642549+0000) 2019-11-29T19:05:04.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:05:04.801+0000 1694c700 -1 osd.4 679 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:03:46.617309+0000 front 2019-11-29T19:03:44.978051+0000 (oldest deadline 2019-11-29T19:04:31.607544+0000) 2019-11-29T19:05:34.975 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:49:43.110 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:34.978 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:49:43.113 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.007 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:49:43.181 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.038 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:49:43.218 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.042 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:49:43.222 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.046 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:49:43.224 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.211 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:49:43.391 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.300 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:49:43.480 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:05:35.349 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:49:43.483 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:02.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:02.055+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:03.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:03.053+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:03.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:03.348+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:04.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:04.032+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:04.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:04.388+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:04.902 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:04.895+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:04.930 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:04.923+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:04.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:04.967+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:05.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:05.019+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:05.393 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:05.386+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:05.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:05.854+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:05.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:05.925+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:05.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:05.986+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:06.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:06.003+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:06.225 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:06.213+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:06.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:06.438+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:06.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:06.478+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:06.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:06.901+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:06.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:06.953+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:06.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:06.969+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:06.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:06.977+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:07.242 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:07.220+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:07.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:07.448+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:07.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:07.499+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:07.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:07.922+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:07.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:07.926+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:07.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:07.985+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:08.025 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:08.015+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:08.180 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:08.174+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:08.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:08.440+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:08.563 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:08.548+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:08.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:08.929+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:08.945 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:08.937+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:09.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:09.026+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:09.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:09.043+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:09.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:09.180+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:09.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:09.416+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:09.528 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:09.521+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:09.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:09.896+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:09.968 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:09.962+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:09.998 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:09.991+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:10.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:10.094+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:10.206 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:10.196+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:10.414 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:10.407+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:10.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:10.489+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:10.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:10.935+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:10.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:10.967+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:10.992 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:10.985+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:11.147 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:11.140+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:11.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:11.212+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:11.220 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:11.214+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:11.431 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:11.424+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:11.491 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:11.480+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:11.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:11.947+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:11.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:11.949+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:11.993 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:11.986+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:12.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:12.152+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:12.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:12.240+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:12.250 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:12.244+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:12.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:12.380+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:12.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:12.449+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:12.946 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:12.939+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:12.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:12.983+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:13.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:12.994+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:13.197 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:13.189+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:13.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:13.202+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:13.210 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:13.204+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:13.539 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:13.358+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:13.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:13.509+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:13.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:13.940+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:13.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:13.984+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:14.012 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:14.005+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:14.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:14.243+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:14.253 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:14.246+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:14.253 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:14.248+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:14.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:14.355+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:14.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:14.573+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:14.925 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:14.918+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:14.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:14.961+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:15.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:15.036+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:15.230 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:15.220+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:15.234 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:15.228+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:15.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:15.274+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:15.330 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:15.321+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:15.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:15.548+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:15.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:15.943+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:16.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:16.002+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:16.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:16.063+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:16.218 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:16.211+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:16.220 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:16.215+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:16.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:16.280+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:16.372 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:16.365+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:16.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:16.535+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:16.933 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:16.925+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:17.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:17.018+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:17.111 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:17.105+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:17.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:17.248+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:17.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:17.252+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:17.327 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:17.320+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:17.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:17.373+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:17.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:17.577+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:17.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:17.883+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:18.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:18.058+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:18.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:18.111+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:18.221 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:18.214+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:18.225 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:18.219+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:18.321 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:18.314+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:18.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:18.382+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:18.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:18.617+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:18.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:18.899+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:19.088 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:19.081+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:19.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:19.132+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:19.265 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:19.255+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:19.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:19.260+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:19.318 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:19.309+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:19.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:19.381+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:19.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:19.599+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:19.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:19.894+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:20.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:20.085+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:20.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:20.126+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:20.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:20.302+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:20.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:20.305+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:20.349 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:20.343+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:20.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:20.420+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:20.644 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:20.637+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:20.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:20.884+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:21.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:21.135+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:21.178 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:21.171+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:21.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:21.305+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:21.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:21.308+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:21.390 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:21.383+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:21.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:21.434+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:21.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:21.639+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:21.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:21.850+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:22.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:22.103+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:22.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:22.196+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:22.275 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:22.269+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:22.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:22.270+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:22.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:22.427+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:22.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:22.482+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:22.697 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:22.688+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:22.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:22.878+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:23.155 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:23.143+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:23.215 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:23.207+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:23.230 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:23.223+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:23.231 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:23.224+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:23.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:23.426+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:23.506 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:23.499+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:23.701 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:23.694+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:23.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:23.927+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:24.134 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:24.127+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:24.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:24.193+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:24.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:24.239+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:24.248 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:24.241+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:24.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:24.411+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:24.530 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:24.522+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:24.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:24.720+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:24.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:24.906+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:25.099 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:25.092+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:25.221 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:25.215+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:25.235 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:25.230+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:25.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:25.231+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:25.384 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:25.377+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:25.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:25.563+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:25.693 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:25.687+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:25.950 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:25.943+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:26.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:26.126+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:26.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:26.221+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:26.281 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:26.273+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:26.282 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:26.275+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:26.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:26.416+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:26.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:26.606+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:26.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:26.739+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:26.976 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:26.969+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:27.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:27.105+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:27.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:27.181+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:27.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:27.237+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:27.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:27.241+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:27.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:27.376+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:27.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:27.575+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:27.712 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:27.704+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:27.983 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:27.975+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:28.101 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:28.093+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:28.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:28.220+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:28.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:28.226+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:28.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:28.227+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:28.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:28.392+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:28.566 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:28.559+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:28.758 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:28.751+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:28.974 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:28.967+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:29.084 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:29.076+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:29.215 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:29.208+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:29.249 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:29.240+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:29.251 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:29.245+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:29.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:29.379+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:29.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:29.555+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:29.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:29.745+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:29.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:29.979+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:30.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:30.129+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:30.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:30.204+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:30.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:30.205+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:30.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:30.267+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:30.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:30.368+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:30.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:30.586+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:30.760 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:30.753+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:30.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:30.971+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:31.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:31.145+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:31.223 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:31.214+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:31.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:31.216+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:31.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:31.255+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:31.358 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:31.350+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:31.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:31.564+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:31.763 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:31.755+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:32.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:32.015+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:32.175 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:32.166+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:32.222 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:32.214+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:32.225 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:32.218+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:32.230 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:32.223+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:32.375 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:32.368+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:32.564 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:32.557+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:32.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:32.807+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:33.063 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:33.056+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:33.168 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:33.150+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:33.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:33.196+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:33.219 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:33.213+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:33.222 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:33.216+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:33.423 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:33.415+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:33.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:33.585+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:33.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:33.851+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:34.084 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:34.077+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:34.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:34.178+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:34.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:34.204+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:34.212 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:34.206+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:34.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:34.244+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:34.435 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:34.421+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:34.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:34.622+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:34.844 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:34.836+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:35.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:35.103+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:35.204 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:35.197+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:35.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:35.210+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:35.231 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:06:35.222+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e685 v685) 2019-11-29T19:06:35.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:35.256+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:35.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:35.257+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:35.467 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:35.460+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:35.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:35.616+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:35.827 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:35.818+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:36.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:36.076+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:36.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:36.226+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:36.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:36.239+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:36.303 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:36.297+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:36.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:36.299+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:36.513 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:36.506+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:36.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:36.581+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:36.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:36.815+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:37.065 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:37.059+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:37.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:37.206+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:37.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:37.224+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:37.295 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:37.288+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:37.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:37.290+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:37.441 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:50:45.574 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.447 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:50:45.582 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.458 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:50:45.638 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.459 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:50:45.639 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.462 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:50:45.642 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.471 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:50:45.651 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:37.523+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:37.534 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:50:45.669 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.555 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:50:45.735 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.565 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:50:45.745 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:06:37.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:37.582+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:37.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:37.869+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:38.037 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:38.030+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:38.179 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:38.173+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:38.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:38.270+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:38.284 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:38.277+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:38.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:38.279+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:38.519 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:38.510+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:38.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:38.594+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:38.899 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:38.892+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:39.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:39.050+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:39.224 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:39.218+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:39.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:39.280+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:39.287 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:39.281+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:39.318 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:39.312+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:39.554 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:39.546+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:39.599 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:39.591+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:39.948 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:39.939+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:40.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:40.050+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:40.246 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:06:40.239+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e685 v685) 2019-11-29T19:06:40.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:40.250+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:40.315 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:40.306+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:40.316 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:40.309+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:40.339 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:40.331+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:40.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:40.500+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:40.573 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:40.566+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:40.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:40.949+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:41.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:41.017+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:41.225 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:41.218+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:41.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:41.298+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:41.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:41.301+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:41.358 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:41.350+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:41.466 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:41.458+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:41.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:41.529+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:41.935 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:41.929+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:42.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:42.037+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:42.198 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:42.190+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:42.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:42.337+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:42.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:42.339+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:42.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:42.381+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:42.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:42.498+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:42.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:42.576+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:42.958 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:42.951+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:43.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:43.012+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:43.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:43.225+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:43.339 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:43.330+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:43.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:43.333+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:43.419 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:43.411+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:43.474 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:43.467+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:43.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:43.538+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:44.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:44.000+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:44.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:44.040+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:44.192 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:44.186+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:44.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:44.347+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:44.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:44.350+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:44.415 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:44.408+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:44.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:44.458+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:44.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:44.499+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:45.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:45.004+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:45.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:45.025+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:45.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:45.238+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:45.279 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:06:45.273+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e685 v685) 2019-11-29T19:06:45.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:45.350+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:45.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:45.352+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:45.427 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:45.420+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:45.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:45.440+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:45.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:45.461+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:46.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:46.049+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:46.087 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:46.081+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:46.255 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:46.247+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:46.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:46.326+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:46.336 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:46.330+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:46.387 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:46.380+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:46.434 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:46.427+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:46.510 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:46.500+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:47.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:47.015+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:47.090 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:47.083+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:47.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:47.263+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:47.344 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:47.337+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:47.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:47.345+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:47.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:47.348+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:47.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:47.414+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:47.527 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:47.520+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:47.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:47.989+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:48.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:48.112+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:48.288 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:48.281+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:48.355 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:48.348+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:48.362 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:48.355+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:48.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:48.357+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:48.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:48.416+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:48.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:48.482+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:48.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:48.973+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:49.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:49.151+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:49.295 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:49.288+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:49.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:49.328+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:49.370 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:49.363+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:49.370 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:49.364+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:49.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:49.416+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:06:49.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:06:49.522+0000 1694c700 -1 osd.4 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.982680+0000 front 2019-11-29T19:05:19.941658+0000 (oldest deadline 2019-11-29T19:06:02.784251+0000) 2019-11-29T19:06:49.950 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:06:49.944+0000 1694c700 -1 osd.2 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.483122+0000 front 2019-11-29T19:05:20.134369+0000 (oldest deadline 2019-11-29T19:06:04.787558+0000) 2019-11-29T19:06:50.138 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:06:50.127+0000 1694c700 -1 osd.7 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:19.949190+0000 front 2019-11-29T19:05:20.137899+0000 (oldest deadline 2019-11-29T19:06:05.807062+0000) 2019-11-29T19:06:50.264 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:06:50.258+0000 1694c700 -1 osd.1 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.987234+0000 front 2019-11-29T19:05:19.663551+0000 (oldest deadline 2019-11-29T19:06:01.948107+0000) 2019-11-29T19:06:50.350 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:06:50.340+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e685 v685) 2019-11-29T19:06:50.352 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:06:50.345+0000 1694c700 -1 osd.6 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:20.210928+0000 front 2019-11-29T19:05:20.229521+0000 (oldest deadline 2019-11-29T19:06:04.898610+0000) 2019-11-29T19:06:50.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:50.356+0000 1694c700 -1 osd.0 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:05:30.413913+0000 (oldest deadline 2019-11-29T19:06:10.413913+0000) 2019-11-29T19:06:50.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:06:50.359+0000 1694c700 -1 osd.0 685 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e683) 2019-11-29T19:06:50.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:06:50.385+0000 1694c700 -1 osd.5 685 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:05:21.691456+0000 front 2019-11-29T19:05:21.716319+0000 (oldest deadline 2019-11-29T19:06:04.561078+0000) 2019-11-29T19:07:47.750 INFO:teuthology.orchestra.run.smithi182.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-11-29T19:08:19.599 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:19.591+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:20.278 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:20.271+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:20.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:20.489+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:20.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:20.557+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:21.264 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:21.257+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:21.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:21.465+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:21.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:21.523+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:21.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:21.617+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:22.234 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:22.227+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:22.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:22.461+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:22.502 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:22.494+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:22.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:22.610+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:22.801 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:22.793+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:23.155 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:23.147+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:23.266 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:23.259+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:23.318 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:23.310+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:23.447 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:23.440+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:23.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:23.459+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:23.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:23.575+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:23.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:23.768+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:24.127 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:24.120+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:24.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:24.283+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:24.361 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:24.354+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:24.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:24.454+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:24.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:24.471+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:24.546 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:24.539+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:24.738 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:24.731+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:25.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:25.168+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:25.336 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:25.326+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:25.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:25.361+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:25.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:25.422+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:25.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:25.488+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:25.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:25.524+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:25.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:25.728+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:26.209 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:26.201+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:26.330 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:26.323+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:26.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:26.408+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:26.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:26.422+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:26.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:26.505+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:26.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:26.514+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:26.724 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:26.716+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:27.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:27.220+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:27.334 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:27.327+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:27.412 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:27.406+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:27.439 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:27.433+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:27.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:27.549+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:27.560 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:27.552+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:27.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:27.675+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:28.216 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:28.209+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:28.356 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:28.348+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:28.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:28.412+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:28.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:28.466+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:28.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:28.535+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:28.559 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:28.552+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:28.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:28.660+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:29.187 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:29.179+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:29.348 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:29.340+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:29.451 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:29.444+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:29.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:29.485+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:29.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:29.512+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:29.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:29.564+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:29.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:29.695+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:30.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:30.188+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:30.387 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:30.379+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:30.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:30.498+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:30.509 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:30.502+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:30.510 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:30.503+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:30.613 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:30.605+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:30.740 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:30.732+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:31.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:31.206+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:31.403 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:31.397+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:31.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:31.493+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:31.501 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:31.493+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:31.551 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:31.544+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:31.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:31.642+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:31.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:31.692+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:32.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:32.220+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:32.451 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:32.445+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:32.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:32.454+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:32.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:32.512+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:32.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:32.526+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:32.654 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:32.646+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:32.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:32.662+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:33.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:33.191+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:33.482 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:33.475+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:33.483 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:33.476+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:33.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:33.506+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:33.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:33.541+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:33.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:33.621+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:33.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:33.653+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:34.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:34.157+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:34.444 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:34.436+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:34.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:08:34.510+0000 1694c700 -1 osd.2 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.986040+0000 front 2019-11-29T19:07:38.984877+0000 (oldest deadline 2019-11-29T19:08:19.576794+0000) 2019-11-29T19:08:34.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:34.511+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:34.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:34.558+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:34.612 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:34.604+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:34.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:34.644+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:35.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:35.161+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:35.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:35.461+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:35.526 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:35.518+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:35.539 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:35.531+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:35.660 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:35.652+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:35.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:35.654+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:36.166 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:36.159+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:36.453 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:36.446+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:36.495 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:36.487+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:36.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:36.566+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:36.659 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:36.651+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:36.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:36.655+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:37.178 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:37.172+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:37.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:37.490+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:37.508 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:37.499+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:37.542 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:37.534+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:37.659 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:37.651+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:37.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:37.704+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:38.164 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:38.157+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:38.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:38.469+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:38.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:38.524+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:38.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:38.552+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:38.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:38.685+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:38.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:38.688+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:39.135 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:39.128+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:39.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:39.457+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:39.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:39.522+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:39.584 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:39.573+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:39.675 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:39.668+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:39.704 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:39.695+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:40.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:40.098+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:40.500 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:40.491+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:40.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:40.545+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:40.603 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:40.596+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:40.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:40.674+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:40.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:40.683+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:41.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:41.116+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:41.511 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:41.503+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:41.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:41.523+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:41.604 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:41.595+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:41.641 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:41.632+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:41.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:41.718+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:42.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:42.091+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:42.479 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:42.472+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:42.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:42.550+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:42.591 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:42.582+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:42.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:42.680+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:42.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:42.755+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:43.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:43.078+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:43.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:43.518+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:43.541 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:43.533+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:43.567 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:43.558+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:43.673 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:43.664+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:43.791 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:43.785+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:44.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:44.069+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:44.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:44.520+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:44.579 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:44.572+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:44.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:44.582+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:44.656 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:44.649+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:44.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:44.833+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:45.040 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:45.032+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:45.531 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:45.523+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:45.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:45.531+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:45.559 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:45.552+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:45.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:45.615+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:45.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:45.621+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:45.875 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:45.867+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:46.006 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:45.994+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:46.519 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:46.511+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:46.580 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:46.573+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:46.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:46.576+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:46.587 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:46.581+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:46.594 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:46.586+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:46.897 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:46.888+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:46.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:46.968+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:47.513 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:47.506+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:47.563 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:47.554+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:47.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:47.557+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:47.577 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:47.570+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:47.643 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:47.635+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:47.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:47.903+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:47.954 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:47.946+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:48.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:48.525+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:48.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:48.533+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:48.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:48.555+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:48.566 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:48.558+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:48.653 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:48.644+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:48.891 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:48.882+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:48.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:48.978+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:49.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:49.484+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:49.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:49.521+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:49.598 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:49.589+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:49.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:49.592+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:49.678 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:49.668+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:49.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:49.857+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:49.988 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:49.979+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:50.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:50.480+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:50.538 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:50.530+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:50.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:50.597+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:50.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:50.601+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:50.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:50.627+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:50.760 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:08:50.753+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e691 v691) 2019-11-29T19:08:50.835 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:50.827+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:50.969 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:50.957+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:51.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:51.522+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:51.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:51.578+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:51.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:51.638+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:51.650 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:51.643+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:51.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:51.658+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:51.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:51.861+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:51.997 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:51.989+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:52.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:52.548+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:52.610 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:52.602+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:52.682 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:52.673+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:52.683 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:52.676+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:52.692 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:52.683+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:52.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:52.907+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:53.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:53.023+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:53.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:53.521+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:53.575 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:53.567+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:53.701 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:53.692+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:53.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:53.697+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:53.721 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:53.707+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:53.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:53.899+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:54.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:54.062+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:54.558 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:54.537+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:54.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:54.548+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:54.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:54.741+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:54.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:54.745+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:54.755 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:54.747+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:54.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:08:54.950+0000 1694c700 -1 osd.4 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.100553+0000 front 2019-11-29T19:07:36.123652+0000 (oldest deadline 2019-11-29T19:08:21.243449+0000) 2019-11-29T19:08:55.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:55.075+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:55.568 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:08:55.561+0000 1694c700 -1 osd.1 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.860315+0000 front 2019-11-29T19:07:38.953404+0000 (oldest deadline 2019-11-29T19:08:22.719384+0000) 2019-11-29T19:08:55.570 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:08:55.563+0000 1694c700 -1 osd.3 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:37.200349+0000 front 2019-11-29T19:07:37.201754+0000 (oldest deadline 2019-11-29T19:08:19.445854+0000) 2019-11-29T19:08:55.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:55.742+0000 1694c700 -1 osd.6 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:38.558609+0000 front 2019-11-29T19:07:38.611088+0000 (oldest deadline 2019-11-29T19:08:23.110382+0000) 2019-11-29T19:08:55.753 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:55.747+0000 1694c700 -1 osd.6 691 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:08:55.805 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:08:55.798+0000 1694c700 -1 osd.7 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:36.873378+0000 front 2019-11-29T19:07:36.841490+0000 (oldest deadline 2019-11-29T19:08:18.995597+0000) 2019-11-29T19:08:55.834 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:08:55.823+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e691 v691) 2019-11-29T19:08:56.109 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:08:56.098+0000 1694c700 -1 osd.5 691 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:07:39.217724+0000 front 2019-11-29T19:07:38.979728+0000 (oldest deadline 2019-11-29T19:08:23.032913+0000) 2019-11-29T19:08:56.761 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:08:56.755+0000 1694c700 -1 osd.6 692 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81481 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e691) 2019-11-29T19:09:41.448 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:53:49.582 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.453 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:53:49.588 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.541 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:53:49.721 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.543 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:53:49.724 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.569 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:53:49.748 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.598 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:53:49.777 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.634 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:53:49.769 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.751 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:53:49.931 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:41.827 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:53:50.006 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:09:53.848 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:53.841+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:54.527 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:54.520+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:54.865 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:54.857+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:55.199 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:09:55.192+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:09:55.572 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:55.565+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:55.803 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:09:55.796+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:09:55.851 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:55.840+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:56.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:09:56.213+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:09:56.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:56.602+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:56.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:09:56.799+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:09:56.848 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:09:56.841+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:09:56.874 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:56.868+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:57.191 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:09:57.183+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:09:57.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:57.640+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:57.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:09:57.794+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:09:57.856 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:57.849+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:57.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:09:57.849+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:09:57.896 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:09:57.889+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:09:58.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:09:58.138+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:09:58.698 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:58.690+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:58.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:09:58.750+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:09:58.841 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:09:58.833+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:09:58.850 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:58.842+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:58.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:09:58.869+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:09:59.170 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:09:59.163+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:09:59.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:09:59.744+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:09:59.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:09:59.768+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:09:59.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:09:59.853+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:09:59.876 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:09:59.869+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:09:59.900 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:09:59.893+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:00.079 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:00.073+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:00.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:00.188+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:00.749 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:00.742+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:00.753 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:00.746+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:00.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:00.840+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:00.850 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:00.844+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:00.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:00.886+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:01.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:01.051+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:01.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:01.150+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:01.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:01.793+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:01.800 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:01.794+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:01.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:01.853+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:01.887 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:01.880+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:01.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:01.902+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:02.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:02.027+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:02.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:02.150+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:02.798 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:02.792+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:02.842 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:02.835+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:02.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:02.839+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:02.860 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:02.853+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:02.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:02.913+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:03.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:03.012+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:03.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:03.137+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:03.790 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:03.782+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:03.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:03.831+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:03.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:03.838+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:03.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:03.888+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:03.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:03.916+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:04.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:04.033+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:04.147 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:04.140+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:04.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:04.743+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:04.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:04.850+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:04.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:04.858+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:04.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:04.935+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:04.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:04.956+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:05.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:05.019+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:05.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:05.022+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:05.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:05.150+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:05.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:05.743+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:05.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:05.811+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:05.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:05.854+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:05.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:05.946+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:05.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:05.955+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:06.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:06.033+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:06.041 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:06.036+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:06.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:06.118+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:06.747 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:06.740+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:06.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:06.845+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:06.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:06.849+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:06.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:06.941+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:07.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:06.997+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:07.009 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:07.002+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:07.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:07.003+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:07.151 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:07.143+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:07.786 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:07.780+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:07.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:07.861+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:07.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:07.887+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:07.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:07.939+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:07.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:07.958+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:07.970 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:07.964+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:08.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:08.011+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:08.157 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:08.150+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:08.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:08.795+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:08.912 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:08.905+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:08.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:08.909+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:08.932 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:08.924+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:08.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:08.950+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:08.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:08.952+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:09.053 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:09.045+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:09.178 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:09.171+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:09.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:09.796+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:09.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:09.891+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:09.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:09.894+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:09.960 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:09.952+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:09.992 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:09.983+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:09.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:09.985+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:10.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:10.003+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:10.150 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:10.142+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:10.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:10.795+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:10.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:10.904+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:10.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:10.948+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:10.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:10.982+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:11.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:10.995+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:11.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:10.997+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:11.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:11.000+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:11.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:11.144+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:11.846 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:11.838+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:11.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:11.940+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:11.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:11.950+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:11.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:11.962+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:11.989 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:11.980+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:12.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:12.027+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:12.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:12.030+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:12.198 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:12.192+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:12.801 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:12.793+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:12.948 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:12.941+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:12.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:12.950+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:12.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:12.989+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:12.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:12.993+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:13.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:13.024+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:13.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:13.025+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:13.193 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:13.186+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:13.791 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:13.777+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:13.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:13.953+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:14.000 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:13.993+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:14.039 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:14.031+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:14.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:14.038+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:14.076 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:14.068+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:14.076 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:14.071+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:14.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:14.222+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:14.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:14.801+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:14.976 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:14.969+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:15.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:15.008+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:15.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:15.017+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:15.066 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:15.060+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:15.069 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:15.063+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:15.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:15.075+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:15.197 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:15.190+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:15.804 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:15.797+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:15.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:15.974+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:15.996 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:15.990+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:16.032 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:16.024+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:16.038 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:16.031+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:16.109 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:16.092+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:16.109 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:16.095+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:16.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:16.188+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:16.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:16.771+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:16.962 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:16.954+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:16.968 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:16.961+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:17.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:16.995+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:17.050 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:17.044+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:17.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:17.053+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:17.062 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:17.056+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:17.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:17.219+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:17.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:17.810+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:17.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:17.989+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:18.005 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:17.992+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:18.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:18.010+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:18.028 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:18.020+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:18.072 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:18.065+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:18.074 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:18.067+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:18.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:18.194+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:18.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:18.838+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:18.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:18.968+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:18.977 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:18.970+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:19.010 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:19.005+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:19.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:19.034+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:19.081 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:19.075+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:19.082 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:19.076+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:19.247 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:19.239+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:19.829 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:19.821+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:19.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:19.963+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:19.976 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:19.968+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:20.014 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:20.006+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:20.030 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:20.021+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:20.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:20.091+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:20.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:20.094+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:20.217 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:20.209+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:20.863 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:20.855+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:20.943 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:20.936+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:20.957 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:20.950+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:21.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:21.003+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:21.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:21.047+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:21.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:21.140+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:21.149 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:21.142+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:21.177 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:21.169+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:21.850 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:21.842+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:21.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:21.905+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:21.936 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:21.929+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:21.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:21.963+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:22.034 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:22.025+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:22.131 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:22.125+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:22.132 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:22.127+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:22.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:22.220+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:22.890 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:22.882+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:22.928 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:22.920+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:22.936 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:22.929+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:22.963 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:22.956+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:23.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:23.078+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:23.096 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:23.090+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:23.098 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:23.093+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:23.191 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:23.183+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:23.916 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:23.908+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:23.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:23.913+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:23.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:23.934+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:23.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:23.935+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:24.078 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:24.070+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:24.078 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:24.072+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:24.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:24.111+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:24.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:24.188+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:24.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:24.942+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:24.963 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:24.955+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:24.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:24.952+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:24.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:24.986+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:25.032 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:25.024+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:25.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:25.026+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:25.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:25.133+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:25.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:25.197+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:25.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:25.903+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:25.956 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:25.948+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:25.974 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:25.967+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:26.003 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:25.997+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:26.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:25.995+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:26.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:26.000+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:26.112 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:26.104+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:26.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:26.187+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:26.474 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:10:26.465+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e698 v698) 2019-11-29T19:10:26.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:26.916+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:26.939 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:26.932+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:26.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:26.983+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:27.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:27.019+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:27.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:27.021+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:27.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:27.039+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:27.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:27.096+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:27.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:27.190+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:27.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:27.930+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:27.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:27.934+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:27.989 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:27.981+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:28.001 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:27.994+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:28.004 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:27.998+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:28.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:28.093+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:28.132 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:28.124+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:28.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:28.189+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:28.922 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:28.915+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:28.959 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:28.947+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:28.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:28.951+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:29.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:29.033+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:29.040 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:29.034+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:29.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:29.060+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:29.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:29.159+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:29.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:29.217+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:29.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:29.923+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:29.958 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:29.950+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:29.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:29.973+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:30.036 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:30.028+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:30.037 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:30.030+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:30.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:30.079+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:30.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:30.151+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:30.200 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:30.193+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:30.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:30.939+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:30.951 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:30.944+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:31.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:30.999+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:31.063 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:31.056+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:31.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:31.057+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:31.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:31.089+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:31.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:31.156+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:31.205 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:31.187+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:31.484 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:10:31.478+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e698 v698) 2019-11-29T19:10:31.530 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:54:39.665 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.540 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:54:39.675 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.550 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:54:39.727 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.553 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:54:39.733 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.554 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:54:39.733 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.557 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:54:39.736 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.617 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:54:39.751 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.634 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:54:39.814 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.636 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:54:39.816 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:10:31.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:31.924+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:31.937 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:31.931+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:32.001 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:31.994+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:32.024 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:32.017+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:32.025 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:32.019+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:32.088 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:32.083+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:32.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:32.119+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:32.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:32.173+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:32.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:32.949+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:32.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:32.958+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:33.009 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:33.001+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:33.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:33.004+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:33.030 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:33.023+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:33.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:33.065+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:33.147 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:33.140+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:33.172 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:33.165+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:33.942 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:33.927+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:33.958 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:33.949+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:34.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:34.016+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:34.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:34.018+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:34.030 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:34.024+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:34.044 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:34.037+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:34.162 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:34.154+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:34.200 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:34.193+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:34.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:34.889+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:34.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:34.969+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:35.001 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:34.991+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:35.001 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:34.992+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:35.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:34.998+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:35.008 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:34.998+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:35.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:35.135+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:35.170 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:35.164+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:35.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:35.846+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:35.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:35.983+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:35.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:35.984+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:35.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:35.989+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:36.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:36.002+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:36.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:36.044+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:36.186 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:36.178+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:36.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:36.214+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:36.505 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:10:36.496+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e698 v698) 2019-11-29T19:10:36.828 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:36.816+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:36.959 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:36.952+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:36.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:36.964+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:37.007 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:37.000+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:37.010 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:37.004+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:37.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:37.064+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:37.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:37.167+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:37.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:37.215+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:37.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:37.836+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:37.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:37.962+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:37.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:37.975+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:38.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:38.014+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:38.028 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:38.016+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:38.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:38.018+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:38.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:38.122+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:38.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:38.255+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:38.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:38.808+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:38.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:38.979+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:38.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:38.984+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:39.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:39.015+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:39.059 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:39.051+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:39.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:39.053+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:39.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:39.167+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:39.310 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:39.302+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:39.805 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:39.797+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:39.984 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:39.976+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:39.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:39.981+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:40.026 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:40.020+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:40.027 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:40.021+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:40.032 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:40.022+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:40.163 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:40.156+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:40.291 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:40.284+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:40.784 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:40.777+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:40.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:10:40.939+0000 1694c700 -1 osd.6 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.652448+0000 front 2019-11-29T19:09:12.007187+0000 (oldest deadline 2019-11-29T19:09:57.527692+0000) 2019-11-29T19:10:41.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:10:40.997+0000 1694c700 -1 osd.2 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:12.748401+0000 front 2019-11-29T19:09:12.780721+0000 (oldest deadline 2019-11-29T19:09:53.167432+0000) 2019-11-29T19:10:41.005 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:40.998+0000 1694c700 -1 osd.0 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:09:24.937815+0000 (oldest deadline 2019-11-29T19:10:04.937815+0000) 2019-11-29T19:10:41.006 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:41.000+0000 1694c700 -1 osd.0 698 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:41.035 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:10:41.028+0000 1694c700 -1 osd.1 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.611357+0000 front 2019-11-29T19:09:10.866948+0000 (oldest deadline 2019-11-29T19:09:56.129110+0000) 2019-11-29T19:10:41.187 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:41.180+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:10:41.280 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:10:41.273+0000 1694c700 -1 osd.4 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.728443+0000 front 2019-11-29T19:09:10.742179+0000 (oldest deadline 2019-11-29T19:09:54.199300+0000) 2019-11-29T19:10:41.580 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:10:41.573+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 41sec e698 v698) 2019-11-29T19:10:41.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:10:41.737+0000 1694c700 -1 osd.7 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:11.448017+0000 front 2019-11-29T19:09:11.884752+0000 (oldest deadline 2019-11-29T19:09:54.879021+0000) 2019-11-29T19:10:42.096 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:10:42.038+0000 1694c700 -1 osd.0 699 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:119140 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e696) 2019-11-29T19:10:42.184 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:10:42.178+0000 1694c700 -1 osd.5 698 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:09:10.845624+0000 front 2019-11-29T19:09:11.145015+0000 (oldest deadline 2019-11-29T19:09:53.718032+0000) 2019-11-29T19:11:15.008 INFO:teuthology.orchestra.run.smithi182.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-11-29T19:12:09.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:09.071+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:10.049 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:10.042+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:10.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:10.656+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:11.032 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:11.025+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:11.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:11.627+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:11.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:11.752+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:11.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:11.993+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:12.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:12.093+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:12.148 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:12.140+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:12.614 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:12.607+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:12.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:12.714+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:12.967 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:12.959+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:13.057 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:13.047+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:13.109 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:13.102+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:13.123 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:13.115+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:13.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:13.645+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:13.719 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:13.712+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:14.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:14.014+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:14.085 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:14.078+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:14.094 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:14.086+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:14.108 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:14.101+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:14.606 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:14.599+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:14.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:14.723+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:14.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:14.979+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:15.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:15.058+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:15.090 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:15.082+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:15.111 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:15.103+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:15.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:15.563+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:15.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:15.768+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:16.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:16.002+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:16.067 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:16.060+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:16.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:16.103+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:16.122 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:16.115+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:16.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:16.524+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:16.778 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:16.771+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:16.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:16.989+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:17.080 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:17.072+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:17.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:17.133+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:17.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:17.149+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:17.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:17.487+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:17.770 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:17.762+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:18.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:18.018+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:18.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:18.039+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:18.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:18.154+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:18.196 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:18.190+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:18.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:18.499+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:18.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:18.815+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:19.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:19.003+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:19.014 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:19.007+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:19.139 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:19.131+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:19.158 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:19.149+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:19.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:19.549+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:19.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:19.862+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:20.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:20.014+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:20.068 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:20.060+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:20.148 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:20.141+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:20.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:20.151+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:20.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:20.568+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:20.848 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:20.840+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:21.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:21.066+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:21.096 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:21.089+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:21.161 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:21.153+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:21.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:21.182+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:21.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:21.610+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:21.853 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:21.845+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:22.128 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:22.119+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:22.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:22.137+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:22.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:22.188+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:22.209 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:22.200+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:22.614 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:22.605+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:22.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:22.830+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:23.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:23.147+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:23.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:23.168+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:23.236 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:23.229+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:23.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:23.220+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:23.596 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:23.588+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:23.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:23.797+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:24.133 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:24.126+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:24.179 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:24.172+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:24.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:24.250+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:24.258 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:24.250+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:24.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:24.595+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:24.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:24.788+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:25.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:25.154+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:25.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:25.169+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:25.290 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:25.283+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:25.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:25.294+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:25.606 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:25.600+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:25.842 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:25.835+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:26.114 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:26.108+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:26.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:26.158+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:26.278 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:26.268+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:26.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:26.297+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:26.598 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:26.590+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:26.873 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:26.865+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:27.071 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:27.063+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:27.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:27.206+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:27.237 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:27.229+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:27.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:27.321+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:27.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:27.564+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:27.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:27.874+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:28.116 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:28.110+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:28.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:28.214+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:28.283 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:28.277+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:28.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:28.363+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:28.607 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:28.599+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:28.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:28.884+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:29.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:29.083+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:29.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:29.231+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:29.323 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:29.316+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:29.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:29.329+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:29.632 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:29.625+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:29.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:29.858+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:30.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:30.057+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:30.282 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:30.275+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:30.341 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:30.334+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:30.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:30.361+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:30.606 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:30.599+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:30.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:30.817+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:31.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:31.100+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:31.262 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:31.252+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:31.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:31.326+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:31.378 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:31.372+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:31.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:31.588+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:31.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:31.838+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:32.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:32.072+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:32.308 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:32.300+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:32.310 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:32.301+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:32.348 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:32.340+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:32.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:32.555+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:32.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:32.888+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:33.073 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:33.065+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:33.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:33.265+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:33.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:33.298+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:33.313 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:33.305+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:33.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:33.594+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:33.921 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:33.913+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:34.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:34.103+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:34.294 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:34.287+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:34.312 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:34.303+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:34.326 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:34.318+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:34.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:34.558+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:34.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:34.956+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:35.136 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:35.128+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:35.274 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:35.266+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:35.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:35.321+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:35.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:35.363+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:35.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:35.531+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:35.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:35.928+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:36.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:36.147+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:36.293 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:36.286+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:36.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:36.359+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:36.389 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:36.369+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:36.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:36.508+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:36.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:36.950+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:37.194 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:37.185+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:37.259 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:37.252+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:37.385 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:37.377+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:37.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:37.395+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:37.564 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:37.557+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:37.933 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:37.924+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:38.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:12:38.126+0000 1694c700 -1 osd.6 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.026898+0000 front 2019-11-29T19:11:26.070982+0000 (oldest deadline 2019-11-29T19:12:37.576121+0000) 2019-11-29T19:12:38.164 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:38.157+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:38.279 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:38.270+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:38.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:38.396+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:38.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:38.404+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:38.597 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:38.589+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:38.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:38.923+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:39.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:12:39.080+0000 1694c700 -1 osd.6 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.026898+0000 front 2019-11-29T19:11:26.070982+0000 (oldest deadline 2019-11-29T19:12:37.576121+0000) 2019-11-29T19:12:39.170 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:39.161+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:39.238 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:39.232+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:39.364 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:39.355+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:39.396 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:39.387+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:39.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:39.606+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:39.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:39.903+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:40.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:12:40.094+0000 1694c700 -1 osd.6 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.026898+0000 front 2019-11-29T19:11:26.070982+0000 (oldest deadline 2019-11-29T19:12:37.576121+0000) 2019-11-29T19:12:40.138 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:40.131+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:40.269 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:40.261+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:40.364 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:40.356+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:40.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:40.379+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:40.666 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:40.658+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:40.883 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:40.876+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:41.076 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:12:41.067+0000 1694c700 -1 osd.6 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.026898+0000 front 2019-11-29T19:11:26.070982+0000 (oldest deadline 2019-11-29T19:12:37.576121+0000) 2019-11-29T19:12:41.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:41.107+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:41.255 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:41.247+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:41.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:41.370+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:12:41.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:12:41.395+0000 1694c700 -1 osd.4 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.390839+0000 front 2019-11-29T19:11:27.344501+0000 (oldest deadline 2019-11-29T19:12:11.408408+0000) 2019-11-29T19:12:41.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:12:41.643+0000 1694c700 -1 osd.1 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:24.659792+0000 front 2019-11-29T19:11:24.605725+0000 (oldest deadline 2019-11-29T19:12:09.859623+0000) 2019-11-29T19:12:41.870 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:12:41.863+0000 1694c700 -1 osd.5 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:28.110383+0000 front 2019-11-29T19:11:28.301771+0000 (oldest deadline 2019-11-29T19:12:11.236039+0000) 2019-11-29T19:12:42.048 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:12:42.032+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e703 v703) 2019-11-29T19:12:42.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:12:42.077+0000 1694c700 -1 osd.6 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.026898+0000 front 2019-11-29T19:11:26.070982+0000 (oldest deadline 2019-11-29T19:12:37.576121+0000) 2019-11-29T19:12:42.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:12:42.087+0000 1694c700 -1 osd.2 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:26.834349+0000 front 2019-11-29T19:11:27.132010+0000 (oldest deadline 2019-11-29T19:12:09.054181+0000) 2019-11-29T19:12:42.266 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:12:42.246+0000 1694c700 -1 osd.3 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.144207+0000 front 2019-11-29T19:11:27.252743+0000 (oldest deadline 2019-11-29T19:12:12.137356+0000) 2019-11-29T19:12:42.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:12:42.361+0000 1694c700 -1 osd.7 703 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:11:27.345625+0000 front 2019-11-29T19:11:27.317412+0000 (oldest deadline 2019-11-29T19:12:12.827845+0000) 2019-11-29T19:13:40.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:40.097+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:41.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:41.069+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:41.336 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:41.329+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:42.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:42.062+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:42.272 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:42.265+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:42.376 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:42.368+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:42.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:42.879+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:43.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:43.064+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:43.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:43.239+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:43.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:43.366+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:43.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:43.930+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:44.077 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:44.070+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:44.182 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:44.175+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:44.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:44.219+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:44.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:44.420+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:44.502 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:44.494+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:44.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:44.907+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:45.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:45.042+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:45.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:45.204+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:45.218 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:45.211+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:45.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:45.377+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:45.404 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:45.396+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:45.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:45.540+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:45.911 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:45.905+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:46.060 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:46.053+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:46.254 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:46.248+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:46.259 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:46.253+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:46.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:46.402+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:46.440 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:46.430+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:46.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:46.549+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:46.885 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:46.877+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:47.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:47.017+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:47.275 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:47.268+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:47.281 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:47.274+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:47.376 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:47.370+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:47.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:47.424+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:47.562 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:47.556+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:47.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:47.858+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:48.034 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:48.027+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:48.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:48.290+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:48.320 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:48.313+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:48.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:48.412+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:48.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:48.419+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:48.606 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:48.600+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:48.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:48.834+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:49.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:49.032+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:49.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:49.276+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:49.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:49.351+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:49.453 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:49.446+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:49.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:49.462+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:49.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:49.647+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:49.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:49.792+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:50.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:50.083+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:50.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:50.311+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:50.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:50.388+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:50.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:50.483+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:50.494 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:50.488+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:50.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:50.683+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:50.815 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:50.808+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:51.116 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:51.109+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:51.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:51.274+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:51.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:51.430+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:51.450 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:51.443+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:51.489 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:51.483+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:51.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:51.663+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:51.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:51.833+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:52.082 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:52.072+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:52.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:52.313+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:52.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:52.443+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:52.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:52.452+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:52.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:52.453+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:52.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:52.538+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:52.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:52.664+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:52.807 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:52.800+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:53.079 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:53.072+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:53.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:53.347+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:53.480 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:53.473+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:53.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:53.474+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:53.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:53.492+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:53.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:53.526+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:53.724 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:53.714+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:53.781 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:53.774+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:54.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:54.103+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:54.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:54.377+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:54.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:54.516+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:54.524 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:54.516+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:54.527 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:54.520+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:54.547 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:54.539+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:54.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:54.761+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:54.776 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:54.770+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:55.076 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:55.069+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:55.372 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:55.365+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:55.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:55.489+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:55.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:55.489+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:55.500 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:55.494+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:55.560 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:55.552+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:55.804 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:55.797+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:55.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:55.810+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:56.091 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:56.084+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:56.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:56.362+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:56.483 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:56.476+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:56.542 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:56.534+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:56.542 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:56.536+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:56.561 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:56.554+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:56.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:56.781+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:56.851 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:56.845+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:57.099 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:57.092+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:57.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:57.321+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:57.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:57.489+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:57.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:57.494+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:57.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:57.496+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:57.578 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:05.712 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:57.576+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:57.588 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:05.723 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.634 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:05.814 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.635 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:05.815 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.646 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:05.826 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.650 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:05.829 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.785 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:05.920 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:57.813+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:57.846 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:06.025 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.849 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:06.029 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:13:57.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:57.863+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:58.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:58.063+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:58.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:58.286+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:58.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:58.510+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:58.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:58.539+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:58.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:58.542+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:58.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:58.623+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:58.853 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:58.845+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:13:58.861 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:58.855+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:59.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:13:59.094+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:13:59.278 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:13:59.271+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:13:59.491 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:13:59.484+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:13:59.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:59.564+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:13:59.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:13:59.565+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:13:59.616 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:13:59.609+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:13:59.828 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:13:59.820+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:13:59.899 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:13:59.877+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:00.089 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:00.082+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:00.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:00.257+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:00.535 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:00.528+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:00.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:00.576+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:00.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:00.578+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:00.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:00.626+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:00.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:00.873+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:00.919 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:00.912+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:01.124 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:01.117+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:01.252 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:01.245+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:01.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:01.523+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:01.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:01.596+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:01.604 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:01.598+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:01.682 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:01.676+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:01.902 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:01.895+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:01.955 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:01.948+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:02.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:02.141+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:02.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:02.258+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:02.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:02.554+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:02.607 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:02.600+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:02.607 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:02.601+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:02.663 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:02.656+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:02.914 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:02.907+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:02.929 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:02.919+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:03.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:03.159+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:03.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:03.260+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:03.576 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:03.569+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:03.658 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:03.650+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:03.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:03.652+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:03.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:03.700+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:03.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:03.900+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:03.924 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:03.917+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:04.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:04.165+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:04.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:04.256+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:04.548 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:04.541+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:04.710 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:04.702+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:04.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:04.704+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:04.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:04.725+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:04.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:04.873+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:04.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:04.910+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:05.141 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:05.133+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:05.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:05.216+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:05.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:05.558+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:05.682 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:05.675+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:05.683 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:05.676+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:05.715 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:05.703+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:05.868 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:05.861+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:05.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:05.892+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:06.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:06.187+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:06.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:06.197+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:06.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:06.557+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:06.713 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:06.705+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:06.714 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:06.707+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:06.740 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:06.727+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:06.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:06.864+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:06.943 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:06.935+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:07.234 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:07.226+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:07.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:07.245+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:07.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:07.577+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:07.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:07.744+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:07.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:07.747+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:07.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:07.772+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:07.841 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:07.833+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:07.959 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:07.952+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:08.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:08.219+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:08.283 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:08.276+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:08.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:08.622+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:08.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:08.741+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:08.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:08.742+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:08.803 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:08.796+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:08.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:08.803+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:08.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:08.916+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:09.235 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:09.227+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:09.282 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:09.275+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:09.626 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:09.619+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:09.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:09.749+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:09.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:09.751+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:09.814 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:09.806+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:09.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:09.813+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:09.965 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:09.957+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:10.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:10.209+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:10.280 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:10.272+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:10.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:10.588+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:10.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:10.735+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:10.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:10.737+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:10.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:10.825+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:10.835 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:10.828+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:10.943 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:10.935+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:11.254 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:11.246+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:11.291 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:11.283+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:11.643 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:11.636+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:11.773 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:11.767+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:11.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:11.768+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:11.842 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:11.834+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:11.850 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:11.843+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:11.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:11.933+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:12.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:12.273+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:12.311 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:12.304+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:12.512 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:14:12.501+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e710 v710) 2019-11-29T19:14:12.647 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:12.639+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:12.741 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:12.733+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:12.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:12.736+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:12.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:12.790+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:12.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:12.872+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:12.936 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:12.920+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:13.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:13.267+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:13.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:13.276+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:13.647 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:13.640+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:13.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:13.746+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:13.783 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:13.775+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:13.784 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:13.776+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:13.848 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:13.841+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:13.940 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:13.931+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:14.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:14.265+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:14.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:14.299+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:14.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:14.608+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:14.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:14.733+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:14.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:14.790+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:14.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:14.793+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:14.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:14.887+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:14.947 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:14.940+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:15.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:15.232+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:15.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:15.349+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:15.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:15.623+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:15.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:15.751+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:15.760 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:15.753+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:15.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:15.778+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:15.875 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:15.868+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:15.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:15.899+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:16.201 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:16.194+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:16.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:16.321+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:16.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:16.660+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:16.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:16.775+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:16.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:16.790+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:16.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:16.793+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:16.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:16.849+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:16.910 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:16.903+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:17.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:17.244+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:17.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:17.320+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:17.543 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:14:17.535+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e710 v710) 2019-11-29T19:14:17.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:17.696+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:17.769 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:17.758+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:17.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:17.796+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:17.804 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:17.798+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:17.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:17.829+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:17.884 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:17.877+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:18.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:18.270+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:18.308 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:18.301+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:18.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:18.725+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:18.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:18.737+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:18.807 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:18.800+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:18.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:18.802+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:18.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:18.807+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:18.864 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:18.857+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:19.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:19.233+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:19.343 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:19.336+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:19.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:19.754+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:19.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:19.758+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:19.824 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:19.818+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:19.838 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:19.831+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:19.839 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:19.833+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:19.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:19.905+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:20.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:20.242+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:20.344 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:20.337+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:20.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:20.734+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:20.804 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:20.797+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:20.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:20.803+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:20.868 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:20.860+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:20.869 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:20.862+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:20.962 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:20.956+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:21.226 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:21.216+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:21.329 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:21.321+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:21.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:21.744+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:21.822 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:21.814+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:21.854 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:21.847+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:21.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:21.849+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:21.858 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:21.852+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:21.961 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:21.953+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:22.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:22.250+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:22.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:22.315+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:22.559 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:14:22.553+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e710 v710) 2019-11-29T19:14:22.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:22.746+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:22.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:22.865+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:22.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:22.888+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:22.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:22.891+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:22.898 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:22.891+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:22.953 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:22.946+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:23.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:23.285+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:23.329 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:23.321+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:23.737 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:23.730+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:23.882 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:23.876+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:23.883 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:23.877+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:23.893 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:23.886+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:23.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:23.888+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:23.912 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:23.905+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:24.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:24.253+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:24.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:24.326+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:24.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:24.774+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:24.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:24.872+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:24.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:24.873+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:24.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:24.894+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:24.924 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:24.899+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:24.940 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:24.932+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:25.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:25.285+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:25.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:25.288+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:25.821 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:25.813+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:25.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:25.887+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:25.921 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:25.914+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:25.956 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:25.950+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:25.963 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:25.954+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:25.976 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:25.968+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:26.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:26.244+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:26.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:26.282+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:26.775 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:14:26.768+0000 1694c700 -1 osd.6 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.538769+0000 front 2019-11-29T19:12:57.529726+0000 (oldest deadline 2019-11-29T19:13:40.397931+0000) 2019-11-29T19:14:26.913 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:26.906+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:26.913 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:26.907+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:26.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:14:26.919+0000 1694c700 -1 osd.4 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.955679+0000 front 2019-11-29T19:12:57.980944+0000 (oldest deadline 2019-11-29T19:13:42.629368+0000) 2019-11-29T19:14:26.967 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:14:26.957+0000 1694c700 -1 osd.1 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.982460+0000 front 2019-11-29T19:12:58.016721+0000 (oldest deadline 2019-11-29T19:13:43.875837+0000) 2019-11-29T19:14:26.978 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:26.966+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:27.272 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:27.265+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:27.274 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:14:27.267+0000 1694c700 -1 osd.5 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:56.814061+0000 front 2019-11-29T19:12:56.798741+0000 (oldest deadline 2019-11-29T19:13:39.440926+0000) 2019-11-29T19:14:27.647 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:14:27.640+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e710 v710) 2019-11-29T19:14:27.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:14:27.928+0000 1694c700 -1 osd.2 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:58.971010+0000 front 2019-11-29T19:12:58.911762+0000 (oldest deadline 2019-11-29T19:13:44.187739+0000) 2019-11-29T19:14:27.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:27.932+0000 1694c700 -1 osd.0 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:13:12.192846+0000 (oldest deadline 2019-11-29T19:13:52.192846+0000) 2019-11-29T19:14:27.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:27.934+0000 1694c700 -1 osd.0 710 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:28.301 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:14:28.296+0000 1694c700 -1 osd.7 710 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:12:57.146409+0000 front 2019-11-29T19:12:56.915412+0000 (oldest deadline 2019-11-29T19:13:41.935346+0000) 2019-11-29T19:14:28.704 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:36.835 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.710 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:36.845 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.712 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:36.891 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.715 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:36.895 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.718 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:36.898 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.721 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:36.901 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.770 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:07:58:36.904 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.770 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:07:58:36.950 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.795 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:07:58:36.975 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:14:28.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:14:28.904+0000 1694c700 -1 osd.0 711 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e707) 2019-11-29T19:14:56.482 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:14:56.424+0000 34f8a700 -1 osd.3 717 build_incremental_map_msg missing incremental map 717 2019-11-29T19:14:56.528 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:14:56.511+0000 35f8c700 -1 osd.3 717 build_incremental_map_msg missing incremental map 717 2019-11-29T19:14:56.916 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:14:56.880+0000 34f8a700 -1 osd.3 717 build_incremental_map_msg missing incremental map 717 2019-11-29T19:14:57.337 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:14:57.288+0000 30f82700 -1 osd.3 717 build_incremental_map_msg missing incremental map 717 2019-11-29T19:14:58.871 INFO:teuthology.orchestra.run.smithi182.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-11-29T19:15:54.302 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:54.293+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:54.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:54.553+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:54.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:54.706+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:55.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:15:55.203+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:15:55.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:55.331+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:55.592 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:55.582+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:55.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:55.663+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:56.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:15:56.231+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:15:56.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:56.372+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:56.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:15:56.399+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:15:56.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:56.553+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:56.699 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:56.691+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:56.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:15:56.857+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:15:57.229 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:15:57.222+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:15:57.355 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:15:57.347+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:15:57.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:57.367+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:57.414 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:15:57.405+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:15:57.602 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:57.594+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:57.713 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:57.702+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:57.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:15:57.887+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:15:58.254 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:15:58.247+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:15:58.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:15:58.336+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:15:58.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:58.383+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:58.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:15:58.447+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:15:58.609 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:58.602+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:58.669 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:58.660+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:58.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:15:58.861+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:15:59.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:15:59.287+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:15:59.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:15:59.362+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:15:59.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:15:59.380+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:15:59.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:15:59.493+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:15:59.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:15:59.637+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:15:59.659 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:15:59.652+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:15:59.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:15:59.838+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:00.270 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:00.263+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:00.421 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:00.414+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:00.438 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:00.431+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:00.587 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:00.535+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:00.599 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:00.593+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:00.622 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:00.615+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:00.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:00.894+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:01.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:01.219+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:01.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:01.426+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:01.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:01.473+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:01.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:01.513+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:01.622 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:01.614+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:01.631 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:01.624+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:01.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:01.873+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:02.235 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:02.228+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:02.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:02.430+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:02.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:02.495+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:02.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:02.512+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:02.669 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:02.663+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:02.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:02.677+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:02.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:02.831+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:03.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:03.283+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:03.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:03.427+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:03.534 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:03.523+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:03.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:03.548+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:03.657 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:03.649+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:03.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:03.695+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:03.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:03.858+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:04.294 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:04.287+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:04.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:04.399+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:04.571 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:04.564+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:04.581 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:04.572+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:04.638 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:04.622+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:04.682 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:04.675+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:04.881 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:04.873+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:05.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:05.302+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:05.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:05.360+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:05.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:05.550+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:05.581 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:05.574+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:05.594 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:05.585+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:05.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:05.724+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:05.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:05.918+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:06.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:06.273+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:06.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:06.376+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:06.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:06.510+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:06.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:06.581+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:06.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:06.627+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:06.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:06.738+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:06.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:06.893+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:07.308 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:07.299+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:07.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:07.355+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:07.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:07.549+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:07.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:07.554+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:07.629 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:07.622+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:07.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:07.779+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:07.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:07.908+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:08.331 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:08.324+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:08.337 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:08.329+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:08.515 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:08.508+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:08.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:08.571+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:08.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:08.598+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:08.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:08.825+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:08.920 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:08.911+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:09.299 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:09.291+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:09.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:09.310+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:09.518 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:09.507+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:09.545 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:09.535+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:09.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:09.585+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:09.885 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:09.876+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:09.954 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:16:09.946+0000 1694c700 -1 osd.4 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:13.587012+0000 front 2019-11-29T19:15:13.444155+0000 (oldest deadline 2019-11-29T19:15:56.781141+0000) 2019-11-29T19:16:10.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:10.271+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:10.316 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:10.308+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:10.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:10.518+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:10.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:10.547+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:10.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:10.627+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:10.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:10.923+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:11.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:11.266+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:11.324 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:11.316+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:11.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:11.514+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:11.534 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:11.527+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:11.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:11.676+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:11.928 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:11.922+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:12.252 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:12.245+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:12.317 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:12.309+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:12.515 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:12.509+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:12.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:12.542+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:12.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:12.669+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:12.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:12.916+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:13.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:13.199+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:13.318 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:13.310+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:13.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:13.534+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:13.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:13.577+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:13.684 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:13.676+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:13.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:13.929+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:14.269 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:14.250+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:14.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:14.357+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:14.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:14.534+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:14.593 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:14.582+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:14.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:14.666+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:14.977 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:14.961+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:15.299 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:15.292+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:15.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:15.396+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:15.573 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:15.566+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:15.634 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:15.626+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:15.695 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:15.688+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:15.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:15.921+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:16.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:16.346+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:16.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:16.358+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:16.582 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:16.573+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:16.636 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:16.628+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:16.719 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:16.712+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:16.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:16.901+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:17.332 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:17.318+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:17.410 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:17.402+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:17.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:17.534+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:17.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:17.636+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:17.708 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:17.700+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:17.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:17.895+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:18.361 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:18.350+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:18.394 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:18.387+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:18.510 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:18.502+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:18.646 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:18.639+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:18.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:18.665+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:18.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:18.943+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:19.342 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:19.334+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:19.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:19.387+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:19.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:19.553+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:19.680 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:19.671+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:19.683 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:19.676+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:19.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:19.966+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:20.370 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:20.362+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:20.406 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:20.399+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:20.528 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:20.522+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:20.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:20.678+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:20.708 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:20.694+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:20.932 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:20.923+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:21.334 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:21.325+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:21.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:21.370+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:21.557 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:21.548+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:21.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:21.687+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:21.741 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:21.733+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:21.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:21.933+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:22.386 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:22.376+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:22.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:22.384+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:22.534 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:22.526+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:22.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:22.668+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:22.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:22.722+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:23.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:22.983+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:23.355 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:23.348+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:23.416 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:23.406+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:23.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:23.497+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:23.679 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:23.671+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:23.743 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:23.733+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:23.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:23.963+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:24.380 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:24.373+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:24.439 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:24.429+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:24.534 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:24.526+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:24.639 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:24.629+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:24.792 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:24.784+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:24.953 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:24.940+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:25.343 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:25.336+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:25.429 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:25.421+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:25.529 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:25.522+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:25.689 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:25.677+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:25.824 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:25.815+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:25.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:25.964+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:26.300 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:26.292+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:26.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:26.438+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:26.540 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:26.533+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:26.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:26.681+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:26.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:26.812+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:26.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:26.970+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:27.338 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:16:27.330+0000 1694c700 -1 osd.2 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.532824+0000 front 2019-11-29T19:15:11.636763+0000 (oldest deadline 2019-11-29T19:15:56.769320+0000) 2019-11-29T19:16:27.421 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:16:27.412+0000 1694c700 -1 osd.6 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:08.527114+0000 front 2019-11-29T19:15:08.556100+0000 (oldest deadline 2019-11-29T19:15:54.360624+0000) 2019-11-29T19:16:27.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:16:27.525+0000 1694c700 -1 osd.3 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:14.260382+0000 front 2019-11-29T19:15:09.708942+0000 (oldest deadline 2019-11-29T19:15:53.769132+0000) 2019-11-29T19:16:27.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:16:27.711+0000 1694c700 -1 osd.1 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.920074+0000 front 2019-11-29T19:15:11.121325+0000 (oldest deadline 2019-11-29T19:15:56.199374+0000) 2019-11-29T19:16:27.839 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:16:27.831+0000 1694c700 -1 osd.7 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:10.201942+0000 front 2019-11-29T19:15:10.225232+0000 (oldest deadline 2019-11-29T19:15:54.248234+0000) 2019-11-29T19:16:27.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:16:27.946+0000 1694c700 -1 osd.5 717 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:15:11.083854+0000 front 2019-11-29T19:15:10.995400+0000 (oldest deadline 2019-11-29T19:15:54.662568+0000) 2019-11-29T19:16:28.142 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:16:28.132+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e717 v717) 2019-11-29T19:17:04.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:04.781+0000 35f8c700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.083 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:04.953+0000 3678d700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.164 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.069+0000 3678d700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.182 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.124+0000 31783700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.226 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.210+0000 31f84700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.359 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.351+0000 124ad700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.422+0000 3778f700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.577 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.534+0000 38f92700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:05.750 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:05.722+0000 3578b700 -1 osd.0 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:06.034 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.022+0000 11cac700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.142 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.134+0000 31f84700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.236+0000 33f88700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.377 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.342+0000 33f88700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.448 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.425+0000 32f86700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.498+0000 32f86700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.765 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:06.665+0000 31783700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:06.838 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:17:06.779+0000 30f82700 -1 osd.3 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:06.999 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:17:06.966+0000 31783700 -1 osd.3 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:07.130 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:17:07.099+0000 33f88700 -1 osd.3 722 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:07.743 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:07.687+0000 37f90700 -1 osd.0 723 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:07.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:07.741+0000 32f86700 -1 osd.0 723 build_incremental_map_msg missing incremental map 722 2019-11-29T19:17:07.801 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:07.773+0000 37f90700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:07.834 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:07.821+0000 32f86700 -1 osd.0 723 build_incremental_map_msg missing incremental map 723 2019-11-29T19:17:27.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:27.450+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:27.822 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:27.815+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:28.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:28.418+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:28.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:28.840+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:29.200 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:29.193+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:29.415 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:29.408+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:29.821 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:29.815+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:30.223 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:30.215+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:30.309 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:30.302+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:30.417 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:30.409+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:30.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:30.473+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:30.758 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:30.751+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:30.803 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:30.792+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:31.234 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:31.225+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:31.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:31.299+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:31.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:31.386+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:31.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:31.456+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:31.755 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:31.747+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:31.830 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:31.824+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:32.266 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:32.258+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:32.351 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:32.344+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:32.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:32.396+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:32.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:32.485+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:32.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:32.717+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:32.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:32.855+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:33.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:33.307+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:33.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:33.350+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:33.433 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:33.424+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:33.495 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:33.489+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:33.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:33.719+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:33.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:33.878+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:34.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:34.317+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:34.349 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:34.328+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:34.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:34.427+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:34.495 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:34.489+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:34.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:34.678+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:34.922 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:34.914+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:35.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:35.264+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:35.326 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:35.315+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:35.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:35.341+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:35.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:35.478+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:35.485 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:35.478+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:35.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:35.715+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:35.934 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:35.926+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:36.290 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:36.284+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:36.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:36.348+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:36.358 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:36.351+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:36.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:36.472+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:36.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:36.476+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:36.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:36.758+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:36.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:36.979+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:37.264 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:37.258+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:37.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:37.314+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:37.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:37.320+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:37.463 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:37.456+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:37.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:37.482+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:37.791 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:37.785+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:37.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:37.980+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:38.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:38.280+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:38.312 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:38.304+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:38.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:38.368+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:38.458 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:38.452+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:38.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:38.498+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:38.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:38.797+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:39.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:39.008+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:39.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:39.262+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:39.271 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:39.258+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:39.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:39.370+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:39.510 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:39.504+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:39.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:39.528+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:39.837 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:39.830+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:40.001 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:39.992+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:40.274 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:40.268+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:40.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:40.312+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:40.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:40.399+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:40.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:40.510+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:40.583 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:40.575+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:40.855 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:40.847+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:40.959 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:40.952+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:41.302 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:41.293+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:41.302 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:41.295+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:41.316 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:41.309+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:41.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:41.406+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:41.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:41.468+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:41.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:41.553+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:41.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:41.827+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:41.931 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:41.924+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:42.312 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:42.304+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:42.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:42.312+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:42.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:42.313+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:42.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:42.405+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:42.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:42.470+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:42.613 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:42.606+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:42.841 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:42.834+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:42.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:42.965+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:43.300 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:43.293+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:43.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:43.297+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:43.312 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:43.305+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:43.388 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:43.377+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:43.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:43.459+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:43.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:43.619+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:43.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:43.794+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:43.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:43.972+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:44.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:44.283+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:44.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:44.286+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:44.327 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:44.319+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:44.370 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:44.363+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:44.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:44.434+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:44.580 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:44.574+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:44.831 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:44.823+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:45.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:45.015+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:45.313 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:45.305+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:45.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:45.307+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:45.349 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:45.340+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:45.385 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:45.378+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:45.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:45.463+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:45.564 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:45.557+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:45.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:45.796+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:46.064 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:46.057+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:46.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:46.311+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:46.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:46.312+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:46.342 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:46.335+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:46.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:46.419+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:46.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:46.496+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:46.533 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:46.526+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:46.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:46.825+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:47.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:47.094+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:47.357 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:47.350+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:47.358 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:47.352+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:47.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:47.361+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:47.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:47.462+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:47.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:47.467+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:47.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:47.527+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:47.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:47.864+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:48.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:48.120+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:48.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:48.320+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:48.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:48.322+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:48.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:48.343+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:48.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:48.447+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:48.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:48.480+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:48.556 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:48.549+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:48.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:48.837+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:49.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:49.101+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:49.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:49.306+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:49.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:49.308+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:49.372 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:49.356+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:49.417 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:49.408+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:49.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:49.506+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:49.549 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:49.541+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:49.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:49.799+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:50.138 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:50.130+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:50.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:50.321+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:50.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:50.322+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:50.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:50.355+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:50.409 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:50.402+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:50.468 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:50.461+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:50.574 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:50.567+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:50.806 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:50.798+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:51.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:51.118+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:51.329 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:51.322+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:51.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:51.366+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:51.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:51.369+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:51.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:51.419+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:51.483 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:51.476+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:51.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:51.578+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:51.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:51.751+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:52.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:52.100+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:52.379 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:52.370+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:52.407 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:52.401+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:52.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:52.404+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:52.432 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:52.425+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:52.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:52.530+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:52.591 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:52.584+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:52.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:52.796+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:53.147 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:53.140+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:53.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:53.393+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:53.405 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:53.397+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:53.408 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:53.401+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:53.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:53.403+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:53.506 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:53.499+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:53.599 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:53.592+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:53.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:53.791+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:54.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:54.138+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:54.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:54.372+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:54.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:54.399+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:54.408 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:54.402+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:54.448 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:54.441+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:54.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:54.551+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:54.559 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:54.552+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:54.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:54.792+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:55.175 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:55.167+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:55.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:55.427+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:55.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:55.428+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:55.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:55.425+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:55.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:55.483+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:55.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:55.531+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:55.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:55.585+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:55.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:55.816+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:56.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:56.180+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:56.395 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:56.387+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:56.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:56.447+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:56.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:56.447+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:56.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:56.448+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:56.582 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:56.571+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:56.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:56.597+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:56.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:56.860+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:57.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:57.231+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:57.368 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:57.359+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:57.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:57.426+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:57.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:57.430+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:57.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:57.474+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:57.532 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:57.525+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:57.621 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:57.613+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:57.867 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:57.842+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:58.290 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:58.279+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:58.378 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:58.370+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:58.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:58.447+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:58.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:58.448+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:58.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:58.505+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:58.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:58.531+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:58.584 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:58.577+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:58.817 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:58.809+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:17:59.306 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:17:59.295+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:17:59.339 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:17:59.331+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:17:59.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:59.477+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:17:59.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:17:59.478+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:17:59.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:17:59.523+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:17:59.551 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:17:59.545+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:17:59.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:17:59.574+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:17:59.799 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:17:59.792+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:00.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:00.294+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:00.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:00.378+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:00.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:00.513+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:00.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:00.527+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:00.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:00.528+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:00.558 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:00.550+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:00.622 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:00.613+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:00.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:00.832+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:01.281 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:01.269+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:01.357 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:01.348+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:01.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:01.551+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:01.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:01.572+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:01.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:01.574+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:01.599 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:01.592+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:01.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:01.619+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:01.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:01.843+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:02.304 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:02.293+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:02.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:02.347+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:02.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:02.523+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:02.603 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:02.596+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:02.630 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:02.623+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:02.631 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:02.624+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:02.633 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:02.627+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:02.889 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:02.883+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:03.314 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:03.305+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:03.334 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:03.327+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:03.471 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:18:03.457+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e723 v723) 2019-11-29T19:18:03.519 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:03.512+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:03.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:03.610+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:03.627 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:03.618+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:03.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:03.621+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:03.648 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:03.642+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:03.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:03.896+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:04.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:04.294+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:04.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:04.351+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:04.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:04.480+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:04.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:04.598+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:04.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:04.625+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:04.671 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:04.663+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:04.671 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:04.666+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:04.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:04.862+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:05.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:05.303+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:05.343 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:05.337+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:05.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:05.477+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:05.629 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:05.623+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:05.648 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:05.641+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:05.720 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:05.712+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:05.721 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:05.715+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:05.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:05.877+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:06.305 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:06.299+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:06.328 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:06.321+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:06.518 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:06.510+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:06.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:06.613+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:06.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:06.657+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:06.733 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:06.724+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:06.734 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:06.727+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:06.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:06.927+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:07.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:07.280+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:07.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:07.355+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:07.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:07.473+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:07.620 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:07.614+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:07.665 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:07.658+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:07.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:07.768+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:07.776 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:07.770+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:07.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:07.899+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:08.249 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:08.241+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:08.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:08.409+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:08.481 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:18:08.473+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e723 v723) 2019-11-29T19:18:08.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:08.500+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:08.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:08.645+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:08.655 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:08.648+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:08.759 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:08.745+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:08.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:08.748+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:08.894 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:08.886+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:09.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:09.256+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:09.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:09.464+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:09.490 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:09.484+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:09.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:09.672+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:09.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:09.682+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:09.765 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:09.758+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:09.766 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:09.759+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:09.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:09.906+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:10.232 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:10.225+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:10.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:10.458+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:10.465 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:10.457+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:10.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:10.700+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:10.732 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:10.723+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:10.744 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:10.737+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:10.745 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:10.738+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:10.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:10.950+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:11.230 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:11.223+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:11.484 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:11.478+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:11.505 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:11.493+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:11.696 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:11.689+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:11.717 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:11.710+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:11.778 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:11.770+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:11.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:11.774+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:11.989 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:11.982+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:12.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:12.237+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:12.479 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:12.472+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:12.522 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:12.515+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:12.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:12.706+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:12.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:12.713+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:12.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:12.765+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:12.775 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:12.767+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:12.977 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:18:12.971+0000 1694c700 -1 osd.5 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:44.378928+0000 front 2019-11-29T19:16:44.293083+0000 (oldest deadline 2019-11-29T19:17:30.125119+0000) 2019-11-29T19:18:13.272 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:18:13.265+0000 1694c700 -1 osd.4 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:46.029078+0000 front 2019-11-29T19:16:46.018961+0000 (oldest deadline 2019-11-29T19:17:30.077715+0000) 2019-11-29T19:18:13.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:18:13.502+0000 1694c700 -1 osd.1 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.033717+0000 front 2019-11-29T19:16:45.098124+0000 (oldest deadline 2019-11-29T19:17:28.514759+0000) 2019-11-29T19:18:13.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:18:13.526+0000 1694c700 -1 osd.6 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:41.526092+0000 front 2019-11-29T19:16:41.570668+0000 (oldest deadline 2019-11-29T19:17:27.397533+0000) 2019-11-29T19:18:13.637 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:18:13.550+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e723 v723) 2019-11-29T19:18:13.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:18:13.685+0000 1694c700 -1 osd.2 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.083297+0000 front 2019-11-29T19:16:45.124496+0000 (oldest deadline 2019-11-29T19:17:27.337340+0000) 2019-11-29T19:18:13.759 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:18:13.753+0000 1694c700 -1 osd.7 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:16:45.463059+0000 front 2019-11-29T19:16:45.420533+0000 (oldest deadline 2019-11-29T19:17:30.093281+0000) 2019-11-29T19:18:13.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:13.779+0000 1694c700 -1 osd.0 723 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:17:00.717961+0000 (oldest deadline 2019-11-29T19:17:40.717961+0000) 2019-11-29T19:18:13.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:13.780+0000 1694c700 -1 osd.0 723 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:14.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:14.818+0000 1694c700 -1 osd.0 724 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e721) 2019-11-29T19:18:15.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:15.016+0000 38f92700 -1 osd.0 724 build_incremental_map_msg missing incremental map 722 2019-11-29T19:18:15.069 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:18:15.058+0000 38f92700 -1 osd.0 724 build_incremental_map_msg missing incremental map 723 2019-11-29T19:18:18.751 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:02:26.885 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:18.767 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:02:26.947 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:18.771 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:02:26.950 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:18.775 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:02:26.955 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:18.775 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:02:26.910 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:18.776 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:02:26.956 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:19.007 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:02:27.186 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:19.054 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:02:27.189 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:19.066 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:02:27.246 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:18:42.005 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:18:41.954+0000 30f82700 -1 osd.3 728 build_incremental_map_msg missing incremental map 728 2019-11-29T19:18:42.090 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:18:42.038+0000 35f8c700 -1 osd.3 728 build_incremental_map_msg missing incremental map 728 2019-11-29T19:18:43.875 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:18:43.864+0000 30f82700 -1 osd.3 728 build_incremental_map_msg missing incremental map 728 2019-11-29T19:19:41.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:41.572+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:42.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:42.103+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:42.540 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:42.533+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:42.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:42.532+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:42.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:42.542+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:43.098 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:43.090+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:43.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:43.528+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:43.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:43.531+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:43.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:43.569+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:43.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:43.591+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:44.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:44.129+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:44.543 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:44.536+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:44.559 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:44.550+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:44.565 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:44.554+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:44.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:44.636+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:45.180 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:45.167+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:45.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:45.521+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:45.558 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:45.552+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:45.560 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:45.553+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:45.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:45.606+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:45.675 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:45.668+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:46.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:46.156+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:46.215 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:46.207+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:46.522 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:46.515+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:46.578 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:46.561+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:46.586 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:46.579+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:46.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:46.602+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:46.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:46.628+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:47.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:47.132+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:47.228 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:47.221+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:47.497 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:47.489+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:47.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:47.522+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:47.571 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:47.564+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:47.610 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:47.601+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:47.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:47.601+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:48.169 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:48.161+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:48.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:48.226+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:48.497 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:48.489+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:48.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:48.531+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:48.581 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:48.561+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:48.595 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:48.587+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:48.669 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:48.651+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:49.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:49.116+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:49.251 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:49.241+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:49.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:49.459+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:49.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:49.507+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:49.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:49.611+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:49.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:49.616+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:49.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:49.643+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:50.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:50.070+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:50.221 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:50.214+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:50.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:50.476+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:50.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:50.521+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:50.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:50.587+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:50.616 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:50.607+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:50.665 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:50.659+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:51.052 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:51.044+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:51.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:51.232+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:51.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:51.483+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:51.551 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:51.545+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:51.612 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:51.605+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:51.626 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:51.619+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:51.707 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:51.697+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:52.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:52.037+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:52.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:52.215+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:52.458 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:52.447+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:52.573 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:52.559+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:52.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:52.636+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:52.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:52.634+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:52.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:52.694+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:53.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:53.033+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:53.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:53.249+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:53.469 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:53.461+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:53.585 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:53.578+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:53.603 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:53.596+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:53.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:53.597+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:53.748 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:53.740+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:54.001 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:53.994+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:54.225 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:54.218+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:54.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:54.486+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:54.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:54.572+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:54.621 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:54.613+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:54.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:54.634+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:54.730 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:54.721+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:55.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:55.026+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:55.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:55.243+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:55.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:55.483+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:55.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:55.558+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:55.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:55.629+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:55.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:55.666+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:55.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:55.707+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:55.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:55.984+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:56.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:56.285+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:56.515 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:56.508+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:56.547 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:56.532+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:56.657 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:56.640+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:56.704 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:56.696+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:56.733 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:56.721+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:57.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:57.016+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:57.311 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:57.303+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:57.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:57.532+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:57.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:57.582+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:57.603 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:57.596+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:57.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:57.681+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:57.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:57.712+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:58.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:58.023+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:58.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:58.324+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:58.557 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:58.549+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:58.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:58.554+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:58.596 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:58.588+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:58.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:58.637+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:58.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:58.761+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:19:59.046 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:19:59.038+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:19:59.312 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:19:59.303+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:19:59.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:19:59.541+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:19:59.585 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:19:59.578+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:19:59.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:19:59.614+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:19:59.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:19:59.661+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:19:59.787 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:19:59.770+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:00.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:00.017+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:00.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:00.350+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:00.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:00.531+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:00.571 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:00.563+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:00.656 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:00.648+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:00.708 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:00.698+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:00.777 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:00.769+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:01.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:01.048+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:01.318 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:01.311+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:01.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:01.506+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:01.567 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:01.560+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:01.698 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:01.691+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:01.706 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:01.700+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:01.798 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:01.791+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:02.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:02.055+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:02.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:02.290+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:02.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:02.462+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:02.554 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:02.546+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:02.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:02.654+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:02.685 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:02.676+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:02.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:02.782+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:03.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:03.060+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:03.278 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:03.270+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:03.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:03.461+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:03.527 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:03.520+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:03.631 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:03.623+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:03.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:03.666+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:03.834 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:03.826+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:04.096 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:04.090+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:04.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:04.247+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:04.481 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:04.475+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:04.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:04.476+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:04.633 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:04.625+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:04.657 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:04.650+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:04.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:04.826+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:05.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:05.128+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:05.241 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:05.233+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:05.473 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:05.461+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:05.479 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:05.473+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:05.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:05.629+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:05.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:05.646+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:05.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:05.792+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:06.146 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:06.137+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:06.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:06.277+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:06.460 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:06.438+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:06.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:06.507+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:06.685 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:06.677+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:06.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:06.685+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:06.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:06.767+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:07.103 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:07.097+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:07.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:07.326+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:07.418 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:07.410+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:07.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:07.485+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:07.697 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:07.690+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:07.745 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:07.735+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:07.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:07.814+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:08.067 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:08.058+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:08.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:08.371+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:08.423 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:08.415+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:08.474 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:08.466+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:08.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:08.742+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:08.779 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:08.770+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:08.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:08.822+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:09.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:09.019+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:09.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:09.384+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:09.408 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:09.401+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:09.530 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:09.519+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:09.746 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:09.737+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:09.747 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:09.740+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:09.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:09.864+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:10.076 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:10.064+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:10.441 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:10.431+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:10.446 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:10.436+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:10.489 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:10.482+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:10.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:10.780+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:10.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:10.783+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:10.877 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:10.862+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:11.081 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:11.074+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:11.393 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:11.385+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:11.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:11.466+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:11.532 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:11.525+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:11.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:11.783+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:11.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:11.792+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:11.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:11.827+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:12.126 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:12.119+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:12.358 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:12.351+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:12.460 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:12.452+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:12.520 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:12.511+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:12.771 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:12.761+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:12.771 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:12.761+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:12.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:12.831+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:13.103 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:13.095+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:13.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:13.324+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:13.481 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:13.472+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:13.519 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:20:13.512+0000 1694c700 -1 osd.2 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:57.141425+0000 front 2019-11-29T19:18:57.233790+0000 (oldest deadline 2019-11-29T19:19:41.682192+0000) 2019-11-29T19:20:13.749 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:13.740+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:20:13.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:20:13.772+0000 1694c700 -1 osd.6 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.493946+0000 front 2019-11-29T19:19:00.496713+0000 (oldest deadline 2019-11-29T19:19:44.567507+0000) 2019-11-29T19:20:13.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:20:13.812+0000 1694c700 -1 osd.4 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.379701+0000 front 2019-11-29T19:18:59.514074+0000 (oldest deadline 2019-11-29T19:19:43.415075+0000) 2019-11-29T19:20:14.083 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:20:14.075+0000 1694c700 -1 osd.1 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:56.549529+0000 front 2019-11-29T19:18:56.584653+0000 (oldest deadline 2019-11-29T19:19:41.095061+0000) 2019-11-29T19:20:14.115 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:20:14.105+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e728 v728) 2019-11-29T19:20:14.331 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:20:14.320+0000 1694c700 -1 osd.3 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.891359+0000 front 2019-11-29T19:18:59.968565+0000 (oldest deadline 2019-11-29T19:19:41.416898+0000) 2019-11-29T19:20:14.483 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:20:14.477+0000 1694c700 -1 osd.7 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:19:00.206452+0000 front 2019-11-29T19:19:00.260946+0000 (oldest deadline 2019-11-29T19:19:46.083030+0000) 2019-11-29T19:20:14.738 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:20:14.732+0000 1694c700 -1 osd.5 728 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:18:59.969550+0000 front 2019-11-29T19:18:59.989569+0000 (oldest deadline 2019-11-29T19:19:42.059112+0000) 2019-11-29T19:21:11.995 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:11.986+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:12.922 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:12.916+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:12.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:12.949+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:12.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:12.976+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:13.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:13.127+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:13.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:13.182+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:13.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:13.876+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:13.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:13.936+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:13.976 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:13.960+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:14.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:14.152+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:14.183 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:14.176+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:14.359 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:14.352+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:14.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:14.829+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:14.930 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:14.924+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:14.965 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:14.958+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:15.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:15.197+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:15.215 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:15.208+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:15.330 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:15.321+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:15.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:15.816+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:15.899 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:15.893+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:15.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:15.968+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:16.182 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:16.174+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:16.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:16.243+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:16.374 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:16.366+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:16.852 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:16.845+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:16.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:16.936+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:16.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:16.962+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:17.179 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:17.171+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:17.269 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:17.262+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:17.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:17.403+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:17.901 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:17.893+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:17.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:17.895+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:17.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:17.950+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:18.191 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:18.184+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:18.274 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:18.265+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:18.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:18.385+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:18.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:18.902+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:18.928 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:18.921+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:18.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:18.966+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:19.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:19.155+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:19.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:19.204+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:19.308 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:19.301+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:19.385 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:19.378+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:19.933 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:19.925+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:19.945 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:19.939+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:19.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:19.975+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:20.168 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:20.160+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:20.231 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:20.225+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:20.350 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:20.343+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:20.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:20.370+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:20.910 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:20.903+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:20.917 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:20.910+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:20.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:20.965+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:21.146 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:21.137+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:21.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:21.271+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:21.348 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:21.341+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:21.383 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:21.376+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:21.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:21.868+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:21.924 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:21.916+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:21.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:21.954+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:22.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:22.134+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:22.238 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:22.233+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:22.346 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:22.340+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:22.389 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:22.382+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:22.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:22.851+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:22.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:22.924+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:22.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:22.936+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:23.173 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:23.167+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:23.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:23.285+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:23.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:23.343+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:23.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:23.376+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:23.831 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:23.824+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:23.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:23.911+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:23.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:23.949+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:24.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:24.205+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:24.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:24.250+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:24.347 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:24.340+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:24.376 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:24.369+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:24.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:24.816+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:24.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:24.889+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:24.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:24.980+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:25.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:25.231+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:25.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:25.305+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:25.352 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:25.346+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:25.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:25.419+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:25.784 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:25.777+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:25.878 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:25.872+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:26.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:26.009+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:26.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:26.213+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:26.307 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:26.300+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:26.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:26.338+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:26.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:26.340+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:26.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:26.398+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:26.811 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:26.804+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:26.920 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:26.913+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:27.019 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:27.012+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:27.202 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:27.194+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:27.329 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:27.320+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:27.364 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:27.356+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:27.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:27.359+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:27.424 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:27.417+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:27.856 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:27.848+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:27.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:27.931+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:27.994 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:27.987+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:28.216 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:28.209+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:28.353 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:28.346+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:28.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:28.401+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:28.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:28.407+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:28.416 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:28.409+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:28.878 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:28.871+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:28.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:28.923+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:29.014 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:29.006+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:29.184 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:29.177+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:29.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:29.350+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:29.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:29.410+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:29.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:29.411+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:29.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:29.443+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:29.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:29.899+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:29.925 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:29.918+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:30.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:30.014+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:30.169 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:21:30.162+0000 1694c700 -1 osd.4 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:30.414392+0000 front 2019-11-29T19:20:30.462439+0000 (oldest deadline 2019-11-29T19:21:12.690416+0000) 2019-11-29T19:21:30.316 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:30.309+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:30.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:30.399+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:30.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:30.419+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:30.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:30.420+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:30.900 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:30.891+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:30.923 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:30.915+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:30.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:30.985+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:31.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:31.347+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:31.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:31.398+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:31.448 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:31.436+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:31.448 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:31.437+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:31.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:31.883+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:31.914 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:31.907+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:31.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:31.984+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:32.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:32.332+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:32.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:32.409+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:32.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:32.480+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:32.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:32.482+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:32.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:32.929+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:32.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:32.946+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:32.960 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:32.952+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:33.361 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:33.354+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:33.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:33.366+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:33.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:33.466+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:33.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:33.472+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:33.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:33.923+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:33.945 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:33.938+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:33.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:33.968+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:34.322 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:34.315+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:34.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:34.372+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:34.462 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:34.456+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:34.464 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:34.457+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:34.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:34.946+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:34.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:34.949+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:34.997 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:34.989+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:35.333 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:35.320+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:35.345 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:35.329+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:35.452 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:35.446+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:35.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:35.449+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:35.950 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:35.943+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:35.974 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:35.967+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:36.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:36.040+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:36.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:36.295+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:36.377 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:36.370+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:36.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:36.407+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:36.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:36.408+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:36.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:36.906+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:36.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:36.950+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:37.005 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:36.996+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:37.274 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:37.268+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:37.354 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:37.346+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:37.390 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:37.382+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:37.391 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:37.384+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:37.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:37.946+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:37.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:37.991+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:38.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:38.024+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:38.276 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:38.269+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:38.327 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:38.321+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:38.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:38.401+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:38.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:38.403+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:38.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:38.921+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:39.000 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:38.993+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:39.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:39.009+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:39.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:39.270+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:39.296 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:39.289+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:39.450 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:39.443+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:39.451 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:39.446+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:39.943 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:39.937+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:40.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:40.002+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:40.043 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:40.035+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:40.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:40.252+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:40.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:40.276+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:40.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:40.466+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:40.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:40.470+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:40.951 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:40.944+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:41.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:41.056+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:41.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:41.056+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:41.217 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:41.209+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:41.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:41.329+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:41.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:41.473+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:41.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:41.475+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:41.945 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:41.938+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:42.033 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:42.025+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:42.093 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:42.084+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:42.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:42.186+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:42.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:42.330+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:42.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:42.515+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:42.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:42.517+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:42.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:42.982+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:43.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:43.008+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:43.142 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:43.134+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:43.177 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:43.168+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:43.322 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:43.314+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:43.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:43.485+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:43.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:43.489+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:44.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:44.006+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:44.020 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:44.011+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:44.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:44.096+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:44.242 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:44.220+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:44.293 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:44.285+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:44.405 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:21:44.399+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e734 v734) 2019-11-29T19:21:44.537 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:44.529+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:44.538 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:44.532+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:45.006 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:44.999+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:45.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:45.017+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:45.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:45.112+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:45.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:45.200+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:45.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:45.316+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:45.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:45.500+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:45.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:45.504+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:46.006 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:45.999+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:46.010 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:46.004+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:46.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:46.087+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:46.243 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:46.235+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:46.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:46.365+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:46.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:46.551+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:46.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:46.553+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:47.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:47.041+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:47.054 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:47.046+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:47.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:47.050+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:47.275 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:47.267+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:47.405 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:47.397+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:47.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:47.515+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:47.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:47.517+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:48.019 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:48.012+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:48.062 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:48.055+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:48.095 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:48.086+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:48.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:48.242+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:48.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:48.407+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:48.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:48.536+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:48.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:48.538+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:48.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:48.972+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:49.070 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:49.062+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:49.146 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:49.139+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:49.257 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:49.249+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:49.427 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:21:49.419+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e734 v734) 2019-11-29T19:21:49.450 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:49.443+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:49.501 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:49.494+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:49.501 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:49.495+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:49.996 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:49.989+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:50.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:50.026+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:50.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:50.119+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:50.256 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:50.249+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:50.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:50.420+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:50.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:50.465+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:50.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:50.469+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:50.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:50.972+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:51.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:51.056+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:51.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:51.133+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:51.247 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:51.240+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:51.436 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:51.429+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:51.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:51.453+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:51.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:51.455+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:52.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:52.024+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:52.057 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:52.050+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:52.112 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:52.105+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:52.250 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:52.243+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:52.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:52.440+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:52.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:52.464+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:52.474 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:52.468+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:52.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:52.981+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:53.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:53.048+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:53.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:53.123+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:53.284 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:53.277+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:53.450 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:53.442+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:53.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:53.484+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:53.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:53.486+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:53.979 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:53.971+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:54.060 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:54.054+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:54.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:54.169+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:54.321 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:54.314+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:54.449 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:54.442+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:54.450 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:21:54.437+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e734 v734) 2019-11-29T19:21:54.539 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:54.532+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:54.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:54.535+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:55.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:55.006+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:55.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:55.030+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:55.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:55.173+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:55.299 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:55.292+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:55.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:55.403+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:55.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:55.513+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:55.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:55.514+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:55.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:55.986+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:56.073 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:56.066+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:56.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:56.222+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:56.281 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:56.274+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:56.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:56.439+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:56.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:56.560+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:56.569 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:56.562+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:57.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:57.018+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:57.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:57.022+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:57.263 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:57.256+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:57.270 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:57.263+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:57.433 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:57.425+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:57.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:57.572+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:57.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:57.575+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:58.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:57.996+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:58.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:58.019+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:58.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:58.249+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:58.275 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:58.269+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:58.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:58.404+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:58.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:58.533+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:58.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:58.534+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:58.988 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:21:58.981+0000 1694c700 -1 osd.5 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.915553+0000 front 2019-11-29T19:20:26.909712+0000 (oldest deadline 2019-11-29T19:21:11.570185+0000) 2019-11-29T19:21:59.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:21:58.998+0000 1694c700 -1 osd.2 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.845282+0000 front 2019-11-29T19:20:26.771146+0000 (oldest deadline 2019-11-29T19:21:12.050751+0000) 2019-11-29T19:21:59.274 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:21:59.267+0000 1694c700 -1 osd.7 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:28.234692+0000 front 2019-11-29T19:20:28.575837+0000 (oldest deadline 2019-11-29T19:21:12.907133+0000) 2019-11-29T19:21:59.301 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:21:59.294+0000 1694c700 -1 osd.1 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:29.956818+0000 front 2019-11-29T19:20:30.073466+0000 (oldest deadline 2019-11-29T19:21:13.402261+0000) 2019-11-29T19:21:59.382 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:21:59.375+0000 1694c700 -1 osd.6 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:20:26.468092+0000 front 2019-11-29T19:20:26.469623+0000 (oldest deadline 2019-11-29T19:21:12.340829+0000) 2019-11-29T19:21:59.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:59.487+0000 1694c700 -1 osd.0 734 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:20:46.219488+0000 (oldest deadline 2019-11-29T19:21:26.219488+0000) 2019-11-29T19:21:59.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:21:59.490+0000 1694c700 -1 osd.0 734 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:120245 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e732) 2019-11-29T19:21:59.524 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:21:59.517+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e734 v734) 2019-11-29T19:22:16.056 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:24.190 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.065 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:24.200 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.079 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:24.257 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.080 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:24.258 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.083 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:24.263 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.083 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:24.263 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.310 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:24.490 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.361 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:24.540 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:16.399 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:24.534 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.816 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:27.950 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.854 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:27.989 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.867 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:28.047 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.871 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:28.006 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.873 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:28.052 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.874 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:28.054 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.914 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:28.094 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.919 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:28.100 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:19.934 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:28.114 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:29.508 INFO:teuthology.orchestra.run.smithi182.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-11-29T19:22:29.906 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-29T19:22:35.209 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:43.343 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.221 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:43.356 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.281 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:06:43.415 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.300 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:43.471 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.301 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:43.478 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.309 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:43.488 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.309 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:43.489 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.353 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:06:43.533 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:22:35.372 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:06:43.551 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:23:26.077 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:26.060+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:26.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:26.236+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:26.623 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:26.615+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:27.057 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:27.049+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:27.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:27.230+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:27.663 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:27.655+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:28.078 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:28.072+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:28.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:28.265+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:28.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:28.360+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:28.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:28.647+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:29.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:29.106+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:29.148 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:29.140+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:29.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:29.261+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:29.332 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:29.323+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:29.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:29.624+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:30.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:30.073+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:30.108 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:30.101+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:30.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:30.281+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:30.319 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:30.310+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:30.367 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:30.359+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:30.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:30.598+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:31.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:31.028+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:31.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:31.113+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:31.324 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:31.316+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:31.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:31.319+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:31.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:31.386+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:31.591 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:31.582+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:32.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:32.039+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:32.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:32.083+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:32.282 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:32.276+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:32.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:32.298+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:32.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:32.405+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:32.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:32.634+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:33.031 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:33.023+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:33.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:33.068+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:33.307 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:33.298+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:33.319 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:33.311+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:33.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:33.409+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:33.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:33.619+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:34.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:33.998+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:34.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:34.053+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:34.309 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:34.301+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:34.333 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:34.327+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:34.434 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:34.426+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:34.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:34.631+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:34.960 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:34.953+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:35.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:35.013+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:35.274 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:35.267+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:35.334 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:35.327+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:35.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:35.434+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:35.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:35.628+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:35.937 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:35.929+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:36.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:36.034+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:36.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:36.297+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:36.369 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:36.361+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:36.495 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:36.487+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:36.593 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:36.587+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:36.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:36.933+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:37.076 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:37.069+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:37.332 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:37.324+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:37.355 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:37.348+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:37.535 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:37.529+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:37.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:37.563+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:37.906 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:37.899+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:38.110 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:38.102+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:38.339 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:38.332+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:38.384 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:38.376+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:38.567 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:38.560+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:38.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:38.613+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:38.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:38.919+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:39.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:39.092+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:39.299 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:39.291+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:39.384 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:39.376+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:39.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:39.548+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:39.605 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:39.595+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:39.945 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:39.938+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:40.081 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:40.070+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:40.269 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:40.262+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:40.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:40.393+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:40.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:40.512+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:40.581 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:40.570+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:40.990 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:40.983+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:41.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:41.059+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:41.240 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:41.232+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:41.380 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:41.373+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:41.497 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:41.489+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:41.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:41.580+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:42.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:42.015+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:42.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:42.077+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:42.240 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:42.231+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:42.433 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:42.425+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:42.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:42.513+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:42.576 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:42.570+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:43.053 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:43.046+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:43.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:43.126+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:43.249 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:43.241+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:43.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:43.401+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:43.535 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:43.525+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:43.592 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:43.584+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:44.033 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:44.025+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:44.171 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:44.163+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:44.251 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:44.244+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:44.390 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:44.382+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:44.526 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:44.518+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:44.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:44.577+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:45.020 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:45.013+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:45.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:45.118+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:45.286 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:45.279+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:45.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:45.360+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:45.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:45.475+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:45.585 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:45.575+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:46.055 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:46.047+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:46.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:46.078+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:46.286 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:46.279+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:46.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:46.372+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:46.489 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:46.482+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:46.577 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:46.564+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:47.084 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:47.073+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:47.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:47.089+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:47.282 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:47.275+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:47.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:47.362+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:47.546 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:47.538+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:47.558 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:47.550+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:48.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:48.109+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:48.128 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:48.121+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:48.236 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:48.230+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:48.387 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:48.375+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:48.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:48.518+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:48.574 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:48.567+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:49.141 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:49.134+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:49.168 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:49.160+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:49.208 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:49.200+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:49.392 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:49.385+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:49.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:49.519+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:49.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:49.583+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:50.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:50.115+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:50.193 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:50.184+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:50.193 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:50.183+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:50.421 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:50.413+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:50.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:50.549+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:50.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:50.562+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:51.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:51.130+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:51.202 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:51.195+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:51.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:51.213+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:51.404 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:51.397+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:51.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:51.565+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:51.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:51.582+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:52.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:52.133+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:52.187 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:52.180+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:52.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:52.257+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:52.396 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:52.388+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:52.550 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:52.543+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:52.622 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:52.614+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:53.155 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:53.147+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:53.194 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:53.186+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:53.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:53.220+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:53.440 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:53.434+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:53.585 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:53.577+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:53.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:53.581+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:53.868 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:53.861+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:54.128 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:54.121+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:54.217 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:54.203+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:54.277 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:54.264+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:54.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:54.468+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:54.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:54.562+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:54.629 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:54.621+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:54.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:54.874+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:55.088 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:55.080+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:55.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:55.162+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:55.279 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:55.271+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:55.490 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:55.483+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:55.584 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:55.577+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:55.613 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:55.605+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:55.859 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:55.850+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:56.120 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:56.112+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:56.130 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:56.121+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:56.249 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:56.241+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:56.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:56.515+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:56.603 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:56.595+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:56.611 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:56.604+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:56.891 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:56.883+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:57.120 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:57.107+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:57.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:57.140+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:57.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:57.262+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:57.502 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:57.490+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:57.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:57.570+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:57.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:57.615+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:57.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:57.877+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:58.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:58.102+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:58.150 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:58.143+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:58.273 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:58.264+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:58.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:58.510+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:58.575 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:58.568+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:58.579 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:58.571+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:58.856 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:58.847+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:23:59.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:23:59.155+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:23:59.198 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:23:59.189+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:23:59.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:23:59.262+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:23:59.484 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:23:59.475+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:23:59.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:23:59.580+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:23:59.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:23:59.617+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:23:59.821 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:23:59.814+0000 1694c700 -1 osd.1 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.005660+0000 front 2019-11-29T19:22:40.272050+0000 (oldest deadline 2019-11-29T19:23:53.056201+0000) 2019-11-29T19:24:00.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:24:00.141+0000 1694c700 -1 osd.6 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:43.077652+0000 front 2019-11-29T19:22:43.100604+0000 (oldest deadline 2019-11-29T19:23:28.938116+0000) 2019-11-29T19:24:00.229 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:24:00.221+0000 1694c700 -1 osd.3 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:44.229672+0000 front 2019-11-29T19:22:44.226208+0000 (oldest deadline 2019-11-29T19:23:30.079481+0000) 2019-11-29T19:24:00.307 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:24:00.298+0000 1694c700 -1 osd.4 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.916577+0000 front 2019-11-29T19:22:41.732280+0000 (oldest deadline 2019-11-29T19:23:25.054329+0000) 2019-11-29T19:24:00.479 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:24:00.468+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e739 v739) 2019-11-29T19:24:00.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:24:00.494+0000 1694c700 -1 osd.5 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:40.571513+0000 front 2019-11-29T19:22:41.072719+0000 (oldest deadline 2019-11-29T19:23:25.947431+0000) 2019-11-29T19:24:00.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:24:00.583+0000 1694c700 -1 osd.7 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:42.062316+0000 front 2019-11-29T19:22:42.052253+0000 (oldest deadline 2019-11-29T19:23:27.925909+0000) 2019-11-29T19:24:00.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:24:00.670+0000 1694c700 -1 osd.2 739 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:22:41.097776+0000 front 2019-11-29T19:22:40.908014+0000 (oldest deadline 2019-11-29T19:23:25.987774+0000) 2019-11-29T19:24:59.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:24:59.437+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:24:59.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:24:59.562+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:00.022 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:00.016+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:00.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:00.445+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:00.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:00.562+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:00.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:00.611+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:00.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:00.979+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:01.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:01.414+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:01.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:01.527+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:01.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:01.638+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:01.653 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:01.646+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:01.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:01.943+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:02.080 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:02.072+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:02.378 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:02.369+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:02.580 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:02.573+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:02.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:02.606+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:02.642 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:02.636+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:02.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:02.954+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:03.035 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:03.029+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:03.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:03.424+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:03.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:03.544+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:03.605 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:03.598+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:03.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:03.652+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:03.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:03.965+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:04.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:04.017+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:04.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:04.382+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:04.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:04.594+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:04.643 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:04.636+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:04.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:04.672+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:04.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:04.933+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:04.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:04.976+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:05.433 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:05.426+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:05.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:05.565+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:05.634 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:05.628+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:05.642 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:05.636+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:05.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:05.707+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:05.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:05.955+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:05.988 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:05.974+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:06.445 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:06.438+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:06.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:06.589+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:06.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:06.603+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:06.679 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:06.672+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:06.720 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:06.713+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:06.930 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:06.923+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:06.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:06.963+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:07.431 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:07.424+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:07.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:07.612+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:07.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:07.630+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:07.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:07.670+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:07.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:07.720+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:07.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:07.919+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:07.967 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:07.960+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:08.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:08.472+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:08.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:08.630+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:08.672 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:08.665+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:08.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:08.674+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:08.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:08.706+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:08.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:08.904+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:09.011 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:09.003+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:09.441 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:09.434+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:09.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:09.612+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:09.703 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:09.697+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:09.706 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:09.700+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:09.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:09.744+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:09.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:09.927+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:10.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:10.000+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:10.493 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:10.486+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:10.587 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:10.579+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:10.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:10.664+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:10.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:10.704+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:10.725 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:10.718+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:10.726 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:10.720+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:10.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:10.908+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:10.965 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:10.958+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:11.526 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:11.519+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:11.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:11.616+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:11.668 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:11.661+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:11.703 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:11.696+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:11.731 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:11.724+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:11.732 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:11.726+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:11.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:11.948+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:12.019 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:12.013+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:12.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:12.542+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:12.583 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:12.574+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:12.705 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:12.698+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:12.713 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:12.707+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:12.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:12.734+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:12.743 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:12.736+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:12.940 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:12.933+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:13.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:12.998+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:13.569 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:13.563+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:13.596 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:13.589+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:13.701 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:13.694+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:13.728 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:13.721+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:13.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:13.763+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:13.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:13.764+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:13.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:13.962+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:13.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:13.989+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:14.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:14.541+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:14.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:14.613+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:14.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:14.693+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:14.710 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:14.703+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:14.814 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:14.807+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:14.815 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:14.809+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:14.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:14.942+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:15.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:15.019+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:15.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:15.504+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:15.622 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:15.615+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:15.718 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:15.711+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:15.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:15.753+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:15.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:15.763+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:15.770 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:15.764+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:15.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:15.912+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:16.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:16.056+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:16.494 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:16.486+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:16.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:16.623+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:16.694 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:16.687+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:16.736 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:16.730+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:16.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:16.733+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:16.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:16.794+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:16.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:16.907+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:17.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:17.060+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:17.475 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:17.468+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:17.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:17.614+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:17.747 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:17.741+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:17.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:17.763+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:17.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:17.765+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:17.835 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:17.828+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:17.958 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:17.950+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:18.082 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:18.075+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:18.474 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:18.467+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:18.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:18.652+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:18.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:18.733+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:18.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:18.804+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:18.813 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:18.808+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:18.829 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:18.822+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:18.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:18.985+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:19.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:19.103+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:19.479 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:19.470+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:19.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:19.617+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:19.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:19.695+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:19.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:19.777+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:19.827 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:19.814+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:19.829 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:19.816+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:19.974 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:19.967+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:20.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:20.103+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:20.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:20.445+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:20.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:20.595+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:20.743 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:20.737+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:20.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:20.796+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:20.852 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:20.843+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:20.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:20.848+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:20.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:20.955+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:21.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:21.060+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:21.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:21.413+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:21.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:21.639+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:21.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:21.703+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:21.823 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:21.816+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:21.823 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:21.818+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:21.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:21.831+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:21.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:21.918+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:22.043 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:22.035+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:22.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:22.414+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:22.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:22.679+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:22.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:22.745+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:22.826 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:22.820+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:22.828 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:22.822+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:22.853 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:22.846+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:22.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:22.878+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:23.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:23.056+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:23.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:23.380+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:23.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:23.735+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:23.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:23.781+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:23.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:23.840+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:23.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:23.849+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:23.860 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:23.854+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:23.886 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:23.878+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:24.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:24.050+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:24.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:24.359+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:24.759 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:24.751+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:24.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:24.769+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:24.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:24.810+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:24.903 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:24.896+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:24.904 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:24.898+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:24.905 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:24.897+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:25.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:25.072+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:25.364 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:25.358+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:25.793 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:25.786+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:25.808 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:25.801+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:25.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:25.802+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:25.863 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:25.856+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:25.913 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:25.896+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:25.915 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:25.897+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:26.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:26.084+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:26.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:26.332+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:26.778 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:26.770+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:26.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:26.827+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:26.857 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:26.850+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:26.895 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:26.888+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:26.917 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:26.911+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:26.919 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:26.913+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:27.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:27.077+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:27.378 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:27.370+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:27.813 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:27.805+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:27.842 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:27.835+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:27.877 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:27.856+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:27.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:27.873+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:27.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:27.874+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:27.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:27.913+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:28.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:28.051+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:28.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:28.369+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:28.834 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:28.826+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:28.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:28.841+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:28.890 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:28.883+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:28.915 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:28.908+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:28.916 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:28.910+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:28.940 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:28.934+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:29.015 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:29.007+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:29.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:29.355+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:29.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:29.810+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:29.873 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:29.859+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:29.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:29.905+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:29.958 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:29.951+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:29.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:29.959+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:29.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:29.963+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:30.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:29.998+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:30.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:30.401+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:30.780 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:30.767+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:30.786 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:25:30.773+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e745 v745) 2019-11-29T19:25:30.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:30.820+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:30.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:30.882+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:30.958 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:30.950+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:30.959 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:30.951+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:30.992 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:30.985+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:31.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:31.050+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:31.429 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:31.421+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:31.749 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:31.740+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:31.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:31.815+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:31.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:31.922+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:31.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:31.947+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:31.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:31.952+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:32.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:31.997+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:32.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:32.048+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:32.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:32.454+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:32.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:32.777+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:32.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:32.857+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:32.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:32.933+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:32.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:32.978+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:32.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:32.980+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:33.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:33.011+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:33.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:33.093+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:33.460 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:33.452+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:33.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:33.752+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:33.895 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:33.887+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:33.976 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:33.969+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:34.029 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:34.022+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:34.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:34.026+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:34.058 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:34.051+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:34.138 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:25:34.131+0000 1694c700 -1 osd.6 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:14.484823+0000 front 2019-11-29T19:24:14.395587+0000 (oldest deadline 2019-11-29T19:24:59.462574+0000) 2019-11-29T19:25:34.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:34.425+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:34.782 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:34.774+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:34.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:34.891+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:34.970 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:34.963+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:35.012 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:35.005+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:35.015 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:35.009+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:35.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:35.104+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:35.464 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:35.455+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:35.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:35.776+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:35.800 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:25:35.793+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e745 v745) 2019-11-29T19:25:35.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:35.917+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:35.987 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:35.978+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:35.987 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:35.981+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:35.994 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:35.986+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:36.067 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:36.060+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:36.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:36.413+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:36.839 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:36.824+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:36.948 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:36.933+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:37.069 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:36.935+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:37.070 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:36.942+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:37.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:36.973+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:37.100 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:37.093+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:37.435 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:37.428+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:37.795 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:37.787+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:37.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:37.896+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:37.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:37.931+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:37.940 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:37.935+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:38.001 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:37.995+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:38.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:38.052+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:38.467 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:38.460+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:38.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:38.786+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:38.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:38.889+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:38.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:38.976+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:38.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:38.979+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:39.031 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:39.025+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:39.075 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:39.069+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:39.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:39.423+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:39.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:39.771+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:39.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:39.940+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:40.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:40.012+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:40.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:40.013+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:40.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:40.028+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:40.118 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:25:40.112+0000 1694c700 -1 osd.1 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:16.454060+0000 front 2019-11-29T19:24:16.581339+0000 (oldest deadline 2019-11-29T19:25:01.720427+0000) 2019-11-29T19:25:40.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:40.398+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:40.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:25:40.819+0000 1694c700 -1 osd.4 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:15.766142+0000 front 2019-11-29T19:24:15.746307+0000 (oldest deadline 2019-11-29T19:25:00.423791+0000) 2019-11-29T19:25:40.888 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:25:40.877+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e745 v745) 2019-11-29T19:25:40.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:40.987+0000 1694c700 -1 osd.0 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:24:30.025177+0000 (oldest deadline 2019-11-29T19:25:10.025177+0000) 2019-11-29T19:25:40.994 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:25:40.989+0000 1694c700 -1 osd.0 745 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e743) 2019-11-29T19:25:41.038 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:41.032+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:25:41.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:25:41.031+0000 1694c700 -1 osd.5 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:12.999623+0000 front 2019-11-29T19:24:12.973176+0000 (oldest deadline 2019-11-29T19:24:58.820630+0000) 2019-11-29T19:25:41.418 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:25:41.411+0000 1694c700 -1 osd.7 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:13.103357+0000 front 2019-11-29T19:24:13.139953+0000 (oldest deadline 2019-11-29T19:24:58.966696+0000) 2019-11-29T19:25:42.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:25:42.009+0000 1694c700 -1 osd.2 745 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:24:17.220618+0000 front 2019-11-29T19:24:17.199589+0000 (oldest deadline 2019-11-29T19:25:00.681699+0000) 2019-11-29T19:26:10.507 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:18.641 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.515 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:18.650 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.527 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:18.707 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.531 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:18.710 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.535 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:18.715 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.541 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:18.720 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.732 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:18.867 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.840 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:19.020 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:10.873 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:19.053 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.609 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:20.744 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.611 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:20.745 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.625 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:10:20.760 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.713 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:20.892 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.714 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:20.894 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.745 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:10:20.925 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.761 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:20.940 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.762 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:20.942 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:26:12.789 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:10:20.969 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:27:12.465 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:12.457+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:13.408 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:13.393+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:13.437 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:13.429+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:13.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:13.522+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:13.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:13.529+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:14.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:14.125+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:14.397 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:14.388+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:14.413 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:14.405+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:14.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:14.497+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:14.554 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:14.546+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:14.624 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:14.618+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:15.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:15.148+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:15.422 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:15.409+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:15.461 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:15.455+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:15.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:15.465+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:15.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:15.579+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:15.659 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:15.650+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:16.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:16.202+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:16.387 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:16.379+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:16.423 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:16.417+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:16.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:16.478+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:16.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:16.565+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:16.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:16.609+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:17.228 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:17.219+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:17.365 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:17.357+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:17.467 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:17.458+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:17.510 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:17.503+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:17.597 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:17.587+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:17.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:17.610+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:18.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:18.226+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:18.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:18.312+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:18.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:18.483+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:18.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:18.508+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:18.586 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:18.578+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:18.590 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:18.582+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:18.592 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:18.586+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:19.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:19.237+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:19.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:19.356+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:19.525 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:19.517+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:19.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:19.534+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:19.612 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:19.604+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:19.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:19.613+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:19.630 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:19.622+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:20.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:20.287+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:20.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:20.328+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:20.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:20.544+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:20.563 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:20.556+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:20.590 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:20.583+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:20.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:20.600+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:20.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:20.604+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:21.303 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:21.296+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:21.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:21.348+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:21.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:21.551+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:21.580 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:21.572+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:21.583 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:21.575+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:21.590 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:21.581+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:21.594 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:21.586+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:22.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:22.326+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:22.347 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:22.340+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:22.545 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:22.538+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:22.575 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:22.567+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:22.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:22.570+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:22.587 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:22.579+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:22.599 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:22.590+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:23.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:23.319+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:23.359 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:23.351+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:23.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:23.500+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:23.556 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:23.548+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:23.595 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:23.588+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:23.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:23.603+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:23.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:23.608+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:24.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:24.368+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:24.413 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:24.405+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:24.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:24.542+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:24.571 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:24.563+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:24.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:24.589+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:24.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:24.613+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:24.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:24.616+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:25.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:25.334+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:25.459 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:25.451+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:25.560 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:25.552+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:25.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:25.562+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:25.571 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:25.564+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:25.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:25.622+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:25.660 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:25.653+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:26.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:26.368+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:26.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:26.444+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:26.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:26.531+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:26.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:26.533+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:26.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:26.556+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:26.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:26.651+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:26.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:26.654+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:27.388 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:27.380+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:27.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:27.409+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:27.498 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:27.490+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:27.573 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:27.563+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:27.574 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:27.565+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:27.641 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:27.626+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:27.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:27.628+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:28.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:28.397+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:28.467 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:28.461+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:28.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:28.493+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:28.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:28.524+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:28.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:28.596+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:28.619 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:28.612+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:28.666 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:28.658+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:29.412 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:29.404+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:29.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:29.442+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:29.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:29.528+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:29.547 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:29.540+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:29.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:29.582+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:29.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:29.626+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:29.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:29.641+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:30.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:30.359+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:30.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:30.435+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:30.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:30.492+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:30.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:30.528+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:30.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:30.558+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:30.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:30.658+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:30.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:30.665+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:31.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:31.394+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:31.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:31.397+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:31.520 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:31.511+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:31.533 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:31.525+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:31.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:31.538+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:31.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:31.653+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:31.703 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:31.695+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:32.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:32.410+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:32.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:32.442+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:32.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:32.490+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:32.534 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:32.524+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:32.558 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:32.551+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:32.646 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:32.640+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:32.737 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:32.730+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:33.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:33.429+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:33.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:33.462+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:33.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:33.479+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:33.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:33.560+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:33.583 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:33.576+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:33.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:33.639+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:33.771 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:33.763+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:34.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:34.394+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:34.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:34.482+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:34.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:34.487+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:34.531 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:34.524+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:34.610 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:34.600+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:34.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:34.619+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:34.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:34.760+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:35.424 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:35.417+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:35.492 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:35.483+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:35.502 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:35.496+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:35.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:35.520+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:35.605 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:35.597+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:35.633 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:35.623+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:35.765 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:35.757+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:36.478 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:36.470+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:36.502 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:36.494+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:36.504 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:36.496+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:36.571 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:36.563+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:36.584 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:36.576+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:36.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:36.581+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:36.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:36.758+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:37.477 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:37.460+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:37.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:37.474+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:37.481 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:37.474+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:37.552 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:37.540+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:37.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:37.579+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:37.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:37.619+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:37.750 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:37.743+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:38.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:38.426+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:38.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:38.467+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:38.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:38.503+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:38.597 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:38.589+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:38.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:38.594+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:38.636 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:38.628+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:38.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:38.708+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:39.437 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:39.429+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:39.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:39.461+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:39.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:39.484+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:39.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:39.585+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:39.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:39.579+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:39.678 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:39.670+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:39.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:39.736+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:40.429 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:40.421+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:40.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:40.426+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:40.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:40.496+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:40.549 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:40.542+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:40.575 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:40.568+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:40.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:40.643+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:40.711 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:40.704+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:41.454 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:41.448+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:41.459 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:41.451+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:41.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:41.454+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:41.574 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:41.568+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:41.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:41.612+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:41.648 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:41.641+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:41.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:41.677+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:42.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:42.412+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:42.428 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:42.420+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:42.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:42.428+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:42.548 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:42.540+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:42.598 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:42.590+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:42.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:42.644+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:42.677 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:42.668+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:43.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:43.391+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:43.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:43.416+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:43.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:43.443+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:43.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:43.524+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:43.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:43.563+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:43.621 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:43.608+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:43.709 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:43.700+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:44.387 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:44.380+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:44.389 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:44.380+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:44.430 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:44.423+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:44.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:44.509+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:44.584 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:44.575+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:44.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:44.589+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:44.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:44.715+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:45.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:45.335+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:45.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:45.406+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:45.468 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:45.458+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:45.515 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:45.507+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:45.569 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:45.561+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:45.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:45.607+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:45.707 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:45.681+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:46.337 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:46.329+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:46.370 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:46.361+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:46.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:27:46.463+0000 1694c700 -1 osd.1 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.572383+0000 front 2019-11-29T19:26:28.557915+0000 (oldest deadline 2019-11-29T19:27:13.230353+0000) 2019-11-29T19:27:46.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:27:46.533+0000 1694c700 -1 osd.3 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.053855+0000 front 2019-11-29T19:26:28.047275+0000 (oldest deadline 2019-11-29T19:27:13.307434+0000) 2019-11-29T19:27:46.546 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:27:46.538+0000 1694c700 -1 osd.6 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:30.584733+0000 front 2019-11-29T19:26:30.653700+0000 (oldest deadline 2019-11-29T19:27:14.593809+0000) 2019-11-29T19:27:46.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:27:46.643+0000 1694c700 -1 osd.5 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:31.740211+0000 front 2019-11-29T19:26:31.804241+0000 (oldest deadline 2019-11-29T19:27:17.617279+0000) 2019-11-29T19:27:46.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:46.720+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:27:47.119 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:27:47.109+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e752 v752) 2019-11-29T19:27:47.353 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:27:47.347+0000 1694c700 -1 osd.7 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:26.290138+0000 front 2019-11-29T19:26:26.013360+0000 (oldest deadline 2019-11-29T19:27:11.879519+0000) 2019-11-29T19:27:47.374 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:27:47.367+0000 1694c700 -1 osd.2 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.982426+0000 front 2019-11-29T19:26:28.983039+0000 (oldest deadline 2019-11-29T19:27:13.495901+0000) 2019-11-29T19:27:47.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:27:47.753+0000 1694c700 -1 osd.4 752 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:26:28.759374+0000 front 2019-11-29T19:26:28.900463+0000 (oldest deadline 2019-11-29T19:27:13.426593+0000) 2019-11-29T19:28:44.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:44.890+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:45.905 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:45.898+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:45.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:45.979+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:46.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:46.732+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:46.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:46.936+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:46.999 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:46.992+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:47.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:47.782+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:47.918 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:47.911+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:48.011 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:48.003+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:48.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:48.289+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:48.330 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:48.322+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:48.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:48.823+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:48.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:48.953+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:48.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:48.958+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:49.061 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:49.054+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:49.282 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:49.276+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:49.315 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:49.308+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:49.813 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:49.806+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:49.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:49.934+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:49.964 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:49.956+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:50.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:50.094+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:50.274 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:50.268+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:50.298 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:50.291+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:50.355 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:50.350+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:50.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:50.794+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:50.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:50.965+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:50.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:50.969+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:51.079 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:51.066+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:51.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:51.248+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:51.323 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:51.316+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:51.396 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:51.391+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:51.759 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:51.752+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:51.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:51.929+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:51.981 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:51.973+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:52.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:52.052+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:52.251 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:52.244+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:52.323 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:52.316+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:52.363 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:52.357+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:52.808 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:52.800+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:52.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:52.928+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:52.975 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:52.969+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:53.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:53.063+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:53.268 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:53.262+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:53.276 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:53.269+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:53.378 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:53.373+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:53.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:53.826+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:53.939 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:53.932+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:53.945 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:53.938+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:54.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:54.111+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:54.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:54.235+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:54.272 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:54.266+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:54.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:54.407+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:54.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:54.793+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:54.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:54.897+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:54.927 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:54.921+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:55.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:55.125+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:55.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:55.205+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:55.253 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:55.247+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:55.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:55.454+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:55.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:55.843+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:55.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:55.898+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:55.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:55.940+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:56.134 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:56.128+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:56.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:56.209+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:56.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:56.255+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:56.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:56.431+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:28:56.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:56.433+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:56.904 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:56.897+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:56.928 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:56.922+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:56.937 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:56.931+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:57.132 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:57.126+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:57.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:57.213+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:57.237 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:57.231+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:57.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:57.403+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:28:57.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:57.406+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:57.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:57.854+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:57.901 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:57.889+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:57.937 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:57.930+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:58.135 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:58.128+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:58.238 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:58.231+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:58.259 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:58.253+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:58.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:58.427+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:28:58.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:58.431+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:58.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:58.866+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:58.923 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:58.917+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:58.955 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:58.948+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:28:59.174 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:28:59.167+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:28:59.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:28:59.243+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:28:59.299 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:28:59.291+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:28:59.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:59.413+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:28:59.422 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:28:59.415+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:28:59.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:28:59.850+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:28:59.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:28:59.933+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:28:59.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:28:59.937+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:00.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:00.205+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:00.291 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:00.282+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:00.348 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:00.342+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:00.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:00.369+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:00.376 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:00.370+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:00.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:00.849+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:00.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:00.895+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:00.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:00.971+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:01.171 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:01.163+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:01.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:01.305+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:01.318 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:01.311+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:01.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:01.409+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:01.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:01.413+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:01.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:01.827+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:01.952 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:01.945+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:01.996 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:01.989+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:02.164 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:02.158+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:02.292 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:02.286+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:02.341 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:02.335+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:02.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:02.452+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:02.462 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:02.454+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:02.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:02.809+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:02.937 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:02.927+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:02.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:02.981+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:03.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:03.146+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:03.291 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:03.283+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:03.357 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:03.351+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:03.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:03.457+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:03.464 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:03.458+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:03.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:03.845+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:03.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:03.945+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:03.972 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:03.965+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:04.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:04.106+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:04.319 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:04.311+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:04.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:04.327+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:04.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:04.483+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:04.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:04.485+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:04.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:04.868+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:04.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:04.957+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:04.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:04.964+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:05.149 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:05.140+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:05.302 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:05.295+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:05.345 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:05.334+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:05.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:05.517+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:05.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:05.519+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:05.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:05.844+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:05.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:05.928+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:05.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:05.991+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:06.119 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:06.111+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:06.277 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:06.271+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:06.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:06.387+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:06.493 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:06.483+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:06.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:06.486+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:06.901 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:06.894+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:06.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:06.948+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:07.026 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:07.019+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:07.073 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:07.066+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:07.246 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:07.239+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:07.396 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:07.388+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:07.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:07.439+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:07.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:07.440+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:07.919 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:07.912+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:07.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:07.976+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:08.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:08.041+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:08.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:29:08.074+0000 1694c700 -1 osd.7 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.738172+0000 front 2019-11-29T19:28:02.723589+0000 (oldest deadline 2019-11-29T19:28:48.590116+0000) 2019-11-29T19:29:08.220 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:08.213+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:08.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:08.409+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:08.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:08.487+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:08.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:08.489+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:08.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:08.932+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:08.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:08.978+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:09.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:08.998+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:09.276 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:09.268+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:09.394 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:09.387+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:09.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:09.476+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:09.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:09.479+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:09.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:09.976+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:10.010 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:10.002+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:10.026 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:10.020+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:10.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:10.228+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:10.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:10.402+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:10.466 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:10.452+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:10.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:10.459+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:10.953 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:10.945+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:11.044 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:11.036+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:11.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:11.054+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:11.214 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:11.208+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:11.378 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:11.371+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:11.444 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:11.438+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:11.447 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:11.441+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:11.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:11.939+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:12.003 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:11.996+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:12.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:12.091+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:12.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:12.176+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:12.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:12.409+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:12.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:12.412+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:12.424 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:12.416+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:12.947 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:12.940+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:12.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:12.972+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:13.069 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:13.061+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:13.136 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:13.130+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:13.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:13.395+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:13.470 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:13.462+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:13.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:13.464+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:13.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:13.955+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:13.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:13.969+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:14.105 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:14.097+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:14.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:14.102+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:14.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:14.412+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:14.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:14.461+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:14.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:14.463+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:14.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:14.962+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:14.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:14.980+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:15.103 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:15.095+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:15.122 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:15.110+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:15.443 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:15.436+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:15.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:15.483+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:15.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:15.485+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:15.974 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:15.966+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:16.008 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:16.000+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:16.100 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:16.093+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:16.104 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:16.097+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:16.406 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:16.399+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:16.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:16.462+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:16.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:16.465+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:16.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:16.941+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:16.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:16.971+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:17.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:17.092+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:17.103 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:17.094+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:17.372 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:17.365+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:17.436 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:29:17.427+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e759 v759) 2019-11-29T19:29:17.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:17.432+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:17.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:17.435+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:17.938 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:17.928+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:17.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:17.975+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:18.091 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:18.083+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:18.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:18.117+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:18.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:18.365+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:18.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:18.438+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:18.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:18.440+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:18.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:18.888+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:18.962 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:18.953+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:19.058 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:19.050+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:19.079 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:19.072+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:19.342 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:19.335+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:19.499 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:19.491+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:19.500 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:19.493+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:19.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:19.851+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:19.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:19.914+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:20.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:20.064+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:20.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:20.076+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:20.343 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:20.334+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:20.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:20.528+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:20.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:20.530+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:20.847 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:20.839+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:20.948 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:20.939+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:21.058 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:21.049+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:21.120 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:21.113+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:21.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:21.373+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:21.586 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:21.575+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:21.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:21.577+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:21.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:21.810+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:21.920 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:21.912+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:22.024 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:22.017+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:22.091 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:22.084+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:22.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:22.386+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:22.451 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:29:22.444+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e759 v759) 2019-11-29T19:29:22.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:22.551+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:22.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:22.553+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:22.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:22.792+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:22.937 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:22.928+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:23.007 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:23.000+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:23.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:23.049+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:23.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:23.410+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:23.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:23.548+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:23.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:23.550+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:23.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:23.757+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:23.930 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:23.922+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:24.005 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:23.997+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:24.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:24.043+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:24.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:24.401+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:24.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:24.508+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:24.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:24.510+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:24.814 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:24.807+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:24.972 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:24.965+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:24.982 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:24.974+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:25.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:25.060+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:25.443 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:25.436+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:25.502 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:25.495+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:25.504 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:25.496+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:25.830 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:25.821+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:26.015 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:26.008+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:26.036 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:26.026+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:26.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:26.067+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:26.441 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:26.434+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:26.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:26.453+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:26.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:26.454+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:26.831 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:29:26.824+0000 1694c700 -1 osd.5 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.654606+0000 front 2019-11-29T19:28:02.709390+0000 (oldest deadline 2019-11-29T19:28:46.131671+0000) 2019-11-29T19:29:26.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:26.975+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:27.029 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:29:27.022+0000 1694c700 -1 osd.2 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:02.505056+0000 front 2019-11-29T19:28:02.486268+0000 (oldest deadline 2019-11-29T19:28:47.765773+0000) 2019-11-29T19:29:27.083 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:27.077+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:29:27.408 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:29:27.396+0000 1694c700 -1 osd.1 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:28:04.539170+0000 front 2019-11-29T19:28:04.545210+0000 (oldest deadline 2019-11-29T19:28:48.031578+0000) 2019-11-29T19:29:27.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:27.501+0000 1694c700 -1 osd.0 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:28:16.193000+0000 (oldest deadline 2019-11-29T19:28:56.193000+0000) 2019-11-29T19:29:27.512 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:29:27.503+0000 1694c700 -1 osd.0 759 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e757) 2019-11-29T19:29:27.539 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:29:27.520+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e759 v759) 2019-11-29T19:29:27.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:29:27.980+0000 1694c700 -1 osd.6 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:58.844591+0000 front 2019-11-29T19:27:59.106638+0000 (oldest deadline 2019-11-29T19:28:44.719557+0000) 2019-11-29T19:29:28.054 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:29:28.047+0000 1694c700 -1 osd.4 759 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:27:59.861168+0000 front 2019-11-29T19:27:59.816176+0000 (oldest deadline 2019-11-29T19:28:45.044888+0000) 2019-11-29T19:30:06.386 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:14.520 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.397 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:14.532 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.412 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:14.590 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.412 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:14.592 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.412 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:14.590 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.415 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:14.594 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.653 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:14.832 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.737 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:14.917 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:06.763 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:14.896 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.068 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:51.203 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.072 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:51.206 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.108 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:51.288 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.126 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:51.305 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.132 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:51.313 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.135 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:14:51.270 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.136 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:51.316 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.171 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:14:51.350 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:43.178 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:14:51.358 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:30:58.535 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:30:58.527+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:30:59.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:30:59.180+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:30:59.529 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:30:59.521+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:30:59.553 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:30:59.546+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:00.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:00.190+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:00.488 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:00.481+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:00.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:00.533+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:00.576 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:00.569+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:00.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:00.893+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:01.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:01.206+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:01.232 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:01.224+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:01.466 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:01.460+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:01.557 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:01.550+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:01.565 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:01.558+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:01.950 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:01.941+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:02.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:02.235+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:02.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:02.251+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:02.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:02.470+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:02.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:02.541+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:02.604 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:02.595+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:03.001 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:02.994+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:03.271 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:03.260+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:03.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:03.273+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:03.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:03.441+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:03.543 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:03.533+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:03.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:03.574+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:03.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:03.619+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:04.034 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:04.026+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:04.283 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:04.267+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:04.312 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:04.306+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:04.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:04.465+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:04.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:04.488+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:04.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:04.611+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:04.646 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:04.639+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:05.099 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:05.080+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:05.257 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:05.249+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:05.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:05.283+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:05.448 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:05.442+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:05.514 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:05.507+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:05.628 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:05.621+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:05.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:05.633+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:06.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:06.062+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:06.302 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:06.295+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:06.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:06.321+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:06.446 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:06.437+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:06.544 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:06.537+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:06.621 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:06.610+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:06.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:06.625+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:07.045 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:07.038+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:07.285 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:07.277+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:07.349 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:07.341+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:07.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:07.403+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:07.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:07.538+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:07.614 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:07.604+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:07.639 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:07.631+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:08.018 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:08.011+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:08.253 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:08.246+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:08.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:08.364+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:08.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:08.435+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:08.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:08.531+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:08.633 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:08.621+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:08.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:08.644+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:09.002 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:08.994+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:09.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:09.252+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:09.344 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:09.337+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:09.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:09.408+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:09.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:09.560+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:09.649 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:09.641+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:09.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:09.653+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:10.017 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:10.010+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:10.306 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:10.297+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:10.364 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:10.356+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:10.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:10.363+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:10.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:10.541+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:10.640 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:10.633+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:10.696 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:10.688+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:11.028 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:11.020+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:11.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:11.316+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:11.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:11.327+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:11.340 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:11.332+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:11.520 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:11.512+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:11.600 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:11.592+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:11.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:11.718+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:12.010 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:12.003+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:12.307 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:12.300+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:12.364 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:12.356+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:12.364 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:12.356+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:12.484 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:12.477+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:12.624 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:12.617+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:12.752 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:12.745+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:13.030 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:13.023+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:13.338 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:13.332+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:13.359 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:13.351+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:13.394 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:13.387+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:13.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:13.508+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:13.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:13.580+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:13.761 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:13.754+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:14.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:14.074+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:14.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:14.318+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:14.351 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:14.340+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:14.364 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:14.357+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:14.506 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:14.498+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:14.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:14.580+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:14.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:14.787+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:15.051 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:15.044+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:15.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:15.285+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:15.310 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:15.302+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:15.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:15.329+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:15.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:15.539+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:15.557 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:15.542+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:15.782 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:15.774+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:16.012 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:16.004+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:16.308 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:16.302+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:16.318 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:16.312+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:16.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:16.349+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:16.532 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:16.526+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:16.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:16.581+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:16.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:16.737+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:17.027 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:17.020+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:17.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:17.270+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:17.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:17.279+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:17.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:17.401+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:17.522 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:17.515+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:17.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:17.548+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:17.770 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:17.763+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:18.042 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:18.034+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:18.255 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:18.246+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:18.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:18.310+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:18.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:18.405+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:18.490 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:18.483+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:18.582 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:18.574+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:18.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:18.729+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:19.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:19.064+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:19.297 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:19.289+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:19.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:19.297+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:19.370 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:19.362+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:19.503 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:19.495+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:19.609 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:19.601+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:19.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:19.724+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:20.103 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:20.096+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:20.254 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:20.247+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:20.300 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:20.292+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:20.334 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:20.327+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:20.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:20.461+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:20.614 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:20.608+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:20.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:20.682+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:21.151 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:21.137+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:21.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:21.221+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:21.318 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:21.311+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:21.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:21.337+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:21.484 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:21.478+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:21.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:21.627+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:21.702 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:21.695+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:22.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:22.151+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:22.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:22.252+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:22.299 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:22.291+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:22.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:22.369+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:22.518 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:22.512+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:22.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:22.663+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:22.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:22.737+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:23.168 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:23.160+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:23.285 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:23.277+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:23.333 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:23.326+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:23.350 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:23.342+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:23.486 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:23.478+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:23.643 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:23.635+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:23.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:23.776+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:24.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:24.142+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:24.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:24.297+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:24.319 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:24.311+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:24.333 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:24.327+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:24.449 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:24.442+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:24.641 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:24.634+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:24.760 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:24.752+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:25.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:25.100+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:25.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:25.310+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:25.338 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:25.330+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:25.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:25.331+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:25.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:25.486+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:25.619 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:25.612+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:25.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:25.776+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:26.143 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:26.137+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:26.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:26.283+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:26.366 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:26.359+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:26.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:26.375+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:26.483 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:26.475+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:26.611 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:26.604+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:26.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:26.773+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:27.148 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:27.140+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:27.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:27.327+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:27.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:27.336+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:27.345 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:27.338+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:27.450 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:27.442+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:27.591 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:27.582+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:27.828 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:27.820+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:28.115 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:28.107+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:28.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:28.328+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:28.336 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:28.329+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:28.340 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:28.333+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:28.470 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:28.464+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:28.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:28.616+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:28.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:28.862+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:29.127 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:29.120+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:29.304 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:29.295+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:29.364 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:29.357+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:29.375 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:29.367+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:29.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:29.463+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:29.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:29.653+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:29.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:29.854+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:30.102 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:30.095+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:30.288 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:30.281+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:30.330 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:30.324+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:30.340 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:30.330+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:30.459 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:30.452+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:30.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:30.630+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:30.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:30.827+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:31.072 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:31.064+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:31.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:31.288+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:31.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:31.292+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:31.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:31.308+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:31.496 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:31.488+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:31.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:31.642+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:31.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:31.799+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:32.079 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:32.071+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:32.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:32.269+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:31:32.287 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:32.280+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:32.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:32.312+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:32.461 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:31:32.454+0000 1694c700 -1 osd.3 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.859401+0000 front 2019-11-29T19:30:13.162014+0000 (oldest deadline 2019-11-29T19:30:58.716553+0000) 2019-11-29T19:31:32.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:31:32.630+0000 1694c700 -1 osd.2 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:12.626408+0000 front 2019-11-29T19:30:12.491000+0000 (oldest deadline 2019-11-29T19:30:58.346018+0000) 2019-11-29T19:31:32.800 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:31:32.792+0000 1694c700 -1 osd.6 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.530486+0000 front 2019-11-29T19:30:17.637130+0000 (oldest deadline 2019-11-29T19:31:02.802440+0000) 2019-11-29T19:31:33.049 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:31:33.040+0000 1694c700 -1 osd.4 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:15.059045+0000 front 2019-11-29T19:30:15.122452+0000 (oldest deadline 2019-11-29T19:31:00.333531+0000) 2019-11-29T19:31:33.267 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:31:33.260+0000 1694c700 -1 osd.1 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.113446+0000 front 2019-11-29T19:30:17.369324+0000 (oldest deadline 2019-11-29T19:31:01.087960+0000) 2019-11-29T19:31:33.283 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:31:33.274+0000 1694c700 -1 osd.7 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:17.583331+0000 front 2019-11-29T19:30:17.573356+0000 (oldest deadline 2019-11-29T19:31:00.419130+0000) 2019-11-29T19:31:33.287 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:31:33.276+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e764 v764) 2019-11-29T19:31:33.290 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:31:33.282+0000 1694c700 -1 osd.5 764 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:30:16.582273+0000 front 2019-11-29T19:30:16.446292+0000 (oldest deadline 2019-11-29T19:30:58.651885+0000) 2019-11-29T19:32:07.450 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:07.430+0000 124ad700 -1 osd.1 769 build_incremental_map_msg missing incremental map 768 2019-11-29T19:32:31.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:31.518+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:32.488 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:32.481+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:32.501 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:32.494+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:33.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:33.029+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:33.456 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:33.449+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:33.460 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:33.452+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:33.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:33.513+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:33.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:33.792+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:34.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:34.009+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:34.424 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:34.418+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:34.438 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:34.430+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:34.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:34.480+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:34.564 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:34.557+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:34.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:34.837+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:35.041 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:35.033+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:35.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:35.389+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:35.453 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:35.444+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:35.514 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:35.499+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:35.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:35.609+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:35.835 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:35.829+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:36.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:36.082+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:36.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:36.383+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:36.419 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:36.413+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:36.474 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:36.467+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:36.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:36.514+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:36.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:36.639+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:36.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:36.845+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:37.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:37.047+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:37.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:37.350+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:37.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:37.437+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:37.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:37.483+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:37.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:37.513+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:37.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:37.647+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:37.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:37.896+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:38.079 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:38.072+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:38.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:38.329+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:38.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:38.424+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:38.468 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:38.461+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:38.477 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:38.470+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:38.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:38.671+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:38.931 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:38.925+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:39.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:39.059+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:39.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:39.334+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:39.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:39.452+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:39.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:39.457+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:39.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:39.513+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:39.730 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:39.724+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:39.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:39.897+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:40.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:40.048+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:40.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:40.308+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:40.439 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:40.432+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:40.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:40.503+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:40.526 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:40.520+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:40.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:40.683+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:40.864 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:40.857+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:41.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:41.100+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:41.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:41.295+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:41.411 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:41.405+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:41.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:41.502+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:41.580 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:41.574+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:41.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:41.676+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:41.931 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:41.911+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:42.063 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:42.056+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:42.315 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:42.308+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:42.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:42.444+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:42.538 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:42.531+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:42.566 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:42.559+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:42.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:42.663+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:42.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:42.977+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:43.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:43.036+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:43.303 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:43.294+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:43.451 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:43.445+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:43.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:43.549+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:43.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:43.594+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:43.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:43.697+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:44.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:44.027+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:44.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:44.054+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:44.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:44.338+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:44.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:44.340+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:44.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:44.489+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:44.600 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:44.592+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:44.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:44.613+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:44.707 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:44.701+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:45.024 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:45.017+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:45.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:45.106+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:45.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:45.328+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:45.336 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:45.329+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:45.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:45.487+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:45.592 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:45.585+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:45.657 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:45.649+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:45.682 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:45.675+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:45.986 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:45.979+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:46.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:46.131+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:46.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:46.355+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:46.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:46.359+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:46.506 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:46.499+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:46.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:46.613+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:46.646 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:46.639+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:46.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:46.654+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:46.979 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:46.972+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:47.164 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:47.157+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:47.324 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:47.316+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:47.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:47.318+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:47.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:47.488+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:47.618 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:47.611+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:47.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:47.623+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:47.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:47.647+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:47.995 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:47.988+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:48.146 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:48.138+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:48.340 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:48.333+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:48.343 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:48.336+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:48.517 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:48.510+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:48.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:48.593+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:48.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:48.609+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:48.656 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:48.649+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:48.996 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:48.989+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:49.101 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:49.094+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:49.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:49.313+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:49.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:49.314+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:49.488 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:49.482+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:49.591 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:49.584+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:49.597 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:49.589+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:49.616 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:49.609+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:49.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:49.948+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:50.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:50.058+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:50.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:50.289+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:50.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:50.290+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:50.485 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:50.478+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:50.568 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:50.561+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:50.578 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:50.570+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:50.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:50.572+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:50.954 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:50.947+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:51.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:51.038+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:51.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:51.280+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:51.288 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:51.283+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:51.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:51.483+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:51.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:51.518+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:51.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:51.527+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:51.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:51.535+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:51.976 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:51.969+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:52.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:52.027+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:52.279 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:52.268+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:52.281 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:52.271+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:52.455 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:52.449+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:52.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:52.505+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:52.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:52.523+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:52.534 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:52.528+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:52.966 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:52.959+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:52.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:52.981+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:53.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:53.266+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:53.273 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:53.267+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:53.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:53.490+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:53.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:53.493+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:53.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:53.494+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:53.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:53.559+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:53.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:53.918+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:53.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:53.992+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:54.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:54.283+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:54.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:54.285+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:54.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:54.507+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:54.527 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:54.521+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:54.548 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:54.542+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:54.589 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:54.582+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:54.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:54.891+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:54.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:54.963+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:55.271 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:55.263+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:55.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:55.265+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:55.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:55.527+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:55.536 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:55.529+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:55.548 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:55.541+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:55.573 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:55.558+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:55.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:55.917+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:56.014 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:56.007+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:56.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:56.279+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:56.286 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:56.281+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:56.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:56.486+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:56.543 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:56.535+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:56.571 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:56.561+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:56.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:56.550+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:56.943 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:56.936+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:56.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:56.981+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:57.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:57.252+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:57.259 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:57.253+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:57.499 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:57.492+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:57.501 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:57.493+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:57.539 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:57.525+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:57.593 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:57.586+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:57.935 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:57.929+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:57.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:57.946+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:58.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:58.278+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:58.295 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:58.279+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:58.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:58.528+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:58.540 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:58.530+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:58.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:58.528+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:58.638 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:58.632+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:58.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:58.935+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:59.006 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:58.999+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:32:59.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:59.323+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:32:59.330 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:32:59.324+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:32:59.499 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:32:59.492+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:32:59.540 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:32:59.533+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:32:59.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:32:59.563+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:32:59.669 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:32:59.663+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:32:59.909 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:32:59.903+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:32:59.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:32:59.970+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:00.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:00.304+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:00.313 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:00.307+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:00.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:00.512+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:00.522 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:00.515+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:00.570 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:00.563+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:00.664 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:00.657+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:00.900 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:00.893+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:01.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:01.020+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:01.328 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:01.320+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:01.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:01.322+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:01.558 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:01.552+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:01.559 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:01.553+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:01.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:01.554+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:01.702 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:01.695+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:01.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:01.888+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:02.032 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:02.025+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:02.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:02.357+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:02.366 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:02.359+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:02.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:02.532+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:02.550 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:02.540+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:02.570 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:02.562+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:02.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:02.701+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:02.948 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:02.939+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:03.009 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:03.002+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:03.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:03.377+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:03.387 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:03.382+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:03.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:03.490+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:03.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:03.509+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:03.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:03.596+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:03.635 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:33:03.627+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e770 v770) 2019-11-29T19:33:03.685 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:03.677+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:03.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:03.896+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:03.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:03.964+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:04.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:04.428+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:04.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:04.429+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:04.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:04.471+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:04.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:04.527+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:04.600 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:04.592+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:04.658 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:04.650+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:04.903 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:04.896+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:04.998 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:04.991+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:05.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:05.413+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:05.422 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:05.416+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:05.513 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:05.504+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:05.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:05.522+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:05.640 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:05.632+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:05.650 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:05.642+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:05.914 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:05.906+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:06.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:06.018+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:06.398 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:06.392+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:06.399 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:06.393+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:06.565 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:06.558+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:06.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:06.570+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:06.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:06.622+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:06.632 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:06.624+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:06.891 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:06.883+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:07.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:07.052+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:07.410 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:07.403+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:07.411 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:07.404+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:07.606 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:07.599+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:07.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:07.602+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:07.612 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:07.604+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:07.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:07.614+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:07.893 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:07.885+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:08.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:08.078+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:08.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:08.357+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:08.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:08.361+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:08.579 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:08.571+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:08.594 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:08.586+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:08.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:08.618+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:08.651 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:33:08.645+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e770 v770) 2019-11-29T19:33:08.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:08.649+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:08.926 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:08.917+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:09.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:09.074+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:09.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:09.410+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:09.420 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:09.413+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:09.568 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:09.559+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:09.581 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:09.567+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:09.651 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:09.642+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:09.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:09.683+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:09.950 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:09.942+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:10.117 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:10.095+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:10.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:10.419+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:10.428 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:10.422+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:10.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:10.579+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:10.618 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:10.610+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:10.652 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:10.644+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:10.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:10.678+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:10.989 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:10.981+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:11.150 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:11.137+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:11.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:11.471+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:11.478 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:11.473+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:11.628 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:11.622+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:11.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:11.662+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:11.694 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:11.687+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:11.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:11.716+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:12.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:12.030+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:12.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:12.141+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:12.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:12.509+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:12.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:12.511+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:12.658 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:12.648+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:12.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:12.667+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:12.673 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:12.660+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:12.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:12.680+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:13.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:13.081+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:13.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:13.123+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:13.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:13.467+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:13.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:13.470+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:13.628 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:13.621+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:13.675 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:13.669+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:13.677 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:33:13.669+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e770 v770) 2019-11-29T19:33:13.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:13.687+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:13.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:13.704+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:14.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:14.039+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:14.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:14.125+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:14.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:14.502+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:14.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:14.507+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:14.664 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:14.657+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:14.667 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:14.660+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:14.670 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:14.663+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:14.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:14.712+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:15.022 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:15.016+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:15.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:15.171+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:15.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:15.541+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:15.549 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:15.543+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:15.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:15.638+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:15.679 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:15.671+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:15.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:15.693+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:15.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:15.762+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:16.061 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:16.055+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:16.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:16.203+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:16.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:16.569+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:16.591 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:16.578+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:16.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:16.671+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:16.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:16.677+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:16.693 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:16.687+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:16.771 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:16.764+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:17.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:17.031+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:17.253 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:17.247+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:17.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:17.570+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:17.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:17.573+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:17.681 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:17.664+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:17.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:17.689+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:17.700 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:17.692+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:17.733 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:17.724+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:18.019 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:18.012+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:18.305 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:33:18.297+0000 1694c700 -1 osd.1 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.223398+0000 front 2019-11-29T19:31:48.057963+0000 (oldest deadline 2019-11-29T19:32:32.733942+0000) 2019-11-29T19:33:18.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:18.554+0000 1694c700 -1 osd.0 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:32:03.757617+0000 (oldest deadline 2019-11-29T19:32:43.757617+0000) 2019-11-29T19:33:18.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:18.555+0000 1694c700 -1 osd.0 770 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:18.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:33:18.678+0000 1694c700 -1 osd.5 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:49.690697+0000 front 2019-11-29T19:31:49.761965+0000 (oldest deadline 2019-11-29T19:32:31.872557+0000) 2019-11-29T19:33:18.708 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:18.700+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:33:18.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:33:18.711+0000 1694c700 -1 osd.6 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.327541+0000 front 2019-11-29T19:31:48.414464+0000 (oldest deadline 2019-11-29T19:32:34.218853+0000) 2019-11-29T19:33:18.748 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:33:18.741+0000 1694c700 -1 osd.2 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:50.167040+0000 front 2019-11-29T19:31:50.218185+0000 (oldest deadline 2019-11-29T19:32:32.459002+0000) 2019-11-29T19:33:18.781 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:33:18.762+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e770 v770) 2019-11-29T19:33:19.026 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:33:19.020+0000 1694c700 -1 osd.7 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:51.298568+0000 front 2019-11-29T19:31:51.294063+0000 (oldest deadline 2019-11-29T19:32:33.480349+0000) 2019-11-29T19:33:19.695 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:33:19.665+0000 1694c700 -1 osd.0 771 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e768) 2019-11-29T19:33:19.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:33:19.690+0000 1694c700 -1 osd.4 770 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:31:48.792339+0000 front 2019-11-29T19:31:48.562851+0000 (oldest deadline 2019-11-29T19:32:30.754413+0000) 2019-11-29T19:34:04.103 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:18:12.231 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.103 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:18:12.238 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.121 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:18:12.301 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.125 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:18:12.304 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.125 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:18:12.306 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.133 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:18:12.313 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.309 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:18:12.444 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.363 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:18:12.543 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:04.450 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:18:12.628 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:34:43.810 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:43.803+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:43.941 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:43.934+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:44.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:44.092+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:44.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:44.775+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:44.991 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:44.983+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:45.153 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:45.146+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:45.545 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:45.535+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:45.794 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:45.787+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:45.963 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:45.955+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:46.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:46.197+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:46.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:46.515+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:46.827 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:46.820+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:46.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:46.923+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:46.937 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:46.928+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:47.256 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:47.250+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:47.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:47.522+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:47.797 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:47.790+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:47.916 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:47.910+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:47.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:47.969+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:48.269 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:48.257+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:48.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:48.520+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:48.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:48.712+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:48.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:48.780+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:48.884 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:48.877+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:48.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:48.979+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:49.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:49.185+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:49.282 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:49.274+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:49.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:49.491+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:49.689 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:49.681+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:49.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:49.776+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:49.916 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:49.909+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:49.969 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:49.962+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:50.222 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:50.216+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:50.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:50.237+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:50.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:50.503+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:50.698 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:50.691+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:50.797 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:50.790+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:50.908 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:50.901+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:51.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:51.007+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:51.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:51.198+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:51.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:51.205+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:51.528 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:51.520+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:51.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:51.651+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:51.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:51.798+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:51.889 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:51.882+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:51.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:51.981+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:52.188 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:52.181+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:52.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:52.224+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:52.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:52.546+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:52.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:52.617+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:52.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:52.820+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:52.894 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:52.886+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:53.004 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:52.998+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:53.177 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:53.170+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:53.229 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:53.222+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:53.598 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:53.590+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:53.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:53.617+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:53.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:53.861+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:53.873 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:53.866+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:54.059 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:54.051+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:54.161 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:54.153+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:54.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:54.237+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:54.652 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:54.644+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:54.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:54.653+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:54.865 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:54.859+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:54.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:54.906+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:55.023 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:55.015+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:55.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:55.128+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:55.269 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:55.262+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:55.674 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:55.667+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:55.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:55.673+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:55.913 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:55.905+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:55.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:55.916+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:56.035 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:56.027+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:56.151 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:56.143+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:56.226 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:56.219+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:56.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:56.680+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:56.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:56.694+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:56.959 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:56.951+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:56.965 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:56.958+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:57.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:57.038+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:57.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:57.124+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:57.255 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:57.248+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:57.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:57.664+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:57.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:57.670+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:57.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:57.922+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:57.998 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:57.992+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:58.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:58.004+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:58.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:58.163+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:58.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:58.242+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:58.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:58.672+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:58.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:58.686+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:58.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:34:58.971+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:34:58.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:58.985+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:34:59.042 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:34:59.035+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:34:59.155 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:34:59.146+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:34:59.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:34:59.213+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:34:59.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:34:59.654+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:34:59.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:34:59.707+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:34:59.991 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:34:59.984+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:00.014 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:00.007+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:00.064 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:00.058+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:00.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:00.121+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:00.259 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:00.251+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:00.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:00.617+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:00.733 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:00.717+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:01.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:01.005+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:01.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:01.055+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:01.092 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:01.085+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:01.092 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:01.084+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:01.224 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:01.217+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:01.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:01.631+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:01.695 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:01.688+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:02.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:02.015+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:02.052 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:02.044+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:02.098 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:02.089+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:02.144 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:02.136+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:02.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:02.178+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:02.688 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:02.680+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:02.699 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:02.691+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:03.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:03.039+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:03.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:03.064+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:03.110 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:03.102+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:03.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:03.172+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:03.227 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:03.221+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:03.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:03.647+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:03.732 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:03.725+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:04.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:04.056+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:04.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:04.060+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:04.089 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:04.081+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:04.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:04.150+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:04.204 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:04.197+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:04.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:04.606+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:04.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:04.710+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:05.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:05.096+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:05.120 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:05.112+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:05.125 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:05.117+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:05.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:05.150+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:05.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:05.201+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:05.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:05.587+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:05.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:05.708+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:06.096 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:06.088+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:06.116 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:06.109+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:06.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:06.119+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:06.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:06.131+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:06.173 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:06.166+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:06.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:06.626+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:06.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:06.714+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:07.100 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:07.091+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:07.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:07.114+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:07.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:07.158+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:07.169 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:07.160+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:07.195 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:07.187+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:07.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:07.585+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:07.711 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:07.697+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:08.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:08.119+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:08.127 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:08.119+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:08.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:08.138+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:08.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:08.158+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:08.196 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:08.188+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:08.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:08.569+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:08.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:08.712+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:09.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:09.073+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:09.153 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:09.145+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:09.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:09.151+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:09.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:09.158+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:09.185 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:09.169+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:09.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:09.533+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:09.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:09.684+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:10.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:10.114+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:10.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:10.135+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:10.152 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:10.144+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:10.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:10.180+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:10.194 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:10.187+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:10.557 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:10.542+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:10.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:10.698+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:11.095 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:11.085+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:11.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:11.135+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:11.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:11.136+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:11.225 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:11.212+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:11.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:11.202+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:11.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:11.594+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:11.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:11.704+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:12.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:12.104+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:12.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:12.107+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:12.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:12.177+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:12.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:12.184+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:12.237 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:12.229+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:12.602 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:12.595+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:12.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:12.749+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:13.082 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:13.074+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:13.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:13.120+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:13.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:13.160+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:13.233 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:13.214+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:13.233 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:13.222+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:13.577 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:13.569+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:13.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:13.778+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:14.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:14.048+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:14.117 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:35:14.111+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e777 v777) 2019-11-29T19:35:14.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:14.110+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:14.171 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:14.163+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:14.177 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:14.169+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:14.192 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:14.182+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:14.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:14.540+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:14.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:14.753+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:15.011 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:15.004+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:15.163 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:15.151+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:15.189 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:15.182+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:15.212 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:15.202+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:15.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:15.204+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:15.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:15.552+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:15.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:15.738+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:16.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:16.047+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:16.147 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:16.124+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:16.168 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:16.160+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:16.196 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:16.186+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:16.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:16.208+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:16.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:16.538+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:16.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:16.777+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:17.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:17.041+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:17.128 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:17.117+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:17.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:17.121+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:17.203 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:17.193+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:17.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:17.243+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:17.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:17.592+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:17.786 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:17.772+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:18.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:18.054+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:18.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:18.090+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:18.149 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:18.142+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:18.209 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:18.202+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:18.287 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:35:18.279+0000 1694c700 -1 osd.5 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.218156+0000 front 2019-11-29T19:34:00.303571+0000 (oldest deadline 2019-11-29T19:34:43.562153+0000) 2019-11-29T19:35:18.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:18.567+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:18.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:18.737+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:35:19.067 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:35:19.058+0000 1694c700 -1 osd.6 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:00.416923+0000 front 2019-11-29T19:34:00.425316+0000 (oldest deadline 2019-11-29T19:34:45.927304+0000) 2019-11-29T19:35:19.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:35:19.082+0000 1694c700 -1 osd.2 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:59.854996+0000 front 2019-11-29T19:33:59.874163+0000 (oldest deadline 2019-11-29T19:34:43.311774+0000) 2019-11-29T19:35:19.105 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:35:19.099+0000 1694c700 -1 osd.1 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.943083+0000 front 2019-11-29T19:34:02.954135+0000 (oldest deadline 2019-11-29T19:34:48.212523+0000) 2019-11-29T19:35:19.190 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:35:19.180+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 43sec e777 v777) 2019-11-29T19:35:19.235 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:35:19.226+0000 1694c700 -1 osd.3 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:01.818741+0000 front 2019-11-29T19:34:01.917437+0000 (oldest deadline 2019-11-29T19:34:43.455519+0000) 2019-11-29T19:35:19.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:35:19.547+0000 1694c700 -1 osd.7 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:33:58.965081+0000 front 2019-11-29T19:33:58.982002+0000 (oldest deadline 2019-11-29T19:34:44.828488+0000) 2019-11-29T19:35:19.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:35:19.728+0000 1694c700 -1 osd.4 777 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:34:02.419755+0000 front 2019-11-29T19:34:02.339304+0000 (oldest deadline 2019-11-29T19:34:48.201635+0000) 2019-11-29T19:36:17.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:17.300+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:17.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:17.728+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:18.172 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:18.165+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:18.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:18.182+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:18.291 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:18.284+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:18.724 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:18.717+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:19.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:19.171+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:19.201 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:19.194+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:19.288 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:19.282+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:19.776 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:19.769+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:20.053 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:20.043+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:20.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:20.147+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:20.220 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:20.211+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:20.311 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:20.304+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:20.732 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:20.727+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:20.795 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:20.788+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:21.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:21.009+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:21.136 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:21.130+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:21.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:21.249+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:21.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:21.263+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:21.745 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:21.738+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:21.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:21.756+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:21.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:21.975+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:22.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:22.132+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:22.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:22.204+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:22.261 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:22.254+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:22.749 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:22.739+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:22.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:22.741+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:22.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:22.934+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:23.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:23.176+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:23.211 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:23.204+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:23.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:23.243+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:23.258 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:23.252+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:23.746 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:23.740+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:23.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:23.791+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:23.982 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:23.972+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:24.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:24.181+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:24.216 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:24.209+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:24.237 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:24.230+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:24.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:24.246+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:24.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:24.763+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:24.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:24.805+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:24.858 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:20:32.987 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:24.863 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:20:32.998 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:24.923 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:20:33.103 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:24.926 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:20:33.106 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:24.950 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:20:33.129 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:24.956 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:20:33.136 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:25.003 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:24.996+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:25.050 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:20:33.185 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:25.093 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:20:33.273 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:25.145 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:25.134+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:25.145 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:20:33.316 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:36:25.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:25.256+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:25.281 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:25.275+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:25.296 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:25.291+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:25.812 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:25.806+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:25.858 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:25.851+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:25.965 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:25.958+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:26.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:26.122+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:26.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:26.253+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:26.275 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:26.262+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:26.327 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:26.321+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:26.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:26.830+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:26.851 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:26.845+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:26.953 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:26.946+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:27.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:27.138+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:27.222 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:27.216+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:27.238 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:27.231+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:27.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:27.279+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:27.792 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:27.785+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:27.875 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:27.868+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:27.875 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:27.869+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:27.954 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:27.946+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:28.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:28.145+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:28.214 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:28.203+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:28.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:28.258+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:28.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:28.298+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:28.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:28.779+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:28.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:28.891+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:28.898 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:28.893+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:28.981 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:28.974+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:29.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:29.135+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:29.190 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:29.184+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:29.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:29.287+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:29.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:29.309+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:29.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:29.754+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:29.900 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:29.892+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:29.902 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:29.894+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:29.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:29.955+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:30.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:30.151+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:30.230 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:30.223+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:30.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:30.312+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:30.337 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:30.330+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:30.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:30.743+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:30.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:30.922+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:30.930 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:30.925+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:31.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:31.006+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:31.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:31.153+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:31.188 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:31.181+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:31.319 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:31.310+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:31.326 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:31.320+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:31.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:31.754+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:31.966 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:31.959+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:31.967 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:31.961+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:32.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:32.003+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:32.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:32.134+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:32.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:32.136+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:32.306 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:32.300+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:32.340 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:32.334+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:32.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:32.757+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:32.992 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:32.986+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:32.993 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:32.987+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:32.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:32.991+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:33.110 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:33.100+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:33.136 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:33.129+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:33.345 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:33.339+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:33.353 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:33.347+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:33.734 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:33.726+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:34.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:34.032+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:34.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:34.032+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:34.041 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:34.033+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:34.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:34.085+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:34.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:34.110+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:34.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:34.321+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:34.331 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:34.325+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:34.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:34.749+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:34.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:34.990+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:35.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:35.022+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:35.033 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:35.023+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:35.122 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:35.115+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:35.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:35.148+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:35.327 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:35.320+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:35.374 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:35.366+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:35.730 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:35.722+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:35.954 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:35.947+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:35.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:35.979+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:35.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:35.980+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:36.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:36.105+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:36.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:36.149+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:36.331 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:36.324+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:36.412 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:36.406+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:36.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:36.687+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:36.985 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:36.978+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:36.986 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:36.978+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:36.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:36.983+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:37.094 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:37.087+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:37.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:37.179+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:37.302 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:37.295+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:37.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:37.446+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:37.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:37.709+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:37.950 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:37.942+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:38.022 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:38.012+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:38.023 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:38.014+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:38.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:38.067+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:38.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:38.231+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:38.325 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:38.319+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:38.499 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:38.493+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:38.740 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:38.733+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:38.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:38.950+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:39.011 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:39.004+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:39.013 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:39.005+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:39.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:39.043+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:39.271 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:39.264+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:39.307 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:39.300+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:39.520 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:39.514+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:39.778 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:39.771+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:39.946 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:39.941+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:39.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:39.976+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:39.984 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:39.978+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:40.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:40.028+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:40.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:40.219+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:40.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:40.274+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:40.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:40.528+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:40.757 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:40.751+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:40.957 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:40.949+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:40.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:40.963+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:40.970 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:40.964+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:41.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:41.056+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:41.188 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:41.181+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:41.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:41.259+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:41.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:41.541+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:41.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:41.778+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:41.961 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:41.944+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:41.961 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:41.946+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:42.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:42.001+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:42.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:42.097+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:42.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:42.209+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:42.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:42.252+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:42.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:42.526+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:42.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:42.792+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:42.967 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:42.961+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:42.969 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:42.964+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:43.000 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:42.993+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:43.150 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:43.143+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:43.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:43.234+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:43.267 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:43.261+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:43.523 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:43.514+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:43.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:43.812+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:43.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:43.955+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:44.013 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:44.007+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:44.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:44.008+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:44.152 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:44.145+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:44.196 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:44.189+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:44.295 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:44.286+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:44.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:44.568+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:44.786 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:44.780+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:44.998 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:44.992+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:45.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:45.007+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:45.014 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:45.009+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:45.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:45.169+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:45.226 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:45.219+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:45.275 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:45.263+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:45.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:45.526+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:45.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:45.753+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:45.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:45.992+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:46.000 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:45.994+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:46.025 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:46.016+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:46.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:46.136+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:46.266 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:46.260+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:46.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:46.272+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:46.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:46.552+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:46.744 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:46.738+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:46.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:46.976+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:46.990 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:46.982+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:46.991 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:46.985+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:47.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:47.148+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:47.316 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:47.308+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:47.324 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:47.315+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:47.536 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:47.524+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:47.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:47.777+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:47.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:47.948+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:48.020 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:48.013+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:48.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:48.015+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:48.134 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:48.126+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:48.324 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:48.318+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:48.329 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:48.322+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:48.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:48.508+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:48.811 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:48.804+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:48.980 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:48.973+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:48.981 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:48.975+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:49.005 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:48.998+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:49.167 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:49.159+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:49.318 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:49.311+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:49.373 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:49.364+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:49.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:49.530+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:49.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:49.778+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:49.872 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:36:49.861+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e785 v785) 2019-11-29T19:36:49.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:49.969+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:49.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:49.971+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:49.977 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:49.966+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:50.135 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:50.127+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:50.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:50.275+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:50.375 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:50.367+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:50.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:50.509+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:50.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:50.791+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:50.929 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:50.921+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:50.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:50.946+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:50.954 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:50.948+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:51.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:51.178+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:51.327 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:51.309+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:51.431 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:51.423+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:51.546 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:51.532+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:51.764 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:51.756+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:51.922 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:51.914+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:51.968 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:51.960+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:51.973 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:51.964+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:52.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:52.182+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:52.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:52.302+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:52.414 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:52.406+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:52.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:52.505+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:52.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:52.755+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:52.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:52.941+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:52.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:52.943+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:52.972 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:52.965+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:53.173 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:53.166+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:53.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:53.349+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:53.411 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:53.402+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:53.521 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:53.513+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:53.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:53.734+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:53.983 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:53.976+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:53.986 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:53.980+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:54.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:54.003+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:54.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:54.197+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:54.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:54.401+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:54.453 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:54.445+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:54.540 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:54.530+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:54.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:54.731+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:54.887 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:36:54.878+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e785 v785) 2019-11-29T19:36:54.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:54.992+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:54.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:54.993+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:55.019 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:55.011+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:55.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:55.199+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:55.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:55.398+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:55.497 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:55.488+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:55.586 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:55.578+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:55.727 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:55.720+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:55.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:55.969+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:55.977 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:55.970+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:56.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:56.054+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:56.174 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:56.166+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:56.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:56.377+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:56.463 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:56.456+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:56.543 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:56.534+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:56.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:56.726+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:56.955 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:56.948+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:56.957 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:56.952+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:57.092 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:57.084+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:57.195 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:57.181+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:57.372 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:57.362+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:57.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:57.438+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:57.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:57.492+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:57.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:57.730+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:57.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:57.919+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:57.927 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:57.921+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:58.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:58.126+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:58.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:58.146+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:58.352 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:58.344+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:58.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:58.432+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:58.547 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:58.540+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:58.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:58.695+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:58.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:58.890+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:58.897 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:58.891+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:59.124 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:36:59.117+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:36:59.176 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:36:59.168+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:36:59.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:36:59.373+0000 1694c700 -1 osd.2 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.602437+0000 front 2019-11-29T19:35:36.663013+0000 (oldest deadline 2019-11-29T19:36:22.395588+0000) 2019-11-29T19:36:59.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:36:59.416+0000 1694c700 -1 osd.5 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:35.921440+0000 front 2019-11-29T19:35:35.765244+0000 (oldest deadline 2019-11-29T19:36:17.986670+0000) 2019-11-29T19:36:59.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:36:59.494+0000 1694c700 -1 osd.4 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.869181+0000 front 2019-11-29T19:35:31.879973+0000 (oldest deadline 2019-11-29T19:36:17.144065+0000) 2019-11-29T19:36:59.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:36:59.734+0000 1694c700 -1 osd.1 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:36.609046+0000 front 2019-11-29T19:35:36.544745+0000 (oldest deadline 2019-11-29T19:36:17.640840+0000) 2019-11-29T19:36:59.865 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:59.854+0000 1694c700 -1 osd.0 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:35:47.102551+0000 (oldest deadline 2019-11-29T19:36:27.102551+0000) 2019-11-29T19:36:59.865 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:36:59.855+0000 1694c700 -1 osd.0 785 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e782) 2019-11-29T19:36:59.958 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:36:59.951+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e785 v785) 2019-11-29T19:37:00.148 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:37:00.143+0000 1694c700 -1 osd.7 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:34.565423+0000 front 2019-11-29T19:35:33.838988+0000 (oldest deadline 2019-11-29T19:36:19.709910+0000) 2019-11-29T19:37:00.227 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:37:00.221+0000 1694c700 -1 osd.6 785 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:35:31.558108+0000 front 2019-11-29T19:35:31.551727+0000 (oldest deadline 2019-11-29T19:36:17.441249+0000) 2019-11-29T19:37:58.630 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:22:06.764 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.639 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:22:06.772 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.646 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:22:06.823 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.653 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:22:06.831 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.653 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:22:06.832 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.657 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:22:06.837 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.777 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:22:06.957 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.778 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:22:06.913 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:37:58.787 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:22:06.967 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:38:33.292 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:33.285+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:33.898 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:33.892+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:34.285 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:34.278+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:34.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:34.882+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:35.255 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:35.248+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:35.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:35.442+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:35.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:35.857+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:36.227 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:36.220+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:36.409 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:36.400+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:36.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:36.732+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:36.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:36.826+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:36.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:36.868+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:37.263 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:37.255+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:37.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:37.421+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:37.728 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:37.721+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:37.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:37.841+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:38.093 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:37.851+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:38.299 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:38.292+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:38.413 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:38.399+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:38.541 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:38.533+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:38.754 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:38.748+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:38.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:38.811+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:38.901 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:38.893+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:39.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:39.335+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:39.349 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:39.343+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:39.414 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:39.408+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:39.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:39.497+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:39.797 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:39.788+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:39.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:39.858+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:39.878 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:39.858+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:40.318 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:40.311+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:40.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:40.378+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:40.418 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:40.412+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:40.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:40.466+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:40.831 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:40.823+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:40.839 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:40.831+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:40.921 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:40.914+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:41.291 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:41.283+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:41.349 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:41.341+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:41.440 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:41.432+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:41.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:41.513+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:41.827 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:41.821+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:41.863 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:41.856+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:41.940 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:41.927+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:42.310 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:42.302+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:42.332 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:42.323+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:42.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:42.428+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:42.531 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:42.524+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:42.879 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:42.872+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:42.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:42.888+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:42.958 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:42.952+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:43.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:43.285+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:43.380 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:43.372+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:43.399 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:43.393+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:43.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:43.485+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:43.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:43.851+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:43.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:43.907+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:44.010 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:44.003+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:44.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:44.306+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:44.386 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:44.379+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:44.443 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:44.435+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:44.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:44.489+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:44.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:44.899+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:44.950 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:44.942+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:45.057 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:45.049+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:45.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:45.270+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:45.344 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:45.338+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:45.404 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:45.396+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:45.454 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:45.447+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:45.919 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:45.912+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:46.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:45.993+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:46.093 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:46.086+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:46.253 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:46.245+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:46.330 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:46.323+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:46.417 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:46.410+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:46.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:46.484+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:46.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:46.870+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:46.882 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:46.876+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:46.991 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:46.984+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:47.128 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:47.121+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:47.269 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:47.260+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:47.368 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:47.360+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:47.478 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:47.462+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:47.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:47.529+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:47.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:47.899+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:47.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:47.904+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:47.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:47.950+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:48.179 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:48.156+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:48.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:48.218+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:48.393 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:48.387+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:48.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:48.430+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:48.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:48.599+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:48.924 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:48.916+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:48.925 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:48.918+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:48.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:48.967+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:49.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:49.201+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:49.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:49.263+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:49.406 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:49.396+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:49.466 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:49.460+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:49.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:49.617+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:49.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:49.902+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:49.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:49.904+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:49.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:49.941+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:50.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:50.211+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:50.243 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:50.236+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:50.389 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:50.383+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:50.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:50.451+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:50.672 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:50.665+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:50.933 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:50.926+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:50.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:50.936+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:50.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:50.941+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:51.184 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:51.177+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:51.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:51.277+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:51.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:51.429+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:51.501 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:51.495+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:51.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:51.683+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:51.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:51.901+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:51.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:51.938+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:51.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:51.941+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:52.185 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:52.175+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:52.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:52.236+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:52.435 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:52.424+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:52.489 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:52.480+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:52.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:52.720+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:52.898 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:52.892+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:52.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:52.977+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:52.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:52.981+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:53.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:53.196+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:53.210 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:53.203+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:53.461 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:53.453+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:53.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:53.492+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:53.775 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:53.768+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:53.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:53.912+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:53.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:53.942+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:53.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:53.944+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:54.223 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:54.215+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:54.234 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:54.227+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:54.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:54.455+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:54.490 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:54.482+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:54.798 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:54.792+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:54.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:54.893+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:54.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:54.944+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:54.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:54.947+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:55.198 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:55.191+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:55.204 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:55.197+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:55.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:55.479+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:55.525 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:55.517+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:55.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:55.844+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:55.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:55.906+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:55.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:55.978+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:55.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:55.981+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:56.173 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:56.165+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:56.208 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:56.201+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:56.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:56.485+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:56.559 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:56.549+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:56.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:56.861+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:56.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:56.869+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:56.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:56.979+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:56.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:56.982+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:57.187 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:57.180+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:57.210 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:57.203+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:57.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:57.462+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:57.514 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:57.507+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:57.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:57.848+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:57.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:57.904+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:57.984 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:57.970+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:57.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:57.972+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:58.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:58.151+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:58.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:58.191+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:58.435 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:58.420+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:58.481 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:58.474+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:58.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:58.867+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:58.900 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:58.890+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:59.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:59.002+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:59.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:59.006+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:38:59.124 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:38:59.117+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:38:59.196 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:38:59.189+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:38:59.436 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:38:59.429+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:38:59.471 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:38:59.464+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:38:59.863 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:38:59.855+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:38:59.946 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:38:59.938+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:38:59.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:59.965+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:38:59.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:38:59.971+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:00.140 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:00.132+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:00.235 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:00.228+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:00.439 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:00.429+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:00.487 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:00.481+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:00.848 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:00.840+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:00.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:00.926+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:00.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:00.988+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:00.999 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:00.993+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:01.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:01.106+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:01.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:01.238+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:01.396 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:01.388+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:01.488 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:01.479+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:01.888 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:01.881+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:01.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:01.956+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:02.047 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:02.038+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:02.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:02.041+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:02.095 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:02.087+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:02.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:02.204+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:02.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:02.422+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:02.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:02.527+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:02.920 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:02.911+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:03.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:02.994+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:03.029 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:03.022+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:03.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:03.026+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:03.075 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:03.067+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:03.219 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:03.211+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:03.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:03.453+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:03.551 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:03.537+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:03.946 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:03.938+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:03.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:03.954+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:04.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:04.027+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:04.040 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:04.031+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:04.063 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:04.056+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:04.186 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:04.177+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:04.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:04.470+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:04.577 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:04.562+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:04.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:04.910+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:04.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:04.978+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:05.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:05.018+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:05.027 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:05.021+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:05.093 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:05.085+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:05.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:05.137+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:05.498 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:39:05.487+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e791 v791) 2019-11-29T19:39:05.522 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:23:13.656 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.527 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:05.518+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:05.559 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:05.550+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:05.581 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:23:13.715 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.621 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:23:13.800 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.632 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:23:13.811 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.634 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:23:13.814 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.644 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:23:13.824 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.663 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:23:13.797 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.685 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:23:13.865 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.706 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:23:13.886 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:39:05.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:05.885+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:05.948 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:05.939+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:06.028 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:06.019+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:06.028 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:06.020+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:06.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:06.091+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:06.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:06.125+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:06.488 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:06.479+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:06.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:06.537+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:06.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:06.912+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:06.945 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:06.938+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:07.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:07.055+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:07.065 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:07.057+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:07.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:07.058+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:07.154 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:07.145+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:07.452 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:07.445+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:07.509 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:07.502+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:07.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:07.912+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:07.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:07.913+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:08.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:08.025+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:08.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:08.027+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:08.052 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:08.040+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:08.130 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:08.122+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:08.436 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:08.426+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:08.557 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:08.536+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:08.895 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:08.881+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:08.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:08.898+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:09.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:09.039+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:09.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:09.038+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:09.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:09.045+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:09.143 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:09.135+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:09.482 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:09.476+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:09.500 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:09.492+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:09.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:09.847+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:09.941 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:39:09.933+0000 1694c700 -1 osd.1 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.152249+0000 front 2019-11-29T19:37:51.116529+0000 (oldest deadline 2019-11-29T19:38:35.791504+0000) 2019-11-29T19:39:10.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:10.060+0000 1694c700 -1 osd.6 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.862293+0000 front 2019-11-29T19:37:51.049997+0000 (oldest deadline 2019-11-29T19:38:33.730717+0000) 2019-11-29T19:39:10.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:10.066+0000 1694c700 -1 osd.6 791 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:10.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:10.086+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:10.129 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:39:10.121+0000 1694c700 -1 osd.5 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.605454+0000 front 2019-11-29T19:37:52.603892+0000 (oldest deadline 2019-11-29T19:38:38.443243+0000) 2019-11-29T19:39:10.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:39:10.490+0000 1694c700 -1 osd.3 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.125678+0000 front 2019-11-29T19:37:50.193627+0000 (oldest deadline 2019-11-29T19:38:32.996914+0000) 2019-11-29T19:39:10.502 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:39:10.495+0000 1694c700 -1 osd.2 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:50.559587+0000 front 2019-11-29T19:37:50.551551+0000 (oldest deadline 2019-11-29T19:38:35.241823+0000) 2019-11-29T19:39:10.565 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:39:10.558+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e791 v791) 2019-11-29T19:39:10.831 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:39:10.824+0000 1694c700 -1 osd.7 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:52.313909+0000 front 2019-11-29T19:37:52.208354+0000 (oldest deadline 2019-11-29T19:38:38.035688+0000) 2019-11-29T19:39:11.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:39:11.091+0000 1694c700 -1 osd.4 791 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:37:51.257869+0000 front 2019-11-29T19:37:51.044905+0000 (oldest deadline 2019-11-29T19:38:36.323048+0000) 2019-11-29T19:39:11.193 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:11.182+0000 1694c700 -1 osd.6 792 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:12.341 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:39:12.274+0000 1694c700 -1 osd.6 793 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81625 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e791) 2019-11-29T19:39:42.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:42.425+0000 3778f700 -1 osd.0 796 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:42.734 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:42.728+0000 38f92700 -1 osd.0 796 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:43.031 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:42.978+0000 34789700 -1 osd.0 796 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:43.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:43.154+0000 124ad700 -1 osd.0 796 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:43.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:43.511+0000 38f92700 -1 osd.0 796 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:44.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:44.785+0000 33f88700 -1 osd.0 797 build_incremental_map_msg missing incremental map 796 2019-11-29T19:39:45.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:39:44.962+0000 32f86700 -1 osd.0 797 build_incremental_map_msg missing incremental map 796 2019-11-29T19:40:08.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:08.837+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:09.492 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:09.485+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:09.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:09.857+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:10.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:10.490+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:10.742 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:10.736+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:10.846 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:10.840+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:11.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:11.515+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:11.761 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:11.753+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:11.893 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:11.886+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:12.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:12.513+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:12.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:12.531+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:12.551 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:12.543+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:12.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:12.804+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:12.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:12.936+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:13.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:13.479+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:13.545 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:13.537+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:13.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:13.547+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:13.766 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:13.760+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:13.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:13.968+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:14.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:14.529+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:14.569 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:14.556+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:14.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:14.561+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:14.803 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:14.794+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:14.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:14.984+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:15.543 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:15.536+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:15.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:15.575+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:15.612 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:15.605+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:15.830 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:15.823+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:15.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:15.978+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:16.557 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:16.542+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:16.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:16.571+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:16.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:16.629+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:16.657 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:16.651+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:16.856 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:16.849+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:16.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:16.966+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:17.538 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:17.533+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:17.546 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:17.539+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:17.633 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:17.626+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:17.700 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:17.688+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:17.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:17.852+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:17.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:17.928+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:18.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:18.536+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:18.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:18.538+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:18.553 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:18.546+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:18.677 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:18.664+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:18.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:18.665+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:18.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:18.826+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:18.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:18.954+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:19.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:19.524+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:19.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:19.525+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:19.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:19.566+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:19.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:19.638+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:19.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:19.662+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:19.854 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:19.846+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:19.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:19.939+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:20.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:20.570+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:20.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:20.573+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:20.585 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:20.578+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:20.652 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:20.645+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:20.679 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:20.673+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:20.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:20.808+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:20.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:20.949+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:21.579 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:21.573+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:21.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:21.576+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:21.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:21.613+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:21.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:21.626+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:21.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:21.694+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:21.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:21.816+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:21.931 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:21.925+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:22.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:22.533+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:22.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:22.535+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:22.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:22.651+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:22.668 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:22.660+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:22.690 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:22.683+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:22.848 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:22.842+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:22.945 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:22.938+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:23.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:23.501+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:23.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:23.503+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:23.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:23.629+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:23.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:23.684+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:23.723 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:23.714+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:23.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:23.826+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:23.949 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:23.940+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:24.537 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:24.531+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:24.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:24.534+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:24.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:24.673+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:24.682 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:24.677+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:24.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:24.732+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:24.878 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:24.870+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:24.949 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:24.942+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:25.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:25.519+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:25.536 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:25.522+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:25.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:25.671+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:25.685 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:25.678+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:25.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:25.724+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:25.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:25.907+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:25.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:25.930+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:26.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:26.475+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:26.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:26.477+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:26.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:26.705+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:26.728 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:26.720+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:26.776 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:26.769+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:26.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:26.897+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:26.944 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:26.938+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:27.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:27.481+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:27.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:27.484+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:27.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:27.679+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:27.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:27.724+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:27.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:27.738+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:27.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:27.886+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:27.921 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:27.913+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:28.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:28.448+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:28.456 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:28.450+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:28.647 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:28.640+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:28.701 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:28.694+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:28.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:28.769+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:28.916 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:28.907+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:28.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:28.954+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:29.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:29.499+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:29.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:29.501+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:29.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:29.656+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:29.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:29.736+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:29.820 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:29.812+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:29.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:29.956+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:30.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:30.003+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:30.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:30.475+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:30.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:30.477+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:30.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:30.661+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:30.722 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:30.717+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:30.783 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:30.775+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:30.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:30.967+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:31.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:31.045+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:31.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:31.515+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:31.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:31.517+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:31.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:31.668+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:31.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:31.739+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:31.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:31.763+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:31.933 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:31.924+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:32.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:32.070+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:32.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:32.502+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:32.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:32.504+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:32.652 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:32.645+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:32.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:32.708+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:32.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:32.773+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:32.893 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:32.886+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:33.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:33.040+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:33.518 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:33.510+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:33.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:33.512+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:33.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:33.646+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:33.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:33.719+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:33.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:33.728+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:33.922 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:33.915+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:34.038 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:34.028+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:34.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:34.543+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:34.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:34.545+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:34.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:34.664+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:34.713 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:34.706+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:34.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:34.716+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:34.905 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:34.898+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:34.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:34.983+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:35.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:35.556+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:35.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:35.558+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:35.685 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:35.677+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:35.704 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:35.697+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:35.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:35.708+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:35.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:35.941+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:36.035 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:36.028+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:36.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:36.582+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:36.592 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:36.586+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:36.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:36.672+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:36.697 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:36.687+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:36.778 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:36.761+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:36.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:36.974+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:37.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:37.010+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:37.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:37.057+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:37.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:37.597+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:37.605 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:37.598+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:37.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:37.672+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:37.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:37.718+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:37.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:37.738+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:38.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:38.004+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:38.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:38.010+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:38.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:38.023+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:38.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:38.554+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:38.565 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:38.559+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:38.718 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:38.710+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:38.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:38.726+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:38.784 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:38.775+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:39.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:39.019+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:39.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:39.025+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:39.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:39.052+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:39.578 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:39.570+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:39.580 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:39.572+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:39.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:39.700+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:39.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:39.737+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:39.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:39.799+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:40.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:40.019+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:40.040 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:40.032+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:40.061 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:40.054+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:40.552 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:40.546+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:40.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:40.547+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:40.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:40.667+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:40.753 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:40.743+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:40.818 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:40.810+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:40.879 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:40:40.863+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e797 v797) 2019-11-29T19:40:41.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:41.034+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:41.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:41.046+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:41.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:41.106+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:41.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:41.509+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:41.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:41.510+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:41.665 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:41.658+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:41.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:41.742+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:41.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:41.781+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:42.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:42.027+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:42.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:42.057+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:42.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:42.152+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:42.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:42.553+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:42.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:42.555+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:42.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:42.615+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:42.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:42.752+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:42.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:42.788+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:42.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:42.987+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:43.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:43.083+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:43.192 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:43.184+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:43.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:43.552+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:43.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:43.554+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:43.591 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:43.585+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:43.753 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:43.744+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:43.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:43.825+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:43.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:43.948+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:44.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:44.040+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:44.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:44.167+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:44.518 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:44.510+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:44.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:44.512+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:44.620 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:44.614+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:44.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:44.750+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:44.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:44.813+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:44.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:44.907+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:45.085 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:45.078+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:45.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:45.143+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:45.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:45.469+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:45.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:45.472+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:45.625 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:45.618+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:45.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:45.776+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:45.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:45.800+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:45.891 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:40:45.884+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e797 v797) 2019-11-29T19:40:45.963 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:45.955+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:46.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:46.101+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:46.196 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:46.188+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:46.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:46.425+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:46.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:46.427+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:46.656 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:46.647+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:46.749 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:46.741+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:46.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:46.830+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:46.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:46.954+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:47.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:47.142+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:47.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:47.171+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:47.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:47.381+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:47.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:47.383+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:47.626 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:47.620+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:47.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:47.781+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:47.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:47.801+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:48.001 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:47.995+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:48.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:48.136+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:48.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:48.170+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:48.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:48.429+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:48.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:48.432+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:48.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:48.655+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:48.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:48.794+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:48.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:48.829+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:48.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:48.957+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:49.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:49.112+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:49.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:49.142+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:49.411 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:49.402+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:49.412 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:49.405+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:49.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:49.656+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:49.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:49.750+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:49.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:49.812+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:50.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:50.004+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:50.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:50.093+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:50.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:40:50.099+0000 1694c700 -1 osd.2 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:25.410598+0000 front 2019-11-29T19:39:25.722996+0000 (oldest deadline 2019-11-29T19:40:10.664434+0000) 2019-11-29T19:40:50.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:50.429+0000 1694c700 -1 osd.0 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:39:38.409782+0000 (oldest deadline 2019-11-29T19:40:18.409782+0000) 2019-11-29T19:40:50.438 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:50.432+0000 1694c700 -1 osd.0 797 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:50.677 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:40:50.665+0000 1694c700 -1 osd.1 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:22.784281+0000 front 2019-11-29T19:39:22.762865+0000 (oldest deadline 2019-11-29T19:40:08.558647+0000) 2019-11-29T19:40:50.749 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:40:50.738+0000 1694c700 -1 osd.4 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.964329+0000 front 2019-11-29T19:39:27.888548+0000 (oldest deadline 2019-11-29T19:40:16.526484+0000) 2019-11-29T19:40:50.852 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:50.844+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:40:50.985 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:40:50.974+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e797 v797) 2019-11-29T19:40:51.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:40:51.031+0000 1694c700 -1 osd.6 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:24.108462+0000 front 2019-11-29T19:39:24.218325+0000 (oldest deadline 2019-11-29T19:40:08.739856+0000) 2019-11-29T19:40:51.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:40:51.132+0000 1694c700 -1 osd.7 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:23.335925+0000 front 2019-11-29T19:39:23.331722+0000 (oldest deadline 2019-11-29T19:40:36.389210+0000) 2019-11-29T19:40:51.506 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:40:51.480+0000 1694c700 -1 osd.0 798 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e795) 2019-11-29T19:40:51.877 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:40:51.868+0000 1694c700 -1 osd.5 797 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:39:27.269705+0000 front 2019-11-29T19:39:27.281828+0000 (oldest deadline 2019-11-29T19:40:12.530324+0000) 2019-11-29T19:41:54.819 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:26:02.949 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:54.824 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:26:03.004 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:54.825 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:26:02.960 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:54.827 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:26:03.007 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:54.829 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:26:03.009 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:54.834 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:26:03.014 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:55.036 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:26:03.215 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:55.047 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:26:03.182 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:41:55.060 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:26:03.240 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:42:23.513 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:23.507+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:24.245 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:24.233+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:24.473 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:24.465+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:24.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:24.577+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:24.737 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:24.730+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:25.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:25.050+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:25.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:25.201+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:25.457 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:25.449+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:25.546 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:25.538+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:25.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:25.776+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:26.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:26.026+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:26.203 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:26.195+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:26.456 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:26.448+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:26.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:26.578+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:26.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:26.780+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:27.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:26.997+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:27.231 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:27.221+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:27.510 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:27.502+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:27.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:27.529+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:27.556 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:27.550+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:27.796 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:27.788+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:27.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:27.968+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:28.213 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:28.205+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:28.358 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:28.350+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:28.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:28.497+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:28.551 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:28.543+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:28.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:28.600+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:28.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:28.822+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:29.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:29.012+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:29.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:29.201+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:29.400 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:29.392+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:29.523 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:29.516+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:29.584 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:29.578+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:29.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:29.582+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:29.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:29.823+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:30.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:30.023+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:30.173 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:30.166+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:30.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:30.420+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:30.532 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:30.523+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:30.586 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:30.578+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:30.609 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:30.602+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:30.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:30.839+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:31.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:30.997+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:31.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:31.152+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:31.471 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:31.463+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:31.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:31.501+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:31.569 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:31.562+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:31.641 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:31.633+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:31.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:31.804+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:31.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:31.968+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:32.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:32.154+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:32.491 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:32.483+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:32.516 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:32.509+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:32.592 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:32.584+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:32.690 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:32.683+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:32.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:32.840+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:33.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:33.000+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:33.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:33.114+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:33.538 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:33.531+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:33.547 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:33.540+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:33.617 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:33.610+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:33.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:33.657+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:33.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:33.873+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:34.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:34.049+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:34.160 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:34.152+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:34.571 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:34.564+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:34.589 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:34.577+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:34.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:34.628+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:34.659 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:34.652+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:34.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:34.895+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:35.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:35.101+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:35.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:35.143+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:35.573 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:35.565+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:35.611 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:35.603+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:35.645 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:35.632+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:35.646 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:35.639+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:35.937 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:35.928+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:36.146 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:36.139+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:36.204 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:36.196+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:36.581 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:36.573+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:36.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:36.593+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:36.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:36.595+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:36.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:36.654+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:36.977 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:36.970+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:37.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:37.108+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:37.175 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:37.167+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:37.566 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:37.555+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:37.568 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:37.560+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:37.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:37.618+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:37.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:37.626+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:37.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:37.939+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:38.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:38.133+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:38.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:38.135+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:38.564 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:38.555+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:38.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:38.584+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:38.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:38.611+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:38.664 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:38.657+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:38.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:38.946+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:39.122 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:39.114+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:39.182 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:39.160+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:39.523 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:39.516+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:39.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:39.581+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:39.981 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:39.653+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:39.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:39.626+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:39.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:39.968+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:40.137 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:40.124+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:40.214 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:40.205+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:40.536 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:40.529+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:40.590 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:40.582+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:40.609 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:40.602+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:40.650 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:40.642+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:40.970 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:40.961+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:41.175 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:41.169+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:41.201 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:41.193+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:41.510 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:41.503+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:41.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:41.581+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:41.635 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:41.628+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:41.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:41.629+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:41.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:41.985+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:42.196 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:42.189+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:42.227 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:42.219+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:42.472 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:42.466+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:42.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:42.619+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:42.638 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:42.630+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:42.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:42.658+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:42.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:42.969+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:43.206 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:43.199+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:43.243 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:43.235+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:43.445 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:43.438+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:43.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:43.599+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:43.618 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:43.611+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:43.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:43.620+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:44.026 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:44.019+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:44.213 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:44.204+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:44.255 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:44.247+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:44.457 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:44.440+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:44.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:44.576+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:44.612 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:44.598+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:44.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:44.637+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:45.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:45.025+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:45.183 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:45.176+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:45.237 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:45.230+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:45.462 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:45.456+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:45.566 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:45.558+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:45.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:45.574+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:45.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:45.637+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:46.064 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:46.056+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:46.192 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:46.183+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:46.289 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:46.282+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:46.422 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:46.414+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:46.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:46.531+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:46.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:46.534+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:46.701 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:46.690+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:47.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:47.079+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:47.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:47.201+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:47.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:47.294+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:47.403 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:47.396+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:47.522 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:47.514+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:47.592 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:47.583+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:47.656 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:47.648+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:48.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:48.095+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:48.229 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:48.221+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:48.322 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:48.316+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:48.395 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:48.387+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:48.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:48.541+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:48.587 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:48.578+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:48.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:48.665+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:49.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:49.078+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:49.207 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:49.195+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:49.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:49.287+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:49.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:49.440+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:49.551 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:49.543+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:49.578 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:49.571+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:49.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:49.680+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:50.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:50.089+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:50.239 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:50.232+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:50.318 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:50.311+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:50.448 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:50.440+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:50.503 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:50.496+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:50.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:50.558+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:50.665 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:50.657+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:51.053 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:51.046+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:51.249 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:51.242+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:51.283 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:51.277+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:51.423 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:51.416+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:51.528 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:51.520+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:51.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:51.542+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:51.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:51.641+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:52.017 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:52.009+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:52.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:52.237+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:52.257 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:52.249+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:52.410 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:52.402+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:52.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:52.479+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:52.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:52.558+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:52.674 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:52.667+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:53.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:53.024+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:53.246 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:53.238+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:53.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:53.249+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:53.382 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:53.375+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:53.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:53.454+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:53.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:53.592+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:53.655 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:53.639+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:54.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:54.023+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:54.228 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:54.218+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:54.293 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:54.282+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:54.364 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:54.358+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:54.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:54.450+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:54.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:54.569+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:54.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:54.638+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:55.087 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:55.077+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:55.237 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:55.223+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:55.290 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:55.283+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:55.395 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:55.385+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:55.485 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:55.466+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:55.613 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:55.603+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:55.692 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:55.683+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:42:56.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:42:56.086+0000 1694c700 -1 osd.6 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.814100+0000 front 2019-11-29T19:41:38.825398+0000 (oldest deadline 2019-11-29T19:42:24.700944+0000) 2019-11-29T19:42:56.277 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:42:56.261+0000 1694c700 -1 osd.1 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:39.773147+0000 front 2019-11-29T19:41:39.898556+0000 (oldest deadline 2019-11-29T19:42:24.384394+0000) 2019-11-29T19:42:56.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:42:56.275+0000 1694c700 -1 osd.4 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.775521+0000 front 2019-11-29T19:41:37.706797+0000 (oldest deadline 2019-11-29T19:42:23.309430+0000) 2019-11-29T19:42:56.397 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:42:56.390+0000 1694c700 -1 osd.3 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:37.828563+0000 front 2019-11-29T19:41:38.008438+0000 (oldest deadline 2019-11-29T19:42:23.098190+0000) 2019-11-29T19:42:56.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:42:56.423+0000 1694c700 -1 osd.2 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:41.163893+0000 front 2019-11-29T19:41:41.153253+0000 (oldest deadline 2019-11-29T19:42:27.042320+0000) 2019-11-29T19:42:56.530 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:42:56.519+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 48sec e805 v805) 2019-11-29T19:42:56.658 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:42:56.639+0000 1694c700 -1 osd.7 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:38.109899+0000 front 2019-11-29T19:41:38.333785+0000 (oldest deadline 2019-11-29T19:42:23.974255+0000) 2019-11-29T19:42:56.740 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:42:56.733+0000 1694c700 -1 osd.5 805 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:41:42.711374+0000 front 2019-11-29T19:41:42.709377+0000 (oldest deadline 2019-11-29T19:42:27.856750+0000) 2019-11-29T19:43:55.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:43:55.001+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:43:55.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:43:55.026+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:43:55.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:43:55.827+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:43:56.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:43:56.003+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:43:56.087 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:43:56.076+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:43:56.816 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:43:56.807+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:43:57.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:43:57.029+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:43:57.045 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:43:57.039+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:43:57.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:43:57.718+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:43:57.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:43:57.830+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:43:58.008 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:43:58.000+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:43:58.030 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:43:58.022+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:43:58.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:43:58.742+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:43:58.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:43:58.806+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:43:58.997 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:43:58.986+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:43:59.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:43:58.990+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:43:59.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:43:59.762+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:43:59.771 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:43:59.764+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:43:59.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:43:59.828+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:00.009 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:00.001+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:00.031 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:00.022+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:00.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:00.754+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:00.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:00.765+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:00.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:00.870+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:01.001 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:00.993+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:01.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:00.999+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:01.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:01.788+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:01.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:01.818+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:01.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:01.826+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:01.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:01.959+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:02.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:02.033+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:02.787 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:02.780+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:02.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:02.843+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:02.868 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:02.861+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:02.926 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:02.919+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:03.015 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:03.008+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:03.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:03.748+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:03.842 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:03.835+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:03.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:03.850+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:03.968 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:03.961+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:04.002 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:03.994+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:04.752 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:04.746+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:04.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:04.852+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:04.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:04.890+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:04.994 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:04.989+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:05.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:05.008+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:05.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:05.729+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:05.828 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:05.821+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:05.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:05.897+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:05.978 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:05.971+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:06.016 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:06.009+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:06.770 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:06.764+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:06.855 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:06.848+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:06.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:06.864+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:06.997 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:06.990+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:07.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:07.006+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:07.756 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:07.749+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:07.817 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:07.803+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:07.840 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:07.833+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:07.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:07.882+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:07.987 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:07.969+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:07.987 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:07.974+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:08.751 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:08.744+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:08.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:08.801+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:08.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:08.806+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:08.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:08.843+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:08.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:08.965+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:08.977 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:08.970+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:09.763 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:09.757+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:09.771 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:09.765+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:09.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:09.818+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:09.846 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:09.839+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:09.991 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:09.984+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:09.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:09.992+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:10.786 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:10.779+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:10.800 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:10.784+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:10.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:10.800+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:10.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:10.857+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:11.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:11.023+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:11.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:11.031+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:11.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:11.750+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:11.833 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:11.827+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:11.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:11.842+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:11.855 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:11.845+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:12.065 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:12.059+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:12.073 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:12.067+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:12.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:12.799+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:12.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:12.829+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:12.838 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:12.829+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:12.853 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:12.846+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:13.112 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:13.104+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:13.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:13.108+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:13.824 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:13.790+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:13.824 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:13.811+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:13.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:13.852+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:13.899 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:13.887+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:14.135 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:14.126+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:14.168 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:14.157+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:14.771 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:14.764+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:14.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:14.809+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:14.835 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:14.827+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:14.949 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:14.934+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:14.950 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:14.935+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:15.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:15.134+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:15.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:15.205+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:15.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:15.786+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:15.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:15.837+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:15.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:15.859+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:15.900 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:15.892+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:15.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:15.894+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:16.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:16.129+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:16.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:16.256+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:16.797 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:16.785+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:16.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:16.879+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:16.891 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:16.881+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:16.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:16.891+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:16.899 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:16.890+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:17.110 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:17.103+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:17.229 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:17.215+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:17.777 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:17.770+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:17.879 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:17.872+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:17.881 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:17.873+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:17.882 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:17.876+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:17.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:17.931+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:18.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:18.078+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:18.275 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:18.267+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:18.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:18.753+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:18.848 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:18.838+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:18.848 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:18.841+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:18.921 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:18.915+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:18.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:18.969+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:19.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:19.089+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:19.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:19.249+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:19.786 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:19.777+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:19.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:19.876+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:19.888 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:19.878+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:19.915 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:19.908+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:19.992 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:19.985+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:20.092 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:20.085+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:20.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:20.293+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:20.748 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:20.734+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:20.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:20.868+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:20.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:20.870+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:20.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:20.900+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:20.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:20.975+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:21.114 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:21.103+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:21.286 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:21.280+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:21.764 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:21.758+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:21.880 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:21.871+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:21.889 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:21.873+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:21.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:21.945+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:21.970 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:21.960+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:22.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:22.067+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:22.314 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:22.308+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:22.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:22.727+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:22.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:22.888+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:22.895 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:22.889+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:22.915 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:22.908+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:22.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:22.945+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:23.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:23.065+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:23.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:23.354+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:23.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:23.747+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:23.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:23.911+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:23.938 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:23.914+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:23.938 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:23.916+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:23.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:23.940+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:24.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:24.097+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:24.376 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:24.366+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:24.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:24.713+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:24.876 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:24.869+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:24.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:24.871+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:24.954 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:24.946+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:24.971 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:24.963+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:25.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:25.138+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:25.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:25.335+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:25.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:25.758+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:25.837 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:25.825+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:25.837 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:25.827+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:25.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:25.922+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:25.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:25.981+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:26.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:26.150+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:26.339 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:26.328+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:26.776 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:26.769+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:26.877 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:26.871+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:26.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:26.874+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:26.973 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:26.960+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:26.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:26.964+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:27.056 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:44:27.047+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e811 v811) 2019-11-29T19:44:27.169 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:27.161+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:27.312 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:27.289+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:27.835 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:27.819+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:27.849 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:27.838+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:27.849 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:27.840+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:27.995 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:27.981+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:28.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:27.994+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:28.137 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:28.129+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:28.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:28.309+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:28.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:28.775+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:28.843 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:28.835+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:28.843 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:28.837+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:28.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:28.950+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:28.959 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:28.952+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:29.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:29.098+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:29.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:29.340+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:29.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:29.762+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:29.818 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:29.812+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:29.820 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:29.815+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:29.918 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:29.911+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:29.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:29.978+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:30.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:30.052+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:30.359 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:30.351+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:30.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:30.718+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:30.793 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:30.780+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:30.793 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:30.782+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:30.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:30.918+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:31.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:30.993+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:31.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:31.014+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:31.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:31.393+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:31.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:31.684+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:31.781 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:31.772+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:31.781 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:31.774+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:31.893 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:31.886+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:32.004 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:31.996+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:32.073 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:44:32.064+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e811 v811) 2019-11-29T19:44:32.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:32.067+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:32.421 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:32.413+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:32.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:32.704+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:32.818 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:32.810+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:32.819 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:32.813+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:32.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:32.929+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:33.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:32.999+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:33.119 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:33.111+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:33.434 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:33.426+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:33.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:33.666+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:33.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:33.792+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:33.802 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:33.796+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:33.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:33.905+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:34.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:34.042+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:34.080 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:34.065+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:34.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:34.454+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:34.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:34.705+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:34.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:34.780+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:34.791 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:34.785+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:34.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:34.923+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:35.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:35.021+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:35.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:35.044+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:35.374 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:35.367+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:35.456 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:35.438+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:35.687 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:35.680+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:35.793 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:35.779+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:35.793 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:35.784+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:35.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:35.904+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:36.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:35.999+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:36.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:36.018+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:36.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:36.351+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:36.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:36.435+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:36.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:36.712+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:36.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:36.780+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:36.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:36.782+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:36.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:36.947+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:36.978 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:36.971+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:37.072 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:37.062+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:37.092 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:44:37.084+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e811 v811) 2019-11-29T19:44:37.358 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:37.350+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:37.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:37.481+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:37.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:37.711+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:37.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:37.793+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:37.805 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:37.798+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:37.935 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:37.927+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:37.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:37.944+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:38.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:38.038+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:38.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:38.379+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:38.505 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:38.498+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:38.722 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:38.716+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:38.763 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:38.756+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:38.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:38.758+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:38.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:38.889+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:38.952 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:38.946+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:39.006 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:39.000+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:39.405 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:39.396+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:39.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:39.541+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:39.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:39.699+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:39.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:39.740+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:39.749 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:39.744+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:39.928 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:39.918+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:40.000 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:39.993+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:40.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:40.020+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:40.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:40.379+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:40.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:40.519+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:40.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:40.725+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:40.742 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:40.736+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:40.743 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:40.737+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:40.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:40.953+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:40.977 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:40.969+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:41.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:41.061+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:41.381 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:41.371+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:41.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:41.543+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:41.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:41.756+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:41.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:41.759+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:41.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:41.770+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:41.972 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:41.965+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:41.988 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:41.981+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:42.060 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:42.053+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:42.109 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:44:42.104+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e811 v811) 2019-11-29T19:44:42.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:42.334+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:42.541 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:42.534+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:42.773 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:42.765+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:42.774 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:42.767+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:42.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:42.778+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:43.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:43.007+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:43.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:43.012+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:43.101 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:43.093+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:43.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:43.385+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:43.510 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:43.504+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:43.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:43.780+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:43.793 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:43.785+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:43.794 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:43.787+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:43.985 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:43.978+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:44.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:44.029+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:44.115 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:44.108+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:44.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:44.363+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:44.515 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:44.509+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:44.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:44.743+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:44.831 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:44.824+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:44.835 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:44.830+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:44.946 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:44.940+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:45.076 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:45.070+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:45.147 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:45.140+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:45.324 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:45.317+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:45.536 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:45.522+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:45.763 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:45.756+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:45.822 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:45.814+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:45.823 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:45.816+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:45.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:45.934+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:46.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:46.093+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:46.196 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:46.188+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:46.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:46.362+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:46.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:46.569+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:46.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:44:46.756+0000 1694c700 -1 osd.1 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.526238+0000 front 2019-11-29T19:43:13.665762+0000 (oldest deadline 2019-11-29T19:43:58.810888+0000) 2019-11-29T19:44:46.792 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:46.781+0000 1694c700 -1 osd.0 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:43:34.647467+0000 (oldest deadline 2019-11-29T19:44:14.647467+0000) 2019-11-29T19:44:46.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:44:46.784+0000 1694c700 -1 osd.0 811 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e809) 2019-11-29T19:44:46.935 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:44:46.929+0000 1694c700 -1 osd.2 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.015414+0000 front 2019-11-29T19:43:12.876520+0000 (oldest deadline 2019-11-29T19:43:55.089111+0000) 2019-11-29T19:44:47.077 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:44:47.068+0000 1694c700 -1 osd.6 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.016513+0000 front 2019-11-29T19:43:12.914631+0000 (oldest deadline 2019-11-29T19:43:54.475595+0000) 2019-11-29T19:44:47.200 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:44:47.189+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e811 v811) 2019-11-29T19:44:47.221 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:47.214+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:44:47.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:44:47.335+0000 1694c700 -1 osd.4 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.014525+0000 front 2019-11-29T19:43:13.016158+0000 (oldest deadline 2019-11-29T19:44:34.471196+0000) 2019-11-29T19:44:47.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:44:47.561+0000 1694c700 -1 osd.7 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.393392+0000 front 2019-11-29T19:43:13.421321+0000 (oldest deadline 2019-11-29T19:43:54.448038+0000) 2019-11-29T19:44:48.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:44:48.168+0000 1694c700 -1 osd.5 811 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:43:13.938673+0000 front 2019-11-29T19:43:13.903939+0000 (oldest deadline 2019-11-29T19:43:56.777079+0000) 2019-11-29T19:45:08.704 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:08.698+0000 30f82700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:08.853 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:08.835+0000 35f8c700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:08.952 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:08.918+0000 35f8c700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:09.164 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:09.102+0000 35f8c700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:09.355 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:09.338+0000 3578b700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:09.535 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:09.448+0000 3578b700 -1 osd.3 817 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:11.460 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:45:11.437+0000 30f82700 -1 osd.3 818 build_incremental_map_msg missing incremental map 817 2019-11-29T19:45:53.657 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:30:01.791 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.672 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:30:01.806 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.677 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:30:01.856 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.679 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:30:01.859 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.681 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:30:01.861 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.684 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:30:01.865 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.951 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:30:02.131 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.967 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:30:02.147 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:45:53.996 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:30:02.130 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:46:06.618 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:06.610+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:06.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:06.663+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:07.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:07.347+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:07.643 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:07.637+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:07.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:07.680+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:08.405 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:08.397+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:08.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:08.643+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:08.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:08.685+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:08.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:08.835+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:09.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:09.232+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:09.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:09.404+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:09.668 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:09.659+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:09.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:09.694+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:09.819 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:09.811+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:09.979 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:09.972+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:10.252 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:10.245+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:10.377 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:10.369+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:10.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:10.380+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:10.628 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:10.620+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:10.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:10.722+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:10.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:10.769+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:10.998 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:10.990+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:11.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:11.262+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:11.390 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:11.374+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:11.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:11.377+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:11.631 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:11.624+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:11.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:11.711+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:11.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:11.728+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:12.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:12.028+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:12.300 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:12.291+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:12.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:12.332+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:12.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:12.414+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:12.623 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:12.617+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:12.715 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:12.708+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:12.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:12.773+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:13.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:13.035+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:13.308 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:13.301+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:13.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:13.336+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:13.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:13.434+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:13.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:13.662+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:13.668 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:13.662+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:13.792 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:13.783+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:14.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:14.018+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:14.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:14.307+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:14.344 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:14.336+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:14.442 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:14.434+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:14.636 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:14.629+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:14.638 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:14.629+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:14.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:14.802+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:15.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:15.041+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:15.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:15.328+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:15.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:15.338+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:15.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:15.438+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:15.617 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:15.608+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:15.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:15.659+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:15.774 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:15.767+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:16.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:16.006+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:16.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:16.283+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:16.350 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:16.343+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:16.450 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:16.442+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:16.607 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:16.600+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:16.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:16.665+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:16.736 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:16.728+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:16.977 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:16.970+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:17.303 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:17.296+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:17.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:17.354+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:17.464 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:17.450+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:17.610 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:17.604+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:17.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:17.707+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:17.723 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:17.717+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:18.001 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:17.995+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:18.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:18.324+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:18.339 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:18.332+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:18.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:18.474+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:18.660 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:18.652+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:18.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:18.674+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:18.763 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:18.754+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:19.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:19.042+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:19.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:19.316+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:19.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:19.376+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:19.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:19.518+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:19.630 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:19.623+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:19.646 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:19.639+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:19.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:19.713+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:20.039 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:20.033+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:20.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:20.285+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:20.422 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:20.413+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:20.509 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:20.502+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:20.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:20.589+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:20.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:20.689+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:20.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:20.743+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:21.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:21.025+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:21.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:21.312+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:21.462 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:21.455+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:21.546 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:21.535+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:21.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:21.604+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:21.756 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:21.743+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:21.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:21.769+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:22.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:22.040+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:22.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:22.299+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:22.453 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:22.447+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:22.561 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:22.553+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:22.617 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:22.611+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:22.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:22.727+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:22.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:22.737+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:23.080 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:23.072+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:23.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:23.273+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:23.483 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:23.477+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:23.531 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:23.522+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:23.634 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:23.627+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:23.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:23.712+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:23.778 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:23.771+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:24.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:24.034+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:24.269 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:24.259+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:24.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:24.473+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:24.519 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:24.512+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:24.676 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:24.668+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:24.768 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:24.754+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:24.833 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:24.821+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:25.065 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:25.058+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:25.317 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:25.310+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:25.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:25.438+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:25.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:25.499+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:25.696 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:25.686+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:25.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:25.774+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:25.824 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:25.818+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:26.084 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:26.076+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:26.316 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:26.309+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:26.430 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:26.423+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:26.467 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:26.459+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:26.698 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:26.690+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:26.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:26.742+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:26.840 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:26.834+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:27.095 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:27.087+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:27.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:27.314+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:27.387 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:27.379+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:27.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:27.425+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:27.670 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:27.663+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:27.756 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:27.748+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:27.820 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:27.801+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:28.111 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:28.104+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:28.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:28.323+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:28.357 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:28.348+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:28.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:28.397+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:28.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:28.678+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:28.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:28.785+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:28.811 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:28.802+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:29.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:29.112+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:29.321 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:29.315+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:29.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:29.325+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:29.386 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:29.378+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:29.684 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:29.674+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:29.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:29.791+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:29.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:29.854+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:30.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:30.125+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:30.290 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:30.283+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:30.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:30.289+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:30.371 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:30.364+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:30.673 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:30.666+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:30.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:30.815+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:30.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:30.826+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:31.197 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:31.178+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:31.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:31.261+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:31.301 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:31.288+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:31.334 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:31.327+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:31.686 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:31.679+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:31.814 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:31.808+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:31.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:31.878+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:32.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:32.218+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:32.277 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:32.271+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:32.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:32.270+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:32.341 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:32.332+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:32.674 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:32.668+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:32.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:32.800+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:32.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:32.859+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:33.261 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:33.251+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:33.261 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:33.238+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:33.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:33.256+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:33.375 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:33.368+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:33.659 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:33.653+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:33.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:33.782+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:33.827 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:33.819+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:34.227 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:34.219+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:34.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:34.243+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:34.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:34.268+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:34.383 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:34.376+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:34.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:34.620+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:34.801 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:34.794+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:34.836 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:34.829+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:35.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:35.265+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:35.277 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:35.270+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:35.281 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:35.273+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:35.415 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:35.407+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:35.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:35.581+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:35.793 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:35.786+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:35.831 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:35.823+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:36.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:36.220+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:36.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:36.246+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:36.275 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:36.269+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:36.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:36.433+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:36.599 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:36.593+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:36.761 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:36.754+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:36.880 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:36.873+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:37.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:37.239+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:37.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:37.249+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:37.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:37.264+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:37.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:37.417+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:37.628 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:37.622+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:37.797 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:37.790+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:37.914 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:37.906+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:38.266 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:38.255+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:38.301 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:38.294+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:38.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:38.309+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:38.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:38.409+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:38.673 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:38.665+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:38.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:38.773+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:38.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:38.892+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:39.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:39.255+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:39.320 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:39.313+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:39.368 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:39.361+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:39.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:39.455+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:39.685 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:39.677+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:39.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:39.759+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:39.935 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:39.928+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:40.272 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:40.265+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:40.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:40.347+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:40.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:40.391+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:40.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:40.431+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:40.691 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:40.685+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:40.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:40.796+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:40.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:40.955+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:41.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:41.228+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:41.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:41.325+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:41.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:41.377+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:41.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:41.448+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:41.736 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:41.722+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:46:41.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:46:41.836+0000 1694c700 -1 osd.6 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.147083+0000 front 2019-11-29T19:45:24.148440+0000 (oldest deadline 2019-11-29T19:46:08.149500+0000) 2019-11-29T19:46:41.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:46:41.945+0000 1694c700 -1 osd.1 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.923039+0000 front 2019-11-29T19:45:25.921755+0000 (oldest deadline 2019-11-29T19:46:06.323687+0000) 2019-11-29T19:46:42.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:46:42.241+0000 1694c700 -1 osd.2 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.443454+0000 front 2019-11-29T19:45:24.058464+0000 (oldest deadline 2019-11-29T19:46:08.973357+0000) 2019-11-29T19:46:42.326 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:46:42.318+0000 1694c700 -1 osd.7 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.431144+0000 front 2019-11-29T19:45:25.515367+0000 (oldest deadline 2019-11-29T19:46:06.409886+0000) 2019-11-29T19:46:42.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:46:42.342+0000 1694c700 -1 osd.5 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:25.768699+0000 front 2019-11-29T19:45:25.774259+0000 (oldest deadline 2019-11-29T19:46:09.237626+0000) 2019-11-29T19:46:42.409 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:46:42.402+0000 1694c700 -1 osd.4 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:24.974109+0000 front 2019-11-29T19:45:24.747164+0000 (oldest deadline 2019-11-29T19:46:09.910900+0000) 2019-11-29T19:46:42.621 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:46:42.611+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e818 v818) 2019-11-29T19:46:42.797 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:46:42.757+0000 1694c700 -1 osd.3 818 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:45:20.854373+0000 front 2019-11-29T19:45:20.809320+0000 (oldest deadline 2019-11-29T19:46:06.097503+0000) 2019-11-29T19:47:28.090 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:31:36.225 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.097 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:31:36.232 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.124 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:31:36.304 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.143 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:31:36.323 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.149 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:31:36.329 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.151 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:31:36.331 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.232 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:31:36.412 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.238 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:31:36.418 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:28.306 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:31:36.441 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:47:40.801 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:40.794+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:41.819 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:41.811+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:42.730 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:42.722+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:42.772 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:42.765+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:42.865 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:42.859+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:43.381 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:43.376+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:43.622 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:43.615+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:43.735 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:43.727+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:43.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:43.781+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:43.826 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:43.818+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:44.359 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:44.352+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:44.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:44.598+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:44.620 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:44.613+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:44.744 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:44.737+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:44.792 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:44.786+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:44.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:44.816+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:45.397 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:45.391+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:45.646 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:45.639+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:45.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:45.665+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:45.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:45.766+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:45.790 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:45.781+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:45.845 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:45.833+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:46.128 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:46.122+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:46.384 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:46.376+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:46.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:46.630+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:46.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:46.669+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:46.744 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:46.737+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:46.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:46.761+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:46.871 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:46.860+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:47.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:47.132+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:47.349 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:47.342+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:47.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:47.639+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:47.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:47.682+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:47.747 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:47.739+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:47.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:47.762+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:47.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:47.875+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:48.134 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:48.128+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:48.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:48.347+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:48.654 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:48.648+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:48.714 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:48.707+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:48.727 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:48.719+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:48.807 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:48.800+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:48.887 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:48.881+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:49.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:49.146+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:49.337 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:49.331+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:49.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:49.680+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:49.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:49.688+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:49.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:49.757+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:49.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:49.832+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:49.867 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:49.859+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:50.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:50.161+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:50.345 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:50.338+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:50.650 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:50.642+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:50.701 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:50.694+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:50.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:50.773+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:50.809 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:50.803+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:50.869 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:50.862+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:51.147 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:51.141+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:51.386 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:51.380+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:51.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:51.626+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:51.670 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:51.663+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:51.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:51.766+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:51.837 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:51.824+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:51.911 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:51.903+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:52.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:52.178+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:52.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:52.180+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:52.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:52.399+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:52.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:52.643+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:52.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:52.695+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:52.802 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:52.791+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:52.815 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:52.809+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:52.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:52.899+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:53.164 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:53.157+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:53.165 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:53.159+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:53.402 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:53.395+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:53.648 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:53.640+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:53.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:53.724+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:53.781 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:53.774+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:53.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:53.793+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:53.951 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:53.944+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:54.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:54.123+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:54.130 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:54.124+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:54.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:54.393+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:54.680 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:54.673+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:54.748 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:54.741+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:54.777 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:54.769+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:54.787 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:54.777+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:54.939 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:54.930+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:55.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:55.162+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:55.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:55.165+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:55.377 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:55.371+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:55.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:55.717+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:55.741 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:55.734+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:55.754 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:55.747+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:55.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:55.773+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:55.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:55.958+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:56.205 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:56.198+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:56.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:56.203+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:56.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:56.391+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:56.705 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:56.699+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:56.716 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:56.708+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:56.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:56.749+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:56.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:56.788+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:56.973 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:56.967+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:57.259 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:57.250+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:57.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:57.253+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:57.416 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:57.408+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:57.718 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:57.711+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:57.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:57.737+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:57.796 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:57.789+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:57.813 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:57.806+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:58.010 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:58.003+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:58.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:58.297+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:58.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:58.299+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:58.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:58.432+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:58.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:58.680+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:58.774 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:58.767+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:47:58.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:58.772+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:58.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:58.781+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:59.017 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:47:59.010+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:47:59.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:59.309+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:47:59.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:47:59.314+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:47:59.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:47:59.414+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:47:59.646 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:47:59.638+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:47:59.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:47:59.756+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:47:59.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:47:59.784+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:47:59.818 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:47:59.810+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:00.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:00.021+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:00.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:00.320+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:00.329 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:00.323+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:00.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:00.467+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:00.622 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:00.614+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:00.723 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:00.715+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:00.824 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:00.817+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:00.825 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:00.818+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:01.060 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:01.053+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:01.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:01.326+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:01.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:01.327+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:01.491 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:01.484+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:01.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:01.580+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:01.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:01.769+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:01.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:01.801+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:01.846 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:01.837+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:02.078 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:02.072+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:02.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:02.374+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:02.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:02.376+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:02.469 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:02.463+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:02.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:02.629+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:02.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:02.799+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:02.832 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:02.823+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:02.887 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:02.880+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:03.066 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:03.058+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:03.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:03.335+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:03.343 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:03.337+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:03.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:03.515+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:03.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:03.647+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:03.801 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:03.794+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:03.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:03.861+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:03.878 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:03.869+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:04.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:04.019+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:04.404 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:04.388+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:04.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:04.390+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:04.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:04.471+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:04.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:04.633+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:04.846 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:04.839+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:04.865 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:04.853+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:04.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:04.911+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:05.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:05.030+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:05.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:05.434+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:05.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:05.436+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:05.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:05.522+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:05.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:05.620+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:05.863 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:05.856+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:05.898 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:05.893+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:05.927 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:05.920+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:06.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:05.998+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:06.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:06.454+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:06.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:06.456+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:06.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:06.486+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:06.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:06.668+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:06.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:06.830+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:06.884 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:06.876+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:06.940 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:06.934+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:07.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:07.018+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:07.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:07.414+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:07.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:07.416+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:07.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:07.442+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:07.702 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:07.695+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:07.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:07.837+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:07.875 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:07.868+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:07.904 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:07.897+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:07.981 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:07.974+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:08.404 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:08.396+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:08.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:08.399+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:08.427 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:08.415+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:08.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:08.751+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:08.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:08.840+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:08.886 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:08.879+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:08.895 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:08.889+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:08.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:08.952+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:09.391 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:09.385+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:09.393 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:09.387+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:09.408 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:09.401+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:09.769 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:09.762+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:09.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:09.799+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:09.849 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:09.842+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:09.856 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:09.850+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:10.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:10.001+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:10.411 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:10.404+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:10.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:10.421+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:10.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:10.424+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:10.785 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:10.776+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:10.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:10.792+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:10.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:10.832+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:10.850 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:10.844+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:11.027 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:11.021+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:11.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:11.433+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:11.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:11.471+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:11.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:11.473+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:11.771 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:11.761+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:11.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:11.808+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:11.842 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:11.827+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:11.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:11.840+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:12.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:12.014+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:12.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:12.437+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:12.478 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:12.472+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:12.478 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:12.473+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:12.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:12.719+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:12.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:12.815+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:12.856 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:12.849+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:12.865 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:12.859+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:13.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:13.000+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:13.215 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:48:13.206+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e825 v825) 2019-11-29T19:48:13.491 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:13.484+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:13.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:13.487+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:13.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:13.490+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:13.731 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:13.723+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:13.805 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:13.797+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:13.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:13.862+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:13.890 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:13.882+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:14.011 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:14.003+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:14.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:14.468+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:14.475 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:14.469+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:14.493 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:14.488+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:14.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:14.744+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:14.853 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:14.845+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:14.861 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:14.855+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:14.884 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:14.875+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:14.992 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:14.984+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:15.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:15.448+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:15.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:15.512+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:15.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:15.515+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:15.743 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:15.735+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:15.824 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:15.816+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:15.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:15.861+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:15.913 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:15.906+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:16.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:16.007+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:16.472 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:16.466+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:16.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:16.561+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:16.569 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:16.562+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:16.722 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:16.712+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:16.828 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:16.820+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:16.862 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:16.855+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:16.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:16.880+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:17.032 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:17.025+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:17.444 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:17.434+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:17.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:17.524+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:17.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:17.527+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:17.714 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:17.705+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:17.808 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:17.799+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:17.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:17.855+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:17.896 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:17.889+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:18.032 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:18.024+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:18.237 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:48:18.227+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e825 v825) 2019-11-29T19:48:18.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:18.432+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:18.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:18.543+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:18.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:18.545+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:18.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:18.696+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:18.825 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:18.817+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:18.836 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:18.828+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:18.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:18.886+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:19.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:19.035+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:19.430 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:19.423+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:19.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:19.512+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:19.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:19.513+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:19.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:19.738+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:19.857 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:19.849+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:19.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:19.860+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:19.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:19.876+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:20.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:20.041+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:20.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:20.381+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:20.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:20.535+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:20.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:20.538+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:20.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:20.737+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:20.843 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:20.837+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:20.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:20.857+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:20.894 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:20.886+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:21.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:21.058+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:21.426 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:21.419+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:21.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:21.524+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:21.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:21.526+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:21.758 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:21.751+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:21.832 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:21.826+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:21.883 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:21.877+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:21.923 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:21.916+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:22.067 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:22.061+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:22.450 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:22.443+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:22.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:22.548+0000 1694c700 -1 osd.0 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:47:11.799418+0000 (oldest deadline 2019-11-29T19:47:51.799418+0000) 2019-11-29T19:48:22.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:22.550+0000 1694c700 -1 osd.0 825 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:22.738 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:22.731+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:22.839 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:22.831+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:22.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:48:22.858+0000 1694c700 -1 osd.2 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.608215+0000 front 2019-11-29T19:46:57.637178+0000 (oldest deadline 2019-11-29T19:47:42.881735+0000) 2019-11-29T19:48:22.977 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:48:22.959+0000 1694c700 -1 osd.4 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:55.491846+0000 front 2019-11-29T19:46:55.709964+0000 (oldest deadline 2019-11-29T19:47:40.714627+0000) 2019-11-29T19:48:23.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:48:23.038+0000 1694c700 -1 osd.5 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.644908+0000 front 2019-11-29T19:46:59.598772+0000 (oldest deadline 2019-11-29T19:47:42.305587+0000) 2019-11-29T19:48:23.321 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:48:23.312+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e825 v825) 2019-11-29T19:48:23.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:48:23.492+0000 1694c700 -1 osd.1 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:57.564590+0000 front 2019-11-29T19:46:57.542273+0000 (oldest deadline 2019-11-29T19:47:42.809765+0000) 2019-11-29T19:48:23.617 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:48:23.563+0000 1694c700 -1 osd.0 826 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e822) 2019-11-29T19:48:23.712 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:48:23.705+0000 1694c700 -1 osd.7 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:56.659770+0000 front 2019-11-29T19:46:56.650102+0000 (oldest deadline 2019-11-29T19:47:41.925192+0000) 2019-11-29T19:48:23.837 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:48:23.829+0000 1694c700 -1 osd.6 825 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:46:59.853494+0000 front 2019-11-29T19:46:59.916202+0000 (oldest deadline 2019-11-29T19:47:43.927964+0000) 2019-11-29T19:48:55.787 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:55.718+0000 31f84700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:55.833 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:55.809+0000 35f8c700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:55.908 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:55.903+0000 34789700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:55.971 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:55.943+0000 31f84700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:56.263 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:56.102+0000 32f86700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:56.563 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:56.465+0000 37f90700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:56.817 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:56.791+0000 31783700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:57.034 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:57.014+0000 3678d700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:48:57.182 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:48:57.155+0000 30f82700 -1 osd.3 831 build_incremental_map_msg missing incremental map 831 2019-11-29T19:49:23.921 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:32.056 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:23.934 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:32.069 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.034 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:32.214 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.036 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:32.216 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.045 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:32.226 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.047 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:32.228 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.087 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:32.219 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.158 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:32.338 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:24.173 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:32.353 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.178 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:59.313 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.189 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:59.369 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.189 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:59.370 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.194 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:59.374 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.196 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:59.330 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.197 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:59.377 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.231 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:33:59.410 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.236 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:33:59.417 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:51.291 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:33:59.425 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:49:55.219 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:49:55.212+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:49:56.054 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:49:56.047+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:49:56.223 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:49:56.215+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:49:56.949 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:49:56.944+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:49:57.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:49:57.036+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:49:57.241 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:49:57.234+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:49:57.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:49:57.792+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:49:57.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:49:57.899+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:49:57.930 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:49:57.925+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:49:58.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:49:57.999+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:49:58.243 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:49:58.236+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:49:58.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:49:58.502+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:49:58.763 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:49:58.757+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:49:58.931 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:49:58.923+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:49:58.967 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:49:58.960+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:49:59.050 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:49:59.043+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:49:59.241 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:49:59.234+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:49:59.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:49:59.488+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:49:59.724 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:49:59.718+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:49:59.894 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:49:59.887+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:49:59.928 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:49:59.917+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:00.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:00.040+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:00.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:00.217+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:00.496 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:00.488+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:00.692 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:00.685+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:00.894 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:00.887+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:00.963 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:00.955+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:01.086 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:01.076+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:01.202 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:01.194+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:01.463 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:01.456+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:01.661 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:01.653+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:01.924 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:01.916+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:01.977 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:01.970+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:02.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:02.064+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:02.163 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:02.156+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:02.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:02.468+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:02.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:02.623+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:02.914 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:02.907+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:02.989 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:02.979+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:03.082 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:03.066+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:03.204 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:03.196+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:03.527 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:03.519+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:03.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:03.597+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:03.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:03.894+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:04.032 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:04.024+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:04.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:04.111+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:04.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:04.232+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:04.481 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:04.473+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:04.624 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:04.618+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:04.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:04.914+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:05.072 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:05.065+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:05.103 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:05.096+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:05.197 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:05.190+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:05.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:05.471+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:05.654 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:05.646+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:05.958 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:05.951+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:06.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:06.054+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:06.073 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:06.067+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:06.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:06.235+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:06.516 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:06.508+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:06.612 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:06.605+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:06.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:06.922+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:07.043 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:07.035+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:07.075 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:07.067+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:07.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:07.256+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:07.488 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:07.481+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:07.599 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:07.593+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:07.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:07.896+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:08.061 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:08.054+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:08.081 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:08.073+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:08.285 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:08.278+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:08.454 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:08.447+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:08.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:08.551+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:08.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:08.895+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:09.040 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:09.033+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:09.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:09.070+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:09.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:09.256+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:09.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:09.406+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:09.522 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:09.515+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:09.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:09.860+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:10.043 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:10.035+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:10.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:10.063+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:10.279 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:10.271+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:10.446 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:10.438+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:10.555 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:10.547+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:10.854 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:10.846+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:11.010 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:11.004+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:11.104 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:11.095+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:11.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:11.261+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:11.420 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:11.413+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:11.589 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:11.583+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:11.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:11.857+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:12.039 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:12.031+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:12.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:12.062+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:12.313 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:12.305+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:12.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:12.441+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:12.619 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:12.611+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:12.875 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:12.867+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:13.025 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:13.017+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:13.093 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:13.081+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:13.276 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:13.269+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:13.433 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:13.425+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:13.585 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:13.578+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:13.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:13.860+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:14.049 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:14.042+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:14.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:14.112+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:14.300 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:14.287+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:14.399 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:14.390+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:14.630 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:14.624+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:14.887 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:14.880+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:15.057 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:15.050+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:15.160 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:15.153+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:15.346 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:15.339+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:15.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:15.419+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:15.653 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:15.636+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:15.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:15.851+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:16.024 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:16.017+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:16.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:16.140+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:16.361 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:16.353+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:16.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:16.450+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:16.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:16.627+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:16.886 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:16.872+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:16.982 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:16.976+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:17.191 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:17.185+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:17.373 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:17.366+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:17.467 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:17.461+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:17.614 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:17.606+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:17.914 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:17.907+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:17.993 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:17.985+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:18.152 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:18.145+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:18.376 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:18.368+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:18.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:18.442+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:18.632 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:18.625+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:18.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:18.889+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:19.012 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:19.001+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:19.159 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:19.153+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:19.383 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:19.376+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:19.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:19.482+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:19.669 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:19.662+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:19.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:19.871+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:20.047 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:20.039+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:20.197 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:20.189+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:20.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:20.409+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:20.452 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:20.444+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:20.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:20.717+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:20.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:20.860+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:21.049 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:21.043+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:21.158 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:21.151+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:21.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:21.434+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:21.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:21.476+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:21.721 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:21.714+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:21.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:21.840+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:22.028 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:22.019+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:22.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:22.177+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:22.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:22.482+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:22.493 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:22.486+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:22.764 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:22.756+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:22.830 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:22.823+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:23.001 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:22.994+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:23.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:23.170+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:23.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:23.453+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:23.480 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:23.472+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:23.793 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:23.786+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:23.800 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:23.793+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:23.979 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:23.971+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:24.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:24.223+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:24.457 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:24.450+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:24.509 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:24.502+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:24.773 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:24.766+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:24.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:24.800+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:25.007 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:25.000+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:25.281 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:25.273+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:25.499 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:25.492+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:25.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:25.547+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:25.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:25.812+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:25.823 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:25.817+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:25.977 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:25.969+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:26.298 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:26.290+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:26.464 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:26.456+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:26.536 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:26.527+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:26.796 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:26.788+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:26.834 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:26.826+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:26.944 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:26.937+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:27.332 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:27.324+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:27.441 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:27.434+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:27.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:27.553+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:27.808 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:27.800+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:27.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:27.841+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:27.941 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:27.922+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:28.342 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:28.334+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:28.408 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:28.400+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:28.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:28.598+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:28.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:28.760+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:28.868 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:28.861+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:28.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:28.959+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:29.164 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:50:29.157+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e831 v831) 2019-11-29T19:50:29.301 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:29.294+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:29.420 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:29.411+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:29.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:29.629+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:29.752 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:29.744+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:29.874 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:29.866+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:29.945 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:29.938+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:30.268 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:30.260+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:30.381 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:30.373+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:30.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:30.670+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:30.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:30.724+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:30.841 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:30.834+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:30.926 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:30.919+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:31.258 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:31.252+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:31.432 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:31.425+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:31.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:31.678+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:31.781 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:31.772+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:31.833 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:31.824+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:31.956 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:31.950+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:32.227 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:32.220+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:32.465 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:32.456+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:32.668 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:32.660+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:32.742 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:32.734+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:32.804 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:32.796+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:32.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:32.958+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:33.218 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:33.209+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:33.495 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:33.485+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:33.655 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:33.646+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:33.773 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:50:33.766+0000 1694c700 -1 osd.2 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:10.591441+0000 front 2019-11-29T19:49:10.809231+0000 (oldest deadline 2019-11-29T19:50:33.226393+0000) 2019-11-29T19:50:33.786 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:50:33.777+0000 1694c700 -1 osd.7 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.122629+0000 front 2019-11-29T19:49:12.754589+0000 (oldest deadline 2019-11-29T19:49:57.425186+0000) 2019-11-29T19:50:33.839 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:50:33.832+0000 1694c700 -1 osd.6 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.967307+0000 front 2019-11-29T19:49:13.964935+0000 (oldest deadline 2019-11-29T19:49:57.135943+0000) 2019-11-29T19:50:33.971 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:50:33.963+0000 1694c700 -1 osd.3 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.933274+0000 front 2019-11-29T19:49:13.964906+0000 (oldest deadline 2019-11-29T19:49:56.195299+0000) 2019-11-29T19:50:34.231 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:50:34.224+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e831 v831) 2019-11-29T19:50:34.251 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:50:34.245+0000 1694c700 -1 osd.1 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.841620+0000 front 2019-11-29T19:49:13.842222+0000 (oldest deadline 2019-11-29T19:49:55.499735+0000) 2019-11-29T19:50:34.505 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:50:34.499+0000 1694c700 -1 osd.5 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:13.946109+0000 front 2019-11-29T19:49:13.101031+0000 (oldest deadline 2019-11-29T19:49:58.479247+0000) 2019-11-29T19:50:34.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:50:34.611+0000 1694c700 -1 osd.4 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:11.143763+0000 front 2019-11-29T19:49:11.006373+0000 (oldest deadline 2019-11-29T19:49:54.469661+0000) 2019-11-29T19:50:34.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:50:34.805+0000 1694c700 -1 osd.2 831 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:49:10.591441+0000 front 2019-11-29T19:49:10.809231+0000 (oldest deadline 2019-11-29T19:50:33.226393+0000) 2019-11-29T19:51:31.127 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:31.122+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:32.131 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:32.126+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:32.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:32.800+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:33.157 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:33.152+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:33.776 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:33.769+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:33.798 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:33.792+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:34.120 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:34.113+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:34.335 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:34.329+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:34.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:34.684+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:34.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:34.769+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:34.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:34.794+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:35.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:35.126+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:35.266 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:35.259+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:35.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:35.300+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:35.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:35.661+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:35.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:35.726+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:35.793 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:35.787+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:36.105 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:36.099+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:36.271 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:36.264+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:36.300 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:36.291+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:36.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:36.671+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:36.700 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:36.690+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:36.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:36.745+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:36.835 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:36.829+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:37.060 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:37.054+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:37.294 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:37.287+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:37.341 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:37.334+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:37.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:37.669+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:37.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:37.676+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:37.752 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:37.745+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:37.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:37.880+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:38.089 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:38.083+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:38.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:38.086+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:38.268 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:38.260+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:38.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:38.321+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:38.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:38.648+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:38.676 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:38.669+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:38.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:38.703+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:38.935 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:38.928+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:39.041+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:39.043+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:39.243 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:39.237+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:39.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:39.356+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:39.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:39.621+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:39.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:39.648+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:39.758 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:39.751+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:39.941 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:39.935+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:40.052 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:40.044+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:40.053 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:40.047+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:40.284 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:40.277+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:40.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:40.375+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:40.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:40.664+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:40.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:40.665+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:40.728 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:40.722+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:40.967 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:40.955+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:41.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:41.029+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:41.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:41.032+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:41.240 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:41.234+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:41.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:41.422+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:41.627 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:41.619+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:41.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:41.629+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:41.693 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:41.687+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:41.945 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:41.937+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:42.091 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:42.081+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:42.100 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:42.089+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:42.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:42.192+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:42.465 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:42.458+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:42.635 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:42.629+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:42.656 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:42.649+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:42.672 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:42.665+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:42.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:42.901+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:43.064 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:43.056+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:43.065 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:43.058+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:43.172 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:43.166+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:43.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:43.506+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:43.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:43.621+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:43.673 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:43.665+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:43.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:43.709+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:43.945 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:43.938+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:44.077 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:44.070+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:44.079 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:44.073+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:44.152 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:44.144+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:44.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:44.521+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:44.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:44.579+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:44.670 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:44.665+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:44.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:44.680+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:44.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:44.896+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:45.085 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:45.078+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:45.086 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:45.079+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:45.185 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:45.178+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:45.532 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:45.521+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:45.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:45.624+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:45.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:45.685+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:45.709 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:45.703+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:45.902 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:45.895+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:46.075 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:46.065+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:46.075 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:46.068+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:46.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:46.184+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:46.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:46.518+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:46.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:46.586+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:46.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:46.734+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:46.747 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:46.741+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:46.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:46.852+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:47.103 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:47.096+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:47.104 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:47.098+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:47.173 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:47.167+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:47.520 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:47.513+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:47.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:47.579+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:47.778 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:47.772+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:47.787 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:47.780+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:47.910 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:47.903+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:48.089 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:48.082+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:48.090 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:48.084+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:48.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:48.207+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:48.512 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:48.505+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:48.573 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:48.566+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:48.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:48.780+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:48.817 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:48.810+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:48.874 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:48.868+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:49.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:49.105+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:49.114 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:49.108+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:49.212 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:49.205+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:49.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:49.471+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:49.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:49.545+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:49.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:49.756+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:49.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:49.781+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:49.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:49.905+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:50.134 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:50.126+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:50.134 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:50.127+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:50.252 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:50.243+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:50.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:50.492+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:50.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:50.595+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:50.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:50.776+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:50.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:50.824+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:50.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:50.861+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:51.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:51.105+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:51.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:51.107+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:51.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:51.246+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:51.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:51.542+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:51.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:51.633+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:51.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:51.817+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:51.826 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:51.819+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:51.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:51.876+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:52.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:52.103+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:52.110 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:52.104+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:52.304 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:52.299+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:52.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:52.497+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:52.622 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:52.611+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:52.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:52.799+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:52.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:52.810+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:52.906 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:52.900+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:53.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:53.144+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:53.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:53.145+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:53.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:53.310+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:53.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:53.492+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:53.591 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:53.584+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:53.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:53.809+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:53.826 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:53.820+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:53.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:53.887+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:54.123 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:54.116+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:54.125 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:54.118+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:54.310 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:54.303+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:54.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:54.480+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:54.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:54.618+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:54.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:54.805+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:54.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:54.851+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:54.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:54.876+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:55.152 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:55.145+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:55.152 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:55.146+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:55.351 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:55.345+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:55.522 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:55.515+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:55.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:55.583+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:55.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:55.832+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:55.846 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:55.838+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:55.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:55.870+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:56.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:56.105+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:56.113 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:56.107+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:56.404 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:56.398+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:56.574 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:56.566+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:56.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:56.596+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:56.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:56.824+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:56.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:56.869+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:56.881 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:56.874+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:57.094 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:57.087+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:57.095 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:57.089+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:57.370 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:57.363+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:57.570 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:57.563+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:57.653 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:57.647+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:57.846 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:57.839+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:57.863 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:57.856+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:57.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:57.914+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:58.133 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:58.112+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:58.134 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:58.114+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:58.372 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:58.365+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:58.532 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:58.525+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:58.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:58.634+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:58.874 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:58.867+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:58.886 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:58.879+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:58.901 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:58.894+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:51:59.165 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:59.155+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:51:59.166 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:51:59.158+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:51:59.371 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:51:59.362+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:51:59.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:51:59.538+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:51:59.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:51:59.593+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:51:59.854 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:51:59.846+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:51:59.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:51:59.890+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:51:59.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:51:59.908+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:00.171 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:00.164+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:00.174 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:00.168+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:00.365 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:00.358+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:00.538 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:00.532+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:00.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:00.630+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:00.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:00.861+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:00.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:00.871+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:00.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:00.883+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:01.153 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:01.143+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:01.154 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:01.145+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:01.400 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:01.389+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:01.588 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:01.580+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:01.656 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:01.648+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:01.844 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:01.837+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:01.850 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:01.844+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:01.912 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:01.903+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:02.123 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:02.116+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:02.123 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:02.117+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:02.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:02.414+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:02.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:02.596+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:02.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:02.684+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:02.881 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:02.874+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:02.889 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:02.882+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:02.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:02.898+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:03.087 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:03.079+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:03.088 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:03.081+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:03.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:03.401+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:03.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:03.574+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:03.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:03.696+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:03.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:03.901+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:03.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:03.924+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:03.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:03.941+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:04.081 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:04.073+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:04.082 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:04.076+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:04.398 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:04.389+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:04.521 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:52:04.515+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e837 v837) 2019-11-29T19:52:04.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:04.551+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:04.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:04.711+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:04.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:04.901+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:04.944 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:04.936+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:04.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:04.958+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:05.045 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:05.038+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:05.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:05.042+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:05.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:05.402+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:05.525 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:05.518+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:05.693 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:05.686+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:05.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:05.895+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:05.974 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:05.963+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:06.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:05.995+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:06.015 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:06.009+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:06.019 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:06.013+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:06.395 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:06.388+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:06.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:06.491+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:06.713 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:06.690+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:06.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:06.861+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:06.956 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:06.950+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:06.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:06.992+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:06.999 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:06.993+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:07.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:07.012+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:07.371 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:07.363+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:07.503 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:07.495+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:07.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:07.711+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:07.823 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:07.816+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:07.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:07.940+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:08.006 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:07.999+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:08.007 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:08.001+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:08.058 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:08.051+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:08.391 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:08.383+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:08.552 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:08.544+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:08.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:52:08.729+0000 1694c700 -1 osd.4 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.863564+0000 front 2019-11-29T19:50:51.916909+0000 (oldest deadline 2019-11-29T19:51:36.547295+0000) 2019-11-29T19:52:08.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:08.787+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:08.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:08.897+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:08.964 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:08.958+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:08.965 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:08.959+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:09.025 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:09.019+0000 1694c700 -1 osd.1 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:48.821584+0000 front 2019-11-29T19:50:48.589788+0000 (oldest deadline 2019-11-29T19:51:34.257303+0000) 2019-11-29T19:52:09.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:52:09.371+0000 1694c700 -1 osd.6 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:49.043110+0000 front 2019-11-29T19:50:49.045613+0000 (oldest deadline 2019-11-29T19:51:34.688134+0000) 2019-11-29T19:52:09.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:52:09.545+0000 1694c700 -1 osd.7 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:51.318348+0000 front 2019-11-29T19:50:51.278441+0000 (oldest deadline 2019-11-29T19:51:34.068250+0000) 2019-11-29T19:52:09.597 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:52:09.581+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 43sec e837 v837) 2019-11-29T19:52:09.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:52:09.804+0000 1694c700 -1 osd.2 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.251346+0000 front 2019-11-29T19:50:50.176512+0000 (oldest deadline 2019-11-29T19:51:33.664085+0000) 2019-11-29T19:52:09.906 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:52:09.899+0000 1694c700 -1 osd.5 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:50:50.474478+0000 front 2019-11-29T19:50:50.488895+0000 (oldest deadline 2019-11-29T19:51:32.726897+0000) 2019-11-29T19:52:09.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:09.930+0000 1694c700 -1 osd.0 837 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:50:57.724459+0000 (oldest deadline 2019-11-29T19:51:37.724459+0000) 2019-11-29T19:52:09.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:09.936+0000 1694c700 -1 osd.0 837 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:10.972 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:52:10.903+0000 1694c700 -1 osd.0 838 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:121335 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e835) 2019-11-29T19:52:40.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:52:40.569+0000 1694c700 -1 osd.1 839 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:123436 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821331152 gen 162] snapc 0=[] ondisk+write+known_if_redirected e838) 2019-11-29T19:52:45.796 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:45.757+0000 33787700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:45.844 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:45.826+0000 33f88700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:45.912 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:45.897+0000 3578b700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:45.935 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:45.927+0000 36f8e700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.003 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:45.969+0000 3678d700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.030 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.007+0000 34789700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.059 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.045+0000 32785700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.097 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.090+0000 32f86700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.146 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.127+0000 31783700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.221 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.190+0000 31783700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.244 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.239+0000 114ab700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.307 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.300+0000 35f8c700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.402 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.347+0000 124ad700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.525 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.448+0000 30f82700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:46.611 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:46.579+0000 37f90700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:48.138 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:52:48.132+0000 34f8a700 -1 osd.3 842 build_incremental_map_msg missing incremental map 842 2019-11-29T19:52:56.340 INFO:teuthology.orchestra.run.smithi182.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-11-29T19:53:47.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:47.199+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:47.546 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:47.539+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:47.688 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:47.680+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:48.193 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:48.186+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:48.596 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:48.589+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:48.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:48.707+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:48.841 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:48.835+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:49.225 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:49.217+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:49.361 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:49.344+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:49.405 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:49.399+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:49.561 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:49.549+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:49.631 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:49.624+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:49.732 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:49.725+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:49.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:49.802+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:50.047 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:37:58.182 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.055 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:37:58.190 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.062 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:37:58.243 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.067 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:37:58.248 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.072 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:37:58.252 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.078 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:37:58.259 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:50.197+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:50.306 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:37:58.486 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.317 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:37:58.498 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:50.313+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:50.394 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:37:58.528 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:53:50.456 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:50.449+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:50.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:50.530+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:50.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:50.622+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:50.722 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:50.715+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:50.811 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:50.805+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:51.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:51.228+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:51.351 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:51.346+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:51.476 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:51.470+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:51.549 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:51.542+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:51.607 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:51.599+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:51.727 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:51.721+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:51.768 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:51.762+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:52.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:52.198+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:52.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:52.302+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:52.480 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:52.473+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:52.546 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:52.540+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:52.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:52.647+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:52.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:52.766+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:52.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:52.767+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:53.234 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:53.227+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:53.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:53.295+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:53.493 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:53.485+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:53.507 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:53.499+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:53.612 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:53.606+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:53.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:53.763+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:53.775 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:53.769+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:54.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:54.203+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:54.296 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:54.289+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:54.507 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:54.500+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:54.527 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:54.522+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:54.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:54.559+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:54.738 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:54.730+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:54.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:54.751+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:55.178 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:55.172+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:55.307 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:55.298+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:55.496 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:55.490+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:55.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:55.528+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:55.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:55.548+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:55.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:55.709+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:55.746 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:55.739+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:56.176 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:56.168+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:56.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:56.265+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:56.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:56.500+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:56.511 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:56.503+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:56.546 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:56.539+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:56.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:56.720+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:56.745 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:56.738+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:57.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:57.148+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:57.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:57.277+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:57.544 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:57.535+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:57.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:57.549+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:57.567 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:57.559+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:57.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:57.712+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:57.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:57.725+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:58.129 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:58.122+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:58.314 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:58.306+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:58.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:58.527+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:58.545 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:58.539+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:58.566 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:58.559+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:58.694 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:58.687+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:58.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:58.758+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:53:59.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:53:59.107+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:53:59.349 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:53:59.342+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:53:59.568 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:53:59.561+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:53:59.571 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:53:59.565+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:53:59.582 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:53:59.575+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:53:59.711 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:53:59.704+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:53:59.796 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:53:59.788+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:00.118 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:00.110+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:00.324 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:00.318+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:00.552 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:00.544+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:00.590 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:00.584+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:00.608 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:00.602+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:00.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:00.701+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:00.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:00.751+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:01.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:01.132+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:01.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:01.343+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:01.513 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:01.507+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:01.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:01.555+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:01.629 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:01.620+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:01.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:01.717+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:01.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:01.782+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:02.160 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:02.152+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:02.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:02.379+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:02.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:02.501+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:02.598 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:02.592+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:02.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:02.648+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:02.775 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:02.768+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:02.793 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:02.785+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:03.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:03.154+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:03.343 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:03.336+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:03.479 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:03.472+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:03.569 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:03.562+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:03.614 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:03.607+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:03.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:03.756+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:03.792 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:03.785+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:04.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:04.135+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:04.390 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:04.383+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:04.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:04.508+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:04.536 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:04.530+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:04.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:04.634+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:04.726 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:04.719+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:04.770 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:04.763+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:05.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:05.103+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:05.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:05.384+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:05.552 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:05.544+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:05.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:05.557+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:05.637 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:05.630+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:05.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:05.679+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:05.803 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:05.792+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:06.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:06.147+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:06.403 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:06.396+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:06.547 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:06.541+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:06.556 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:06.549+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:06.624 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:06.616+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:06.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:06.638+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:06.810 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:06.802+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:07.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:07.183+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:07.442 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:07.434+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:07.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:07.498+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:07.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:07.519+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:07.606 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:07.599+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:07.614 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:07.606+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:07.796 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:07.788+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:08.183 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:08.176+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:08.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:08.402+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:08.460 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:08.452+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:08.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:08.569+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:08.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:08.650+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:08.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:08.651+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:08.942 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:08.753+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:09.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:09.186+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:09.403 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:09.397+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:09.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:09.461+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:09.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:09.596+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:09.652 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:09.645+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:09.692 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:09.687+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:09.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:09.769+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:10.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:10.200+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:10.435 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:10.428+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:10.480 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:10.473+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:10.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:10.621+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:10.684 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:10.673+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:10.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:10.686+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:10.793 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:10.786+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:11.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:11.245+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:11.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:11.421+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:11.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:11.436+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:11.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:11.660+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:11.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:11.664+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:11.720 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:11.712+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:11.796 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:11.788+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:12.275 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:12.267+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:12.454 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:12.447+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:12.465 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:12.458+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:12.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:12.638+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:12.646 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:12.639+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:12.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:12.725+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:12.767 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:12.760+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:13.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:13.251+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:13.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:13.500+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:13.514 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:13.508+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:13.629 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:13.621+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:13.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:13.674+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:13.691 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:13.684+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:13.820 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:13.813+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:14.229 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:14.221+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:14.509 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:14.502+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:14.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:14.532+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:14.652 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:14.644+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:14.666 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:14.659+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:14.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:14.665+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:14.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:14.862+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:15.241 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:15.234+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:15.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:15.526+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:15.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:15.528+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:15.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:15.621+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:15.704 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:15.698+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:15.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:15.705+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:15.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:15.890+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:16.275 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:16.268+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:16.542 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:16.536+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:16.550 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:16.543+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:16.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:16.632+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:16.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:16.653+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:16.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:16.729+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:16.871 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:16.861+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:17.262 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:17.253+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:17.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:17.517+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:17.572 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:17.565+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:17.618 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:17.612+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:17.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:17.656+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:17.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:17.752+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:17.846 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:17.839+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:18.242 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:18.234+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:18.542 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:18.535+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:18.556 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:18.548+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:18.632 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:18.625+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:18.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:18.641+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:18.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:18.746+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:18.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:18.846+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:19.225 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:19.217+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:19.536 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:54:19.530+0000 1694c700 -1 osd.3 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.201530+0000 front 2019-11-29T19:53:05.249947+0000 (oldest deadline 2019-11-29T19:53:49.191807+0000) 2019-11-29T19:54:19.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:19.567+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:19.614 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:19.607+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:19.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:19.637+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:54:19.779 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:54:19.771+0000 1694c700 -1 osd.1 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.892526+0000 front 2019-11-29T19:53:05.884917+0000 (oldest deadline 2019-11-29T19:53:49.562094+0000) 2019-11-29T19:54:19.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:54:19.805+0000 1694c700 -1 osd.7 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.704119+0000 front 2019-11-29T19:53:04.705751+0000 (oldest deadline 2019-11-29T19:53:48.659796+0000) 2019-11-29T19:54:20.028 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:54:20.022+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e842 v842) 2019-11-29T19:54:20.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:54:20.227+0000 1694c700 -1 osd.6 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:01.937113+0000 front 2019-11-29T19:53:01.893219+0000 (oldest deadline 2019-11-29T19:53:47.191334+0000) 2019-11-29T19:54:20.598 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:54:20.590+0000 1694c700 -1 osd.5 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:05.387066+0000 front 2019-11-29T19:53:05.410326+0000 (oldest deadline 2019-11-29T19:53:48.858534+0000) 2019-11-29T19:54:20.598 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:54:20.592+0000 1694c700 -1 osd.2 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.702783+0000 front 2019-11-29T19:53:04.372512+0000 (oldest deadline 2019-11-29T19:53:47.237927+0000) 2019-11-29T19:54:20.641 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:54:20.631+0000 1694c700 -1 osd.4 842 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:53:04.657000+0000 front 2019-11-29T19:53:04.310316+0000 (oldest deadline 2019-11-29T19:53:47.488219+0000) 2019-11-29T19:55:18.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:18.517+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:18.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:18.825+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:19.221 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:19.214+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:19.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:19.522+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:19.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:19.798+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:20.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:20.231+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:20.267 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:20.259+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:20.507 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:20.500+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:20.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:20.812+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:21.204 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:21.198+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:21.289 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:21.279+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:21.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:21.498+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:21.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:21.832+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:22.150 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:22.143+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:22.248 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:22.241+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:22.332 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:22.323+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:22.348 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:22.342+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:22.501 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:22.494+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:22.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:22.858+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:23.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:23.101+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:23.233 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:23.226+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:23.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:23.342+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:23.376 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:23.359+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:23.507 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:23.493+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:23.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:23.848+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:24.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:24.095+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:24.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:24.280+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:24.356 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:24.349+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:24.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:24.371+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:24.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:24.404+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:24.482 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:24.475+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:24.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:24.822+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:25.073 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:25.067+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:25.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:25.249+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:25.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:25.374+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:25.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:25.420+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:25.444 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:25.437+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:25.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:25.471+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:25.853 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:25.846+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:26.067 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:26.059+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:26.281 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:26.269+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:26.378 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:26.372+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:26.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:26.394+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:26.468 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:26.461+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:26.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:26.512+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:26.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:26.811+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:27.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:27.051+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:27.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:27.285+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:27.344 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:27.338+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:27.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:27.438+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:27.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:27.443+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:27.532 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:27.526+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:27.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:27.776+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:28.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:28.040+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:28.264 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:28.257+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:28.304 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:28.297+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:28.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:28.402+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:28.473 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:28.465+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:28.545 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:28.538+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:28.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:28.789+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:29.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:29.027+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:29.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:29.289+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:29.307 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:29.301+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:29.414 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:29.408+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:29.519 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:29.508+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:29.537 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:29.532+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:29.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:29.749+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:30.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:30.057+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:30.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:30.262+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:30.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:30.298+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:30.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:30.462+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:30.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:30.499+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:30.526 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:30.521+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:30.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:30.742+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:31.033 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:31.020+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:31.227 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:31.220+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:31.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:31.344+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:31.427 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:31.421+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:31.530 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:31.524+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:31.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:31.527+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:31.749 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:31.742+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:32.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:31.997+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:32.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:32.216+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:32.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:32.354+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:32.448 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:32.442+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:32.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:32.490+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:32.497 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:32.492+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:32.528 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:32.522+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:32.744 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:32.737+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:32.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:32.979+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:33.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:33.219+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:33.351 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:33.343+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:33.473 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:33.464+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:33.473 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:33.467+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:33.491 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:33.484+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:33.571 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:33.564+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:33.720 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:33.713+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:34.012 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:34.004+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:34.185 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:34.179+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:34.386 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:34.379+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:34.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:34.426+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:34.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:34.429+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:34.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:34.451+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:34.626 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:34.613+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:34.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:34.742+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:34.975 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:34.968+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:35.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:35.189+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:35.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:35.342+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:35.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:35.439+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:35.446 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:35.441+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:35.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:35.456+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:35.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:35.581+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:35.733 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:35.725+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:35.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:35.965+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:36.168 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:36.161+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:36.372 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:36.350+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:36.425 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:36.418+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:36.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:36.419+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:36.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:36.456+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:36.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:36.604+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:36.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:36.757+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:37.004 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:36.997+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:37.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:37.157+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:37.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:37.352+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:37.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:37.423+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:37.430 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:37.424+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:37.484 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:37.478+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:37.613 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:37.606+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:37.794 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:37.788+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:38.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:38.024+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:38.122 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:38.112+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:38.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:38.384+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:38.465 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:38.457+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:38.465 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:38.459+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:38.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:38.487+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:38.626 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:38.613+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:38.812 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:38.806+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:39.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:39.035+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:39.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:39.137+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:39.355 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:39.349+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:39.510 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:39.503+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:39.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:39.507+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:39.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:39.510+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:39.625 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:39.619+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:39.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:39.781+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:40.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:40.070+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:40.155 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:40.149+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:40.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:40.341+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:40.485 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:40.478+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:40.528 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:40.521+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:40.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:40.523+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:40.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:40.623+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:40.822 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:40.815+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:41.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:41.102+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:41.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:41.111+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:41.313 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:41.306+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:41.458 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:41.452+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:41.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:41.555+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:41.564 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:41.557+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:41.654 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:41.647+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:41.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:41.837+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:42.107 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:42.101+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:42.114 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:42.108+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:42.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:42.349+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:42.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:42.489+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:42.601 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:42.595+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:42.603 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:42.598+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:42.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:42.670+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:42.878 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:42.871+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:43.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:43.106+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:43.136 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:43.130+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:43.392 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:43.385+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:43.468 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:43.462+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:43.558 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:43.551+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:43.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:43.556+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:43.699 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:43.692+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:43.854 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:43.848+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:44.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:44.129+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:44.148 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:44.141+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:44.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:44.420+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:44.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:44.419+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:44.555 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:44.548+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:44.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:44.551+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:44.750 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:44.743+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:44.822 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:44.816+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:45.114 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:45.107+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:45.136 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:45.129+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:45.434 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:45.427+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:45.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:45.448+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:45.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:45.553+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:45.563 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:45.557+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:45.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:45.733+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:45.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:45.822+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:46.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:46.122+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:46.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:46.160+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:46.414 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:46.408+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:46.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:46.443+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:46.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:46.521+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:46.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:46.523+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:46.753 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:46.746+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:46.812 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:46.805+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:47.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:47.096+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:47.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:47.151+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:47.443 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:47.437+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:47.448 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:47.442+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:47.493 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:47.487+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:47.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:47.489+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:47.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:47.725+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:47.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:47.813+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:48.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:48.104+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:48.158 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:48.151+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:48.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:48.436+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:48.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:48.437+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:48.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:48.476+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:48.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:48.478+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:48.751 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:48.744+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:48.845 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:48.837+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:49.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:49.140+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:49.207 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:49.192+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:49.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:49.402+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:49.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:49.457+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:49.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:49.458+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:49.466 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:49.460+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:49.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:49.768+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:49.804 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:49.795+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:50.160 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:50.154+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:50.258 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:50.245+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:50.407 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:50.399+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:50.423 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:50.416+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:50.424 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:50.418+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:50.482 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:50.475+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:50.628 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:55:50.620+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e848 v848) 2019-11-29T19:55:50.705 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:39:58.839 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.714 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:39:58.849 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.763 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:39:58.943 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:50.757+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:50.764 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:39:58.945 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.765 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:39:58.946 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.769 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:39:58.949 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:50.813+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:50.850 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:39:58.985 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.865 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:39:59.045 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:50.889 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:39:59.069 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:55:51.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:51.195+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:51.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:51.237+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:51.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:51.407+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:51.452 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:51.446+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:51.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:51.447+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:51.469 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:51.462+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:51.761 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:51.753+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:51.877 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:51.870+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:52.194 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:52.188+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:52.279 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:52.273+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:52.444 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:52.437+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:52.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:52.477+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:52.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:52.479+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:52.496 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:52.490+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:52.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:52.774+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:52.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:52.884+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:53.179 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:53.173+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:53.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:53.249+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:53.489 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:53.481+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:53.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:53.486+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:53.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:53.505+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:53.515 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:53.509+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:53.801 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:53.794+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:53.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:53.843+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:54.134 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:54.128+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:54.287 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:54.279+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:54.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:54.486+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:54.497 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:54.489+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:54.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:54.499+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:54.515 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:54.500+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:54.827 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:54.819+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:54.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:54.838+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:55.143 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:55.136+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:55.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:55.286+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:55.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:55.483+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:55.533 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:55.528+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:55.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:55.547+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:55.556 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:55.550+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:55.646 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:55:55.637+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e848 v848) 2019-11-29T19:55:55.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:55.777+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:55.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:55.856+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:56.166 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:56.160+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:56.269 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:56.262+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:56.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:56.497+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:56.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:56.520+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:56.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:56.522+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:56.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:56.530+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:56.764 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:56.756+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:56.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:56.835+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:57.139 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:57.131+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:57.292 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:57.284+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:57.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:57.525+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:57.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:57.527+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:57.536 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:57.530+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:57.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:57.542+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:57.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:57.748+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:57.835 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:57.827+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:58.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:58.133+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:58.305 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:58.298+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:58.526 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:58.518+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:58.527 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:58.521+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:58.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:58.537+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:58.588 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:58.581+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:58.791 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:58.784+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:58.876 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:58.865+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:55:59.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:55:59.113+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:55:59.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:55:59.257+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:55:59.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:59.473+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:55:59.480 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:55:59.475+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:55:59.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:55:59.540+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:55:59.617 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:55:59.611+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:55:59.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:55:59.833+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:55:59.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:55:59.893+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:00.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:00.102+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:00.254 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:00.247+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:00.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:00.523+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:00.531 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:00.525+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:00.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:00.584+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:00.622 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:00.615+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:00.658 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:56:00.653+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e848 v848) 2019-11-29T19:56:00.815 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:00.809+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:00.941 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:56:00.935+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:01.104 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:01.098+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:01.255 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:01.248+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:01.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:01.487+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:01.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:01.490+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:01.578 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:01.571+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:01.586 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:01.580+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:01.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:01.768+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:01.982 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:56:01.974+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:02.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:02.055+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:02.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:02.237+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:02.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:02.501+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:02.508 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:02.503+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:02.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:02.557+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:02.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:02.629+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:02.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:02.809+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:02.958 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:56:02.951+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:03.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:03.029+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:03.253 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:03.246+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:03.486 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:03.479+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:03.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:03.480+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:03.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:03.597+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:03.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:03.676+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:03.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:03.825+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:03.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:56:03.967+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:04.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:04.038+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:04.292 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:04.284+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:04.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:04.447+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:04.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:04.449+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:04.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:04.581+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:04.672 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:04.665+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:04.870 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:04.863+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:04.974 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:56:04.967+0000 1694c700 -1 osd.6 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.150242+0000 front 2019-11-29T19:54:35.049263+0000 (oldest deadline 2019-11-29T19:55:18.487023+0000) 2019-11-29T19:56:05.097 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:56:05.090+0000 1694c700 -1 osd.1 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.253867+0000 front 2019-11-29T19:54:36.300185+0000 (oldest deadline 2019-11-29T19:55:22.020099+0000) 2019-11-29T19:56:05.273 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:05.266+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:05.471 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:05.465+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:05.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:05.466+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:05.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:56:05.554+0000 1694c700 -1 osd.7 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:34.604575+0000 front 2019-11-29T19:54:34.664169+0000 (oldest deadline 2019-11-29T19:55:18.682433+0000) 2019-11-29T19:56:05.633 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:56:05.625+0000 1694c700 -1 osd.2 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.441275+0000 front 2019-11-29T19:54:35.560557+0000 (oldest deadline 2019-11-29T19:55:21.330018+0000) 2019-11-29T19:56:05.752 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:56:05.737+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e848 v848) 2019-11-29T19:56:05.826 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:56:05.819+0000 1694c700 -1 osd.5 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:36.524939+0000 front 2019-11-29T19:54:36.389538+0000 (oldest deadline 2019-11-29T19:55:18.557140+0000) 2019-11-29T19:56:06.239 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:56:06.232+0000 1694c700 -1 osd.4 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:54:35.075613+0000 front 2019-11-29T19:54:34.778399+0000 (oldest deadline 2019-11-29T19:55:20.027222+0000) 2019-11-29T19:56:06.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:06.424+0000 1694c700 -1 osd.0 848 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:54:51.649496+0000 (oldest deadline 2019-11-29T19:55:31.649496+0000) 2019-11-29T19:56:06.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:56:06.426+0000 1694c700 -1 osd.0 848 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e846) 2019-11-29T19:56:34.090 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:56:34.083+0000 31783700 -1 osd.3 853 build_incremental_map_msg missing incremental map 853 2019-11-29T19:56:34.218 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:56:34.200+0000 3578b700 -1 osd.3 853 build_incremental_map_msg missing incremental map 853 2019-11-29T19:56:34.867 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:56:34.824+0000 3578b700 -1 osd.3 853 build_incremental_map_msg missing incremental map 853 2019-11-29T19:56:35.242 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:56:35.236+0000 30f82700 -1 osd.3 853 build_incremental_map_msg missing incremental map 853 2019-11-29T19:56:37.903 INFO:teuthology.orchestra.run.smithi182.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-11-29T19:56:37.972 INFO:teuthology.orchestra.run.smithi182.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-11-29T19:57:33.424 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:33.403+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:34.356 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:34.348+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:34.403 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:34.395+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:34.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:34.867+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:35.230 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:35.222+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:35.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:35.387+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:35.401 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:35.393+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:35.631 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:35.625+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:35.911 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:35.903+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:36.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:36.191+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:36.390 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:36.383+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:36.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:36.394+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:36.640 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:36.633+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:36.665 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:36.659+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:36.872 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:36.865+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:37.175 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:37.168+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:37.353 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:37.346+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:37.433 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:37.425+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:37.619 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:37.613+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:37.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:37.632+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:37.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:37.834+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:37.846 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:37.841+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:38.153 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:38.144+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:38.345 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:38.337+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:38.478 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:38.471+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:38.625 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:38.618+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:38.628 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:38.622+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:38.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:38.852+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:38.868 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:38.862+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:39.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:39.132+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:39.389 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:39.383+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:39.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:39.520+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:39.596 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:39.589+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:39.625 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:39.618+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:39.826 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:39.818+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:39.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:39.857+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:40.172 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:40.165+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:40.439 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:40.430+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:40.530 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:40.523+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:40.608 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:40.600+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:40.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:40.641+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:40.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:40.855+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:40.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:40.890+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:41.146 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:41.139+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:41.393 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:41.384+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:41.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:41.480+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:41.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:41.615+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:41.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:41.660+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:41.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:41.843+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:41.856 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:41.845+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:42.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:42.114+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:42.410 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:42.403+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:42.541 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:42.534+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:42.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:42.636+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:42.648 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:42.639+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:42.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:42.870+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:42.880 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:42.872+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:43.080 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:43.073+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:43.376 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:43.369+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:43.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:43.535+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:43.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:43.630+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:43.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:43.675+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:43.876 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:43.869+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:43.895 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:43.887+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:44.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:44.102+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:44.417 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:44.410+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:44.530 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:44.522+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:44.661 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:44.655+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:44.730 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:44.723+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:44.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:44.843+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:44.887 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:44.880+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:45.109 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:45.101+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:45.411 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:45.405+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:45.506 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:41:53.641 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:45.510+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:45.520 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:41:53.701 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.522 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:41:53.702 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.522 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:41:53.658 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.524 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:41:53.704 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.528 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:41:53.708 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.647 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:41:53.828 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:45.642+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:45.665 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:41:53.845 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:45.677+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:45.687 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:41:53.822 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T19:57:45.867 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:45.860+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:45.924 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:45.917+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:46.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:46.074+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:46.462 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:46.455+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:46.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:46.522+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:46.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:46.630+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:46.694 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:46.688+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:46.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:46.901+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:46.928 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:46.922+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:47.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:47.030+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:47.461 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:47.454+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:47.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:47.541+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:47.684 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:47.678+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:47.700 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:47.693+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:47.922 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:47.915+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:47.964 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:47.957+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:48.042 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:48.034+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:48.471 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:48.462+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:48.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:48.522+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:48.699 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:48.692+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:48.730 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:48.722+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:48.913 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:48.905+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:48.998 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:48.991+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:49.061 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:49.053+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:49.446 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:49.440+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:49.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:49.545+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:49.673 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:49.665+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:49.699 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:49.692+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:49.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:49.901+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:50.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:50.006+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:50.063 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:50.056+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:50.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:50.455+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:50.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:50.597+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:50.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:50.663+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:50.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:50.706+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:50.950 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:50.943+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:51.043 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:51.031+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:51.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:51.041+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:51.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:51.437+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:51.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:51.615+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:51.671 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:51.664+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:51.718 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:51.712+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:51.921 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:51.914+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:52.023 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:52.015+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:52.036 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:52.028+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:52.491 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:52.484+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:52.596 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:52.586+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:52.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:52.639+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:52.749 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:52.743+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:52.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:52.926+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:53.037 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:53.020+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:53.078 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:53.070+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:53.488 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:53.479+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:53.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:53.593+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:53.648 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:53.642+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:53.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:53.748+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:53.986 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:53.976+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:54.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:54.065+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:54.113 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:54.106+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:54.520 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:54.512+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:54.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:54.570+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:54.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:54.669+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:54.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:54.751+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:54.958 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:54.950+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:55.083 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:55.076+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:55.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:55.129+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:55.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:55.532+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:55.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:55.596+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:55.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:55.640+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:55.744 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:55.733+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:55.924 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:55.917+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:56.122 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:56.112+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:56.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:56.125+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:56.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:56.498+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:56.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:56.577+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:56.642 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:56.637+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:56.706 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:56.700+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:56.966 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:56.956+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:57.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:57.148+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:57.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:57.156+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:57.541 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:57.515+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:57.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:57.578+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:57.618 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:57.612+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:57.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:57.680+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:57.991 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:57.984+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:58.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:58.197+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:58.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:58.206+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:58.489 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:58.482+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:58.571 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:58.564+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:58.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:58.624+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:58.730 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:58.724+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:57:59.042 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:57:59.035+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:57:59.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:57:59.224+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:57:59.258 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:57:59.250+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:57:59.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:57:59.499+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:57:59.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:57:59.538+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:57:59.660 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:57:59.653+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:57:59.775 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:57:59.768+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:00.084 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:58:00.077+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:58:00.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:00.224+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:00.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:00.242+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:00.500 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:00.492+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:00.530 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:00.522+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:00.669 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:00.662+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:00.778 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:00.771+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:01.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:58:01.040+0000 1694c700 -1 osd.5 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.404464+0000 front 2019-11-29T19:56:51.462169+0000 (oldest deadline 2019-11-29T19:57:37.259903+0000) 2019-11-29T19:58:01.244 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:01.236+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:01.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:01.259+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:01.486 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:01.480+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:01.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:01.529+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:01.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:01.651+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:01.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:01.729+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:02.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:02.204+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:02.308 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:02.300+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:02.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:02.523+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:02.585 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:02.577+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:02.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:02.617+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:02.717 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:02.711+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:03.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:03.173+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:03.307 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:03.301+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:03.575 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:03.568+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:03.610 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:03.604+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:03.642 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:03.635+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:03.719 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:03.713+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:04.209 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:04.202+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:04.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:04.326+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:04.531 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:04.525+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:04.651 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:04.644+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:04.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:04.650+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:04.674 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:04.668+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:05.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:05.199+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:05.323 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:05.316+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:05.549 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T19:58:05.542+0000 1694c700 -1 osd.3 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.609964+0000 front 2019-11-29T19:56:51.461169+0000 (oldest deadline 2019-11-29T19:57:33.090464+0000) 2019-11-29T19:58:05.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:58:05.620+0000 1694c700 -1 osd.2 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.225190+0000 front 2019-11-29T19:56:49.495651+0000 (oldest deadline 2019-11-29T19:57:34.684103+0000) 2019-11-29T19:58:05.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:05.654+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:58:05.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:58:05.678+0000 1694c700 -1 osd.1 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.089219+0000 front 2019-11-29T19:56:51.101208+0000 (oldest deadline 2019-11-29T19:57:35.747401+0000) 2019-11-29T19:58:06.193 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:58:06.186+0000 1694c700 -1 osd.6 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:49.496544+0000 front 2019-11-29T19:56:49.332033+0000 (oldest deadline 2019-11-29T19:57:34.726017+0000) 2019-11-29T19:58:06.276 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:58:06.263+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e854 v854) 2019-11-29T19:58:06.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:58:06.363+0000 1694c700 -1 osd.7 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.615977+0000 front 2019-11-29T19:56:52.095664+0000 (oldest deadline 2019-11-29T19:57:34.481966+0000) 2019-11-29T19:58:06.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:58:06.696+0000 1694c700 -1 osd.4 854 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T19:56:51.108980+0000 front 2019-11-29T19:56:51.349392+0000 (oldest deadline 2019-11-29T19:57:33.383704+0000) 2019-11-29T19:59:05.037 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:05.029+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:06.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:06.042+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:06.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:06.876+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:07.021 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:07.014+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:07.836 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:07.829+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:08.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:08.029+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:08.074 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:08.067+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:08.822 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:08.816+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:08.865 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:08.858+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:09.044 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:09.036+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:09.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:09.073+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:09.778 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:09.771+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:09.882 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:09.874+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:09.896 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:09.890+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:09.971 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:09.963+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:10.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:10.049+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:10.079 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:10.072+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:10.738 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:10.729+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:10.869 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:10.863+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:10.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:10.921+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:11.019 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:11.012+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:11.040 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:11.034+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:11.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:11.098+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:11.731 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:11.723+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:11.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:11.852+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:11.906 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:11.896+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:12.022 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:12.016+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:12.069 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:12.058+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:12.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:12.151+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:12.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:12.707+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:12.867 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:12.860+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:12.888 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:12.880+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:13.029 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:13.023+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:13.065 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:13.056+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:13.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:13.141+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:13.697 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:13.691+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:13.890 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:13.884+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:13.905 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:13.900+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:13.934 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:13.928+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:13.989 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:13.982+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:14.095 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:14.088+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:14.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:14.195+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:14.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:14.711+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:14.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:14.892+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:14.944 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:14.939+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:14.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:14.968+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:15.029 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:15.022+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:15.060 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:15.054+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:15.241 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:15.234+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:15.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:15.726+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:15.872 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:15.865+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:15.941 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:15.927+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:15.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:15.923+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:16.032 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:16.026+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:16.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:16.074+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:16.255 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:16.248+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:16.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:16.697+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:16.886 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:16.880+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:16.948 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:16.941+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:16.967 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:16.960+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:17.047 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:17.040+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:17.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:17.093+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:17.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:17.283+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:17.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:17.686+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:17.919 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:17.913+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:17.933 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:17.927+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:17.956 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:17.950+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:18.098 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:18.092+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:18.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:18.106+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:18.292 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:18.286+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:18.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:18.690+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:18.945 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:18.939+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:18.946 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:18.939+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:18.963 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:18.956+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:19.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:19.124+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:19.149 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:19.143+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:19.314 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:19.305+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:19.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:19.731+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:19.917 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:19.910+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:19.918 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:19.912+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:19.975 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:19.966+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:20.010 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:20.003+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:20.137 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:20.123+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:20.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:20.173+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:20.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:20.356+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:20.711 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:20.705+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:20.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:20.895+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:20.901 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:20.896+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:20.947 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:20.940+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:21.040 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:21.030+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:21.102 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:21.095+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:21.200 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:21.194+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:21.401 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:21.394+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:21.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:21.687+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:21.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:21.887+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:21.894 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:21.889+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:21.950 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:21.943+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:22.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:22.031+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:22.126 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:22.119+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:22.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:22.215+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:22.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:22.436+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:22.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:22.719+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:22.943 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:22.930+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:22.943 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:22.932+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:22.957 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:22.951+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:23.051 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:23.044+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:23.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:23.171+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:23.211 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:23.205+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:23.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:23.422+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:23.783 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:23.769+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:23.910 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:23.904+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:23.912 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:23.906+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:24.008 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:24.001+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:24.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:24.032+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:24.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:24.131+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:24.189 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:24.180+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:24.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:24.400+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:24.769 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:24.762+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:24.962 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:24.955+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:24.963 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:24.957+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:24.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:24.983+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:25.010 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:25.004+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:25.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:25.129+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:25.199 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:25.193+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:25.438 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:25.430+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:25.740 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:25.734+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:25.955 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:25.948+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:26.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:26.007+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:26.017 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:26.008+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:26.061 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:26.055+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:26.172 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:26.165+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:26.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:26.199+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:26.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:26.386+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:26.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:26.712+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:26.986 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:26.979+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:27.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:27.012+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:27.021 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:27.016+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:27.069 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:27.063+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:27.202 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:27.196+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:27.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:27.221+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:27.346 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:27.340+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:27.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:27.688+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:27.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:27.944+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:28.038 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:28.031+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:28.039 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:28.032+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:28.125 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:28.113+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:28.221 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:28.215+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:28.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:28.242+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:28.309 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:28.303+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:28.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:28.696+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:28.913 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:28.906+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:29.068 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:29.057+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:29.077 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:29.067+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:29.175 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:29.167+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:29.270 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:29.264+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:29.292 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:29.286+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:29.331 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:29.325+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:29.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:29.738+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:29.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:29.874+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:30.122 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:30.116+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:30.125 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:30.119+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:30.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:30.208+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:30.289 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:30.282+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:30.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:30.328+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:30.341 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:30.334+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:30.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:30.700+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:30.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:30.865+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:31.120 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:31.115+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:31.129 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:31.117+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:31.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:31.251+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:31.340 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:31.334+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:31.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:31.367+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:31.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:31.378+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:31.712 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:31.706+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:31.840 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:31.828+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:32.159 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:32.153+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:32.160 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:32.154+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:32.283 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:32.274+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:32.323 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:32.316+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:32.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:32.335+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:32.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:32.393+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:32.703 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:32.697+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:32.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:32.883+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:33.137 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:33.131+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:33.138 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:33.132+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:33.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:33.274+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:33.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:33.323+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:33.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:33.371+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:33.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:33.373+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:33.716 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:33.709+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:33.862 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:33.855+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:34.127 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:34.112+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:34.128 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:34.117+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:34.321 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:34.314+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:34.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:34.365+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:34.379 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:34.371+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:34.430 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:34.423+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:34.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:34.737+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:34.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:34.846+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:35.124 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:35.117+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:35.125 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:35.119+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:35.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:35.290+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:35.379 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:35.373+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:35.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:35.396+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:35.440 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:35.433+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:35.705 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:35.699+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:35.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:35.872+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:36.087 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:36.074+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:36.089 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:36.077+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:36.344 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:36.335+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:36.375 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:36.369+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:36.388 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:36.381+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:36.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:36.424+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:36.710 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:36.703+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:36.856 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:36.851+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:37.056 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:37.047+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:37.057 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:37.050+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:37.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:37.346+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:37.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:37.378+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:37.408 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:37.401+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:37.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:37.442+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:37.707 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:37.700+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:37.852 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:37.845+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:38.106 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:38.100+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:38.108 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:38.103+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:38.318 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:38.311+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:38.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:38.377+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:38.433 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:38.422+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:38.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:38.463+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:38.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:38.743+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:38.906 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:38.898+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:39.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:39.086+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:39.092 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:39.087+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:39.329 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:39.321+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:39.423 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:39.417+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:39.434 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:39.426+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:39.441 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:39.434+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:39.795 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:39.788+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:39.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:39.893+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:40.144 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:40.136+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:40.145 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:40.138+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:40.317 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:40.309+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:40.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:40.396+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:40.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:40.441+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:40.456 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:40.450+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:40.802 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:40.796+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:40.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:40.856+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:41.154 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:41.147+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:41.155 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:41.149+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:41.335 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:41.328+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:41.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:41.402+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:41.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:41.451+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:41.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:41.463+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:41.607 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:59:41.598+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e861 v861) 2019-11-29T19:59:41.814 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:41.807+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:41.889 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:41.881+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:42.173 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:42.157+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:42.173 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:42.159+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:42.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:42.288+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:42.431 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:42.423+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:42.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:42.436+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:42.460 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:42.446+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:42.867 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:42.859+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:42.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:42.879+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:43.160 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:43.153+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:43.161 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:43.155+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:43.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:43.330+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:43.410 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:43.401+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:43.444 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:43.438+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:43.463 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:43.455+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:43.818 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:43.812+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:43.877 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:43.869+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:44.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:44.174+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:44.187 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:44.176+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:44.370 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:44.361+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:44.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:44.417+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:44.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:44.463+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:44.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:44.474+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:44.831 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:44.824+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:44.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:44.839+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:45.199 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:45.192+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:45.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:45.195+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:45.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:45.410+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:45.434 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:45.427+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:45.435 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:45.422+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:45.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:45.483+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:45.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:45.852+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:45.867 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:45.861+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:46.244 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:46.238+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:46.247 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:46.241+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:46.393 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:46.386+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:46.412 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:46.404+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:46.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:46.415+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:46.489 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:46.482+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:46.638 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:59:46.627+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e861 v861) 2019-11-29T19:59:46.838 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:46.831+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:46.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:46.835+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:47.201 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:47.194+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:47.203 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:47.198+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:47.433 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:47.426+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:47.449 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:47.442+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:47.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:47.457+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:47.529 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:47.521+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:47.807 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:47.799+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:47.862 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:47.856+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:48.177 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:48.170+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:48.178 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:48.172+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:48.407 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:48.399+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:48.440 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:48.433+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:48.487 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:48.480+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:48.539 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:48.531+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:48.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:48.855+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:48.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:48.901+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:49.195 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:49.187+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:49.196 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:49.189+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:49.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:49.409+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:49.426 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:49.420+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:49.518 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:49.511+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:49.537 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:49.525+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:49.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:49.893+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:49.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:49.953+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:50.238 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:50.232+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:50.241 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:50.236+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:50.416 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:50.405+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:50.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:50.419+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:50.498 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:50.492+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:50.518 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:50.511+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:50.907 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:50.899+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:50.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T19:59:50.971+0000 1694c700 -1 osd.1 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:21.439230+0000 front 2019-11-29T19:58:21.621762+0000 (oldest deadline 2019-11-29T19:59:06.739371+0000) 2019-11-29T19:59:51.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:51.278+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:51.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:51.282+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:51.438 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:51.432+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:51.461 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:51.455+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:51.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T19:59:51.487+0000 1694c700 -1 osd.7 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.518194+0000 front 2019-11-29T19:58:23.551116+0000 (oldest deadline 2019-11-29T19:59:09.336004+0000) 2019-11-29T19:59:51.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T19:59:51.533+0000 1694c700 -1 osd.2 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:20.600061+0000 front 2019-11-29T19:58:20.591027+0000 (oldest deadline 2019-11-29T19:59:04.639927+0000) 2019-11-29T19:59:51.715 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T19:59:51.701+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e861 v861) 2019-11-29T19:59:51.897 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:51.891+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:52.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:52.304+0000 1694c700 -1 osd.0 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T19:58:39.558816+0000 (oldest deadline 2019-11-29T19:59:19.558816+0000) 2019-11-29T19:59:52.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:52.306+0000 1694c700 -1 osd.0 861 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T19:59:52.415 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T19:59:52.407+0000 1694c700 -1 osd.4 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.198178+0000 front 2019-11-29T19:58:23.191497+0000 (oldest deadline 2019-11-29T19:59:07.838695+0000) 2019-11-29T19:59:52.483 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T19:59:52.476+0000 1694c700 -1 osd.5 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:22.124028+0000 front 2019-11-29T19:58:22.022786+0000 (oldest deadline 2019-11-29T19:59:07.895811+0000) 2019-11-29T19:59:52.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T19:59:52.864+0000 1694c700 -1 osd.6 861 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T19:58:23.977640+0000 front 2019-11-29T19:58:23.980393+0000 (oldest deadline 2019-11-29T19:59:09.260826+0000) 2019-11-29T19:59:53.376 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T19:59:53.302+0000 1694c700 -1 osd.0 862 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:123895 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e858) 2019-11-29T20:00:20.950 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:20.937+0000 3578b700 -1 osd.3 867 build_incremental_map_msg missing incremental map 867 2019-11-29T20:00:21.187 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:21.025+0000 3578b700 -1 osd.3 867 build_incremental_map_msg missing incremental map 867 2019-11-29T20:00:21.468 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:21.386+0000 31783700 -1 osd.3 867 build_incremental_map_msg missing incremental map 867 2019-11-29T20:00:21.789 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:21.719+0000 3778f700 -1 osd.3 867 build_incremental_map_msg missing incremental map 867 2019-11-29T20:00:21.919 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:21.905+0000 33787700 -1 osd.3 867 build_incremental_map_msg missing incremental map 867 2019-11-29T20:00:23.366 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:00:23.339+0000 34f8a700 -1 osd.3 868 build_incremental_map_msg missing incremental map 867 2019-11-29T20:01:19.884 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:19.878+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:20.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:20.110+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:20.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:20.468+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:20.561 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:20.551+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:20.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:20.843+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:20.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:20.915+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:21.017 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:21.009+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:21.175 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:21.168+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:21.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:21.467+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:21.529 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:21.523+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:21.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:21.877+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:21.977 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:21.970+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:22.033 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:22.017+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:22.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:22.147+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:22.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:22.478+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:22.581 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:22.575+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:22.728 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:22.720+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:22.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:22.830+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:22.936 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:22.929+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:23.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:23.013+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:23.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:23.157+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:23.484 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:23.476+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:23.566 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:23.558+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:23.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:23.750+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:23.831 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:23.822+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:23.990 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:23.981+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:24.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:24.036+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:24.169 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:24.162+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:24.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:24.449+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:24.537 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:24.528+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:24.741 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:24.734+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:24.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:24.858+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:25.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:25.035+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:25.058 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:25.052+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:25.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:25.139+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:25.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:25.473+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:25.492 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:25.484+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:25.742 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:25.735+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:25.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:25.901+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:26.078 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:26.069+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:26.090 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:26.079+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:26.193 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:26.185+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:26.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:26.468+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:26.494 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:26.485+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:26.717 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:26.704+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:26.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:26.879+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:27.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:27.074+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:27.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:27.117+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:27.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:27.198+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:27.434 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:27.427+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:27.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:27.489+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:27.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:27.719+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:27.845 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:27.838+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:28.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:28.073+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:28.160 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:28.153+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:28.199 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:28.192+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:28.451 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:28.445+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:28.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:28.479+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:28.781 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:28.773+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:28.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:28.874+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:29.036 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:29.029+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:29.215 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:29.207+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:29.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:29.230+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:29.420 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:29.413+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:29.549 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:29.526+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:29.793 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:29.786+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:29.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:29.843+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:30.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:29.999+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:30.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:30.219+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:30.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:30.259+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:30.473 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:30.465+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:30.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:30.573+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:30.816 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:30.790+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:30.835 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:30.827+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:30.987 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:30.979+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:31.205 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:31.198+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:31.309 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:31.301+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:31.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:31.499+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:31.550 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:31.544+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:31.844 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:31.836+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:31.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:31.843+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:32.017 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:32.011+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:32.251 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:32.244+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:32.322 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:32.314+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:32.524 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:32.509+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:32.536 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:32.529+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:32.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:32.841+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:32.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:32.857+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:33.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:33.050+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:33.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:33.206+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:33.342 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:33.328+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:33.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:33.498+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:33.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:33.579+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:33.893 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:33.879+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:33.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:33.892+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:34.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:34.051+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:34.247 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:34.239+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:34.379 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:34.368+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:34.566 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:34.550+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:34.600 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:34.592+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:34.882 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:34.875+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:34.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:34.919+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:35.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:35.095+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:35.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:35.228+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:35.336 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:35.329+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:35.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:35.539+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:35.636 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:35.628+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:35.866 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:35.858+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:35.905 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:35.898+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:36.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:36.109+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:36.271 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:36.264+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:36.400 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:36.389+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:36.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:36.539+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:36.668 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:36.659+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:36.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:36.891+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:36.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:36.894+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:37.108 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:37.101+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:37.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:37.259+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:37.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:37.417+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:37.569 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:37.561+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:37.645 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:37.638+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:37.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:37.871+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:37.935 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:37.925+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:38.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:38.090+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:38.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:38.293+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:38.451 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:38.443+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:38.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:38.522+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:38.672 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:38.665+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:38.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:38.923+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:38.944 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:38.937+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:39.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:39.141+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:39.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:39.269+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:39.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:39.462+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:39.502 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:39.495+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:39.631 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:39.625+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:39.932 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:39.925+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:39.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:39.937+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:40.192 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:40.185+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:40.274 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:40.268+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:40.494 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:40.487+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:40.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:40.542+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:40.657 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:40.644+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:40.985 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:40.978+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:40.989 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:40.983+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:41.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:41.202+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:41.318 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:41.311+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:41.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:41.476+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:41.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:41.565+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:41.683 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:41.677+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:41.979 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:41.971+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:41.979 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:41.973+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:42.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:42.169+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:42.370 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:42.363+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:42.462 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:42.452+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:42.601 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:42.593+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:42.661 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:42.654+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:42.939 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:42.933+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:42.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:42.934+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:43.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:43.140+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:43.396 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:43.389+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:43.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:43.424+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:43.597 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:43.591+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:43.643 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:43.636+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:43.909 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:43.902+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:43.962 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:43.956+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:44.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:44.108+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:44.389 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:44.382+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:44.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:44.406+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:44.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:44.604+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:44.634 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:44.627+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:44.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:44.921+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:44.982 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:44.963+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:45.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:45.104+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:45.413 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:45.407+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:45.419 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:45.413+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:45.620 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:45.607+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:45.671 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:45.655+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:45.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:45.883+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:45.951 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:45.943+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:46.090 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:46.082+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:46.393 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:46.386+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:46.458 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:46.451+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:46.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:46.610+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:46.690 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:46.683+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:46.852 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:46.845+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:46.928 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:46.920+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:47.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:47.122+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:47.445 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:47.438+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:47.491 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:47.484+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:47.600 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:47.592+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:47.666 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:47.657+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:47.867 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:47.860+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:47.920 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:47.912+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:48.115 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:48.107+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:48.328 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:45:56.463 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.355 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:45:56.490 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.362 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:45:56.543 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.364 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:45:56.544 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.366 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:45:56.547 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.371 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:45:56.551 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:48.422+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:48.489 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:48.482+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:48.621 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:48.613+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:48.622 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:45:56.802 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:48.631+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:48.651 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:45:56.830 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.694 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:45:56.828 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:01:48.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:48.871+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:48.956 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:48.949+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:49.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:49.136+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:49.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:49.452+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:49.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:49.471+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:49.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:49.581+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:49.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:49.655+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:49.843 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:49.837+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:49.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:49.952+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:50.116 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:50.109+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:50.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:50.418+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:50.527 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:50.515+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:50.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:50.589+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:50.701 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:50.690+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:50.812 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:50.802+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:50.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:50.913+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:51.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:51.097+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:51.469 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:51.461+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:51.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:51.527+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:51.553 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:51.547+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:51.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:51.739+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:51.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:51.839+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:51.902 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:51.895+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:52.112 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:01:52.106+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e868 v868) 2019-11-29T20:01:52.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:52.150+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:52.512 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:52.504+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:52.515 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:52.508+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:52.541 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:52.534+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:52.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:52.723+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:52.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:52.794+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:52.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:52.865+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:53.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:53.119+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:53.516 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:53.506+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:53.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:53.515+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:53.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:53.579+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:53.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:53.698+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:53.806 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:53.799+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:53.860 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:53.849+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:54.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:54.110+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:54.484 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:54.476+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:54.511 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:54.502+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:54.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:54.575+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:54.682 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:54.675+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:54.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:54.758+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:54.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:54.805+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:55.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:55.119+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:55.443 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:55.435+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:55.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:55.529+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:55.580 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:55.574+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:55.701 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:55.693+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:55.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:55.728+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:55.808 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:55.801+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:56.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:56.159+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:56.463 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:56.455+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:56.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:56.514+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:56.602 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:01:56.594+0000 1694c700 -1 osd.7 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:35.146794+0000 front 2019-11-29T20:00:35.154406+0000 (oldest deadline 2019-11-29T20:01:19.611740+0000) 2019-11-29T20:01:56.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:56.670+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:01:56.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:01:56.713+0000 1694c700 -1 osd.6 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:37.427730+0000 front 2019-11-29T20:00:37.418380+0000 (oldest deadline 2019-11-29T20:01:22.702209+0000) 2019-11-29T20:01:56.802 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:01:56.796+0000 1694c700 -1 osd.1 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.303503+0000 front 2019-11-29T20:00:34.296532+0000 (oldest deadline 2019-11-29T20:01:19.352185+0000) 2019-11-29T20:01:57.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:01:57.140+0000 1694c700 -1 osd.2 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:38.504345+0000 front 2019-11-29T20:00:38.525198+0000 (oldest deadline 2019-11-29T20:01:20.170599+0000) 2019-11-29T20:01:57.193 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:01:57.176+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e868 v868) 2019-11-29T20:01:57.490 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:01:57.479+0000 1694c700 -1 osd.3 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.290784+0000 front 2019-11-29T20:00:36.074748+0000 (oldest deadline 2019-11-29T20:01:19.993697+0000) 2019-11-29T20:01:57.560 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:01:57.554+0000 1694c700 -1 osd.5 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:36.291733+0000 front 2019-11-29T20:00:36.424606+0000 (oldest deadline 2019-11-29T20:01:20.365215+0000) 2019-11-29T20:01:57.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:01:57.657+0000 1694c700 -1 osd.4 868 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:00:34.530496+0000 front 2019-11-29T20:00:34.549859+0000 (oldest deadline 2019-11-29T20:01:19.476346+0000) 2019-11-29T20:02:28.993 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:28.963+0000 114ab700 -1 osd.1 873 build_incremental_map_msg missing incremental map 873 2019-11-29T20:02:28.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:28.972+0000 31f84700 -1 osd.1 873 build_incremental_map_msg missing incremental map 873 2019-11-29T20:02:28.999 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:28.987+0000 114ab700 -1 osd.1 873 build_incremental_map_msg missing incremental map 873 2019-11-29T20:02:29.031 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:29.023+0000 114ab700 -1 osd.1 873 build_incremental_map_msg missing incremental map 873 2019-11-29T20:02:29.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:29.395+0000 114ab700 -1 osd.1 873 build_incremental_map_msg missing incremental map 873 2019-11-29T20:02:31.881 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:31.846+0000 31783700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:32.207 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:32.128+0000 33f88700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:32.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:32.321+0000 31783700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:32.464 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:32.382+0000 33f88700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:32.575 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:32.539+0000 3578b700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:32.921 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:32.757+0000 3778f700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:33.753 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:33.718+0000 37f90700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:34.451 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:34.446+0000 114ab700 -1 osd.0 875 build_incremental_map_msg missing incremental map 875 2019-11-29T20:02:55.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:02:55.169+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:02:55.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:55.381+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:02:56.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:02:56.036+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:02:56.198 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:02:56.192+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:02:56.432 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:56.424+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:02:57.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:02:57.036+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:02:57.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:02:57.073+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:02:57.240 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:02:57.234+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:02:57.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:57.385+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:02:57.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:02:57.416+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:02:58.025 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:02:58.019+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:02:58.127 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:02:58.121+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:02:58.252 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:02:58.244+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:02:58.386 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:58.381+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:02:58.429 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:02:58.421+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:02:58.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:02:58.985+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:02:59.115 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:02:59.109+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:02:59.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:02:59.141+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:02:59.281 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:02:59.273+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:02:59.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:02:59.386+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:02:59.450 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:02:59.444+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:00.029 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:00.023+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:00.085 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:00.076+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:00.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:00.119+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:00.304 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:00.297+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:00.349 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:00.344+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:00.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:00.474+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:01.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:01.048+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:01.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:01.053+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:01.119 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:01.114+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:01.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:01.126+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:01.327 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:01.321+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:01.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:01.358+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:01.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:01.442+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:02.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:02.042+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:02.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:02.101+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:02.150 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:02.143+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:02.164 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:02.157+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:02.302 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:02.283+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:02.373 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:02.365+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:02.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:02.454+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:03.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:03.006+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:03.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:03.144+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:03.151 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:03.145+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:03.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:03.164+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:03.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:03.258+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:03.352 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:03.346+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:03.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:03.501+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:04.046 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:04.038+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:04.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:04.144+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:04.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:04.161+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:04.182 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:04.176+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:04.277 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:04.265+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:04.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:04.349+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:04.487 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:04.481+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:05.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:05.059+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:05.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:05.139+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:05.164 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:05.159+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:05.169 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:05.162+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:05.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:05.260+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:05.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:05.382+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:05.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:05.502+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:06.120 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:06.110+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:06.168 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:06.162+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:06.171 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:06.165+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:06.171 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:06.165+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:06.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:06.167+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:06.242 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:06.235+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:06.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:06.353+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:06.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:06.466+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:07.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:07.152+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:07.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:07.173+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:07.199 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:07.192+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:07.200 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:07.194+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:07.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:07.206+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:07.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:07.267+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:07.325 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:07.318+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:07.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:07.465+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:08.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:08.149+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:08.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:08.172+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:08.198 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:08.192+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:08.250 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:08.243+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:08.252 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:08.247+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:08.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:08.294+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:08.331 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:08.324+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:08.472 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:08.465+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:09.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:09.137+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:09.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:09.157+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:09.175 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:09.168+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:09.263 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:09.256+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:09.282 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:09.273+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:09.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:09.276+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:09.286 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:09.279+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:09.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:09.432+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:10.140 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:10.133+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:10.180 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:10.173+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:10.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:10.180+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:10.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:10.219+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:10.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:10.289+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:10.298 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:10.292+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:10.329 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:10.322+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:10.433 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:10.426+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:11.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:11.190+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:11.201 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:11.185+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:11.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:11.217+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:11.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:11.252+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:11.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:11.252+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:11.261 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:11.253+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:11.311 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:11.304+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:11.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:11.429+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:12.150 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:12.144+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:12.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:12.159+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:12.196 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:12.189+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:12.214 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:12.206+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:12.215 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:12.209+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:12.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:12.250+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:12.331 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:12.323+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:12.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:12.440+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:12.897 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:47:21.032 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:12.905 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:47:21.040 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:12.970 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:47:21.150 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:12.973 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:47:21.152 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:12.994 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:47:21.175 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:13.015 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:47:21.195 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:13.020 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:47:21.155 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:13.072 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:47:21.252 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:13.119 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:47:21.300 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:03:13.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:13.185+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:13.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:13.194+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:13.224 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:13.219+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:13.234 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:13.228+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:13.235 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:13.230+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:13.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:13.233+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:13.330 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:13.325+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:13.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:13.478+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:14.148 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:14.142+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:14.200 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:14.193+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:14.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:14.195+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:14.214 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:14.207+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:14.278 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:14.271+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:14.279 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:14.273+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:14.297 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:14.290+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:14.507 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:14.501+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:15.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:15.175+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:15.184 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:15.177+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:15.201 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:15.195+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:15.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:15.198+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:15.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:15.264+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:15.272 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:15.266+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:15.335 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:15.330+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:15.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:15.500+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:16.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:16.134+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:16.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:16.152+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:16.225 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:16.218+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:16.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:16.233+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:16.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:16.303+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:16.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:16.305+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:16.386 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:16.379+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:16.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:16.500+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:17.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:17.095+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:17.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:17.151+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:17.213 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:17.200+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:17.260 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:17.253+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:17.307 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:17.300+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:17.307 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:17.302+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:17.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:17.350+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:17.470 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:17.463+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:18.070 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:18.063+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:18.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:18.127+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:18.183 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:18.176+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:18.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:18.220+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:18.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:18.282+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:18.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:18.287+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:18.357 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:18.351+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:18.439 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:18.432+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:19.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:19.111+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:19.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:19.152+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:19.162 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:19.156+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:19.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:19.261+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:19.267 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:19.262+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:19.279 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:19.273+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:19.351 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:19.344+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:19.411 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:19.404+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:20.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:20.113+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:20.196 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:20.189+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:20.206 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:20.200+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:20.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:20.254+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:20.295 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:20.288+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:20.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:20.292+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:20.374 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:20.368+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:20.418 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:20.410+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:21.087 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:21.078+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:21.175 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:21.169+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:21.218 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:21.211+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:21.240 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:21.226+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:21.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:21.321+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:21.330 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:21.324+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:21.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:21.354+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:21.416 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:21.410+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:22.102 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:22.093+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:22.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:22.122+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:22.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:22.193+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:22.247 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:22.240+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:22.356 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:22.349+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:22.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:22.364+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:22.375 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:22.368+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:22.406 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:22.399+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:23.148 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:23.135+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:23.167 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:23.155+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:23.167 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:23.147+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:23.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:23.203+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:23.368 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:23.361+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:23.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:23.365+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:23.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:23.396+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:23.419 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:23.413+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:24.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:24.113+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:24.135 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:24.128+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:24.176 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:24.170+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:24.178 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:24.172+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:24.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:24.387+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:24.401 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:24.394+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:24.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:24.394+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:24.403 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:24.397+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:25.148 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:25.141+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:25.158 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:25.151+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:25.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:25.169+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:25.179 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:25.172+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:25.380 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:25.374+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:25.383 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:25.378+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:25.426 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:25.419+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:25.458 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:25.448+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:26.141 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:26.135+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:26.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:26.164+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:26.183 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:26.174+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:26.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:26.176+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:26.404 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:26.398+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:26.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:26.422+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:26.430 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:26.424+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:26.495 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:26.488+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:27.149 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:27.144+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:27.197 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:27.191+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:27.204 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:27.198+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:27.217 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:27.209+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:27.409 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:27.402+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:27.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:27.435+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:27.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:27.439+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:27.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:27.456+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:27.880 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:03:27.874+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e875 v875) 2019-11-29T20:03:28.164 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:28.158+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:28.194 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:28.188+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:28.215 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:28.207+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:28.215 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:28.207+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:28.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:28.370+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:28.413 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:28.406+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:28.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:28.408+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:28.452 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:28.445+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:29.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:29.170+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:29.178 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:29.171+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:29.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:29.183+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:29.196 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:29.188+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:29.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:29.369+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:29.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:29.415+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:29.448 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:29.442+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:29.450 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:29.445+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:30.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:30.134+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:30.179 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:30.172+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:30.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:30.179+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:30.248 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:30.240+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:30.428 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:30.421+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:30.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:30.433+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:30.500 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:30.494+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:30.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:30.498+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:31.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:31.110+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:31.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:31.136+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:31.222 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:31.215+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:31.292 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:31.283+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:31.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:31.401+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:31.470 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:31.462+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:31.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:31.470+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:31.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:31.473+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:32.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:32.121+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:32.158 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:32.145+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:32.262 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:32.256+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:32.327 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:32.319+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:32.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:32.388+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:32.493 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:32.479+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:32.493 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:32.481+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:32.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:32.511+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:32.902 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:03:32.894+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e875 v875) 2019-11-29T20:03:33.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:33.082+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:33.134 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:33.126+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:33.278 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:33.272+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:33.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:33.367+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:33.391 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:33.385+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:33.466 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:33.460+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:33.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:33.464+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:33.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:33.510+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:34.108 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:34.100+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:34.142 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:34.134+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:34.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:34.237+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:34.354 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:34.347+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:34.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:34.346+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:34.481 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:34.473+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:34.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:34.476+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:34.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:34.524+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:35.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:35.074+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:35.120 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:35.112+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:35.254 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:35.246+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:35.359 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:35.352+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:35.409 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:35.386+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:35.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:35.508+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:35.515 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:35.509+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:35.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:35.530+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:36.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:36.028+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:36.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:36.079+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:36.249 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:36.243+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:36.353 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:36.347+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:36.388 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:36.380+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:36.496 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:36.489+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:36.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:36.522+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:36.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:36.525+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:37.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:37.004+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:37.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:37.036+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:37.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:03:37.214+0000 1694c700 -1 osd.2 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:13.198103+0000 front 2019-11-29T20:02:13.060851+0000 (oldest deadline 2019-11-29T20:02:55.243861+0000) 2019-11-29T20:03:37.347 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:03:37.339+0000 1694c700 -1 osd.1 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798398+0000 front 2019-11-29T20:02:12.724006+0000 (oldest deadline 2019-11-29T20:02:54.996520+0000) 2019-11-29T20:03:37.382 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:03:37.372+0000 1694c700 -1 osd.6 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:14.851960+0000 front 2019-11-29T20:02:14.900113+0000 (oldest deadline 2019-11-29T20:03:00.544307+0000) 2019-11-29T20:03:37.488 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:03:37.475+0000 1694c700 -1 osd.4 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.477890+0000 front 2019-11-29T20:02:12.677212+0000 (oldest deadline 2019-11-29T20:02:56.519394+0000) 2019-11-29T20:03:37.547 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:37.539+0000 1694c700 -1 osd.0 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:02:25.990279+0000 (oldest deadline 2019-11-29T20:03:05.990279+0000) 2019-11-29T20:03:37.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:37.542+0000 1694c700 -1 osd.0 875 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:37.971 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:03:37.964+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e875 v875) 2019-11-29T20:03:38.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:03:38.007+0000 1694c700 -1 osd.7 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:12.798447+0000 front 2019-11-29T20:02:12.679332+0000 (oldest deadline 2019-11-29T20:02:56.766862+0000) 2019-11-29T20:03:38.067 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:03:38.056+0000 1694c700 -1 osd.5 875 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:02:11.135713+0000 front 2019-11-29T20:02:14.984544+0000 (oldest deadline 2019-11-29T20:02:54.938895+0000) 2019-11-29T20:03:38.654 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:38.626+0000 1694c700 -1 osd.0 876 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e873) 2019-11-29T20:03:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:03:39.006+0000 34f8a700 -1 osd.0 876 build_incremental_map_msg missing incremental map 875 2019-11-29T20:04:13.264 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:48:21.399 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.269 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:48:21.404 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.277 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:48:21.458 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.297 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:48:21.478 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.300 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:48:21.480 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.304 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:48:21.485 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.335 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:48:21.470 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.364 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:48:21.544 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:04:13.397 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:48:21.578 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:10.567 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:10.559+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:10.630 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:10.620+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:10.787 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:10.779+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:10.831 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:10.823+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:11.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:11.440+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:11.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:11.583+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:11.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:11.601+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:11.713 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:11.707+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:11.806 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:11.800+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:11.853 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:11.847+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:12.412 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:12.403+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:12.565 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:12.556+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:12.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:12.589+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:12.766 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:12.759+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:12.834 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:12.827+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:12.847 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:12.842+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:13.371 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:13.364+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:13.433 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:13.423+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:13.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:13.542+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:13.603 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:13.597+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:13.776 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:13.769+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:13.851 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:13.845+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:13.887 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:13.871+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:14.392 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:14.385+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:14.451 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:14.445+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:14.551 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:14.545+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:14.612 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:14.606+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:14.785 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:14.776+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:14.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:14.837+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:14.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:14.892+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:15.405 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:15.398+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:15.425 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:15.417+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:15.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:15.516+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:15.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:15.619+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:15.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:15.827+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:15.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:15.852+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:15.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:15.888+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:16.392 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:16.385+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:16.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:16.446+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:16.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:16.522+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:16.621 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:16.615+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:16.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:16.802+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:16.825 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:16.818+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:16.889 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:16.883+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:17.365 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:17.358+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:17.494 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:17.488+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:17.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:17.541+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:17.667 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:17.660+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:17.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:17.775+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:17.871 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:17.865+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:17.882 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:17.875+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:18.384 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:18.376+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:18.506 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:18.499+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:18.598 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:18.593+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:18.679 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:18.672+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:18.750 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:18.744+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:18.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:18.839+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:18.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:18.895+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:19.429 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:19.422+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:19.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:19.457+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:19.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:19.556+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:19.635 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:19.629+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:19.717 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:19.710+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:19.872 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:19.867+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:19.874 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:19.867+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:20.441 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:20.431+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:20.499 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:20.492+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:20.607 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:20.599+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:20.615 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:20.608+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:20.684 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:20.677+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:20.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:20.904+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:20.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:20.920+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:21.465 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:21.457+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:21.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:21.540+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:21.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:21.557+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:21.616 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:21.608+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:21.646 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:21.639+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:21.886 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:21.880+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:21.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:21.946+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:22.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:22.442+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:22.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:22.522+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:22.538 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:22.532+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:22.617 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:22.612+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:22.678 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:22.671+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:22.895 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:22.887+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:22.929 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:22.923+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:23.436 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:23.429+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:23.527 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:23.514+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:23.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:23.542+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:23.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:23.595+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:23.667 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:23.660+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:23.907 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:23.900+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:23.981 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:23.974+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:24.438 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:24.430+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:24.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:24.534+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:24.565 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:24.559+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:24.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:24.581+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:24.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:24.624+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:24.956 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:24.949+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:25.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:25.021+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:25.397 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:25.390+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:25.583 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:25.569+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:25.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:25.584+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:25.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:25.588+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:25.662 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:25.656+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:25.995 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:25.987+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:26.076 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:26.061+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:26.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:26.362+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:26.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:26.544+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:26.572 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:26.566+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:26.648 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:26.641+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:26.679 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:26.671+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:27.043 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:27.036+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:27.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:27.047+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:27.364 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:27.357+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:27.588 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:27.581+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:27.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:27.600+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:27.662 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:27.655+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:27.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:27.723+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:28.010 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:28.003+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:28.083 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:28.076+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:28.406 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:28.399+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:28.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:28.564+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:28.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:28.573+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:28.713 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:28.707+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:28.781 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:28.773+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:29.013 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:29.006+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:29.043 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:29.036+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:29.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:29.383+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:29.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:29.525+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:29.560 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:29.553+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:29.723 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:29.716+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:29.823 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:29.815+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:30.026 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:30.019+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:30.054 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:30.047+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:30.385 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:30.378+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:30.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:30.485+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:30.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:30.515+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:30.755 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:30.749+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:30.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:30.820+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:31.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:31.002+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:31.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:31.021+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:31.404 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:31.396+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:31.483 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:31.476+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:31.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:31.532+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:31.765 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:31.757+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:31.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:31.817+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:31.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:31.992+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:32.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:32.027+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:32.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:32.406+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:32.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:32.505+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:32.546 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:32.539+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:32.730 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:32.724+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:32.795 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:32.788+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:33.048 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:33.040+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:33.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:33.042+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:33.450 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:33.440+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:33.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:33.508+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:33.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:33.539+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:33.720 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:33.714+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:33.777 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:33.769+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:34.050 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:34.044+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:34.057 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:34.050+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:34.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:34.474+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:34.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:34.492+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:34.561 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:34.554+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:34.709 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:34.703+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:34.742 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:34.734+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:35.099 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:35.092+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:35.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:35.095+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:35.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:35.490+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:35.510 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:35.502+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:35.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:35.564+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:35.732 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:35.724+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:35.732 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:35.725+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:36.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:36.075+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:36.095 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:36.089+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:36.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:36.501+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:36.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:36.520+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:36.550 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:36.543+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:36.728 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:36.721+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:36.739 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:36.732+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:37.045 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:37.038+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:37.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:37.129+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:37.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:37.481+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:37.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:37.530+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:37.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:37.542+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:37.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:37.750+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:37.773 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:37.767+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:38.089 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:38.082+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:38.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:38.108+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:38.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:38.513+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:38.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:38.538+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:38.584 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:38.577+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:38.728 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:38.722+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:38.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:38.776+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:39.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:39.074+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:39.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:39.144+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:39.572 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:39.564+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:39.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:39.567+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:39.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:39.599+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:39.767 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:39.760+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:39.821 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:39.811+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:40.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:40.095+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:40.113 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:40.106+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:40.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:40.554+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:40.621 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:40.616+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:40.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:40.638+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:40.794 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:40.788+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:40.859 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:40.852+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:41.080 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:41.074+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:41.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:41.116+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:41.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:41.543+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:41.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:41.608+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:41.629 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:41.623+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:41.749 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:49:49.884 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.755 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:49:49.891 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.774 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:49:49.955 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.776 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:49:49.956 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.781 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:49:49.962 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.782 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:49:49.962 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.829 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:41.822+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:41.870 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:49:50.051 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.890 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:41.882+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:41.895 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:49:50.030 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:41.901 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:49:50.081 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:05:42.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:42.064+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:42.081 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:42.075+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:42.577 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:42.571+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:42.585 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:42.580+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:42.635 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:42.629+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:42.801 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:42.795+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:42.879 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:42.872+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:43.095 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:43.089+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:43.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:43.118+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:43.485 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:05:43.480+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e881 v881) 2019-11-29T20:05:43.612 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:43.606+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:43.617 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:43.610+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:43.626 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:43.620+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:43.853 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:43.847+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:43.918 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:43.910+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:44.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:44.122+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:44.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:44.172+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:44.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:44.588+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:44.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:44.650+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:44.666 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:44.659+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:44.838 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:44.833+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:44.967 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:44.959+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:45.140 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:45.135+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:45.225 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:45.217+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:45.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:45.625+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:45.634 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:45.627+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:45.673 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:45.662+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:45.870 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:45.863+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:45.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:45.974+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:46.162 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:46.154+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:46.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:46.264+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:46.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:46.634+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:46.649 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:46.643+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:46.734 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:46.725+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:46.887 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:46.879+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:47.032 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:47.024+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:47.176 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:47.169+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:47.229 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:47.220+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:47.651 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:47.645+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:47.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:47.650+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:47.704 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:47.694+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:47.869 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:05:47.863+0000 1694c700 -1 osd.3 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.375924+0000 front 2019-11-29T20:04:25.400963+0000 (oldest deadline 2019-11-29T20:05:10.062629+0000) 2019-11-29T20:05:48.003 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:47.992+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:05:48.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:05:48.212+0000 1694c700 -1 osd.2 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.500665+0000 front 2019-11-29T20:04:25.705537+0000 (oldest deadline 2019-11-29T20:05:10.187663+0000) 2019-11-29T20:05:48.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:05:48.232+0000 1694c700 -1 osd.6 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.365451+0000 front 2019-11-29T20:04:26.446275+0000 (oldest deadline 2019-11-29T20:05:10.355450+0000) 2019-11-29T20:05:48.571 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:05:48.562+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e881 v881) 2019-11-29T20:05:48.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:05:48.622+0000 1694c700 -1 osd.4 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.561484+0000 front 2019-11-29T20:04:30.130577+0000 (oldest deadline 2019-11-29T20:05:11.227722+0000) 2019-11-29T20:05:48.650 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:05:48.643+0000 1694c700 -1 osd.1 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:25.252083+0000 front 2019-11-29T20:04:25.391449+0000 (oldest deadline 2019-11-29T20:05:10.534320+0000) 2019-11-29T20:05:48.754 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:05:48.748+0000 1694c700 -1 osd.7 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:29.256938+0000 front 2019-11-29T20:04:29.200900+0000 (oldest deadline 2019-11-29T20:05:12.540152+0000) 2019-11-29T20:05:49.000 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:05:48.994+0000 1694c700 -1 osd.5 881 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:04:26.101279+0000 front 2019-11-29T20:04:26.095495+0000 (oldest deadline 2019-11-29T20:05:10.769334+0000) 2019-11-29T20:06:20.845 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:20.618+0000 124ad700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:20.937 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:20.728+0000 32785700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.180 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:20.998+0000 35f8c700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.289 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:21.215+0000 37f90700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.294 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:21.282+0000 3778f700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:21.367+0000 114ab700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:21.471+0000 38791700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:21.952 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:21.909+0000 38f92700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:22.719 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:22.688+0000 32f86700 -1 osd.0 887 build_incremental_map_msg missing incremental map 887 2019-11-29T20:06:46.112 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:46.105+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:46.407 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:46.400+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:47.079 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:47.072+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:47.367 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:47.359+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:47.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:47.503+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:47.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:47.727+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:48.084 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:48.077+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:48.414 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:48.407+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:48.497 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:48.488+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:48.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:48.745+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:49.108 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:49.101+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:49.442 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:49.434+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:49.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:49.472+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:49.702 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:49.690+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:49.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:49.719+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:49.775 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:49.769+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:50.144 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:50.136+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:50.400 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:50.393+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:50.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:50.504+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:50.683 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:50.677+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:50.717 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:50.711+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:50.812 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:50.805+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:51.159 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:51.151+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:51.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:51.403+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:51.517 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:51.511+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:51.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:51.673+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:51.691 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:51.686+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:51.817 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:51.812+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:52.130 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:52.124+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:52.413 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:52.407+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:52.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:52.536+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:52.656 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:52.650+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:52.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:52.653+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:52.774 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:52.767+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:53.176 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:53.168+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:53.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:53.403+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:53.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:53.515+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:53.645 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:53.640+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:53.690 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:53.684+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:53.754 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:53.748+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:54.167 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:54.161+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:54.449 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:54.442+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:54.485 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:54.479+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:54.607 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:54.601+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:54.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:54.677+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:54.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:54.778+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:55.137 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:55.130+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:55.432 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:55.424+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:55.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:55.461+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:55.595 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:55.588+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:06:55.596 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:55.590+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:55.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:55.687+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:55.768 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:55.763+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:56.113 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:56.106+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:56.444 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:56.436+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:56.469 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:56.462+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:56.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:56.574+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:06:56.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:56.576+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:56.712 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:56.705+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:56.779 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:56.772+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:57.152 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:57.145+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:57.472 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:57.465+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:57.473 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:57.465+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:57.589 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:57.581+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:06:57.590 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:57.584+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:57.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:57.684+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:57.777 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:57.771+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:58.189 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:58.183+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:58.486 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:58.479+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:58.499 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:58.491+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:58.619 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:58.610+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:06:58.620 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:58.613+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:58.666 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:58.659+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:58.827 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:58.822+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:06:59.153 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:06:59.146+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:06:59.495 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:06:59.488+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:06:59.498 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:06:59.492+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:06:59.617 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:59.610+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:06:59.621 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:06:59.616+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:06:59.668 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:06:59.662+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:06:59.863 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:06:59.857+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:00.106 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:00.100+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:00.477 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:00.470+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:00.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:00.503+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:00.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:00.576+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:00.586 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:00.580+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:00.693 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:00.686+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:00.888 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:00.874+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:01.110 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:01.104+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:01.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:01.504+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:01.531 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:01.513+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:01.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:01.546+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:01.554 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:01.548+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:01.704 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:01.698+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:01.863 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:01.858+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:02.154 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:02.147+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:02.501 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:02.495+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:02.516 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:02.509+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:02.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:02.565+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:02.573 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:02.568+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:02.713 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:02.705+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:02.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:02.847+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:03.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:03.174+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:03.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:03.485+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:03.532 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:03.525+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:03.617 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:03.611+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:03.618 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:03.612+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:03.720 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:03.713+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:03.878 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:03.873+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:04.208 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:04.201+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:04.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:04.477+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:04.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:04.575+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:04.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:04.601+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:04.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:04.603+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:04.731 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:04.724+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:04.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:04.919+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:05.258 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:05.251+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:05.455 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:05.448+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:05.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:05.571+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:05.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:05.652+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:05.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:05.654+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:05.755 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:05.748+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:05.894 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:05.887+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:06.242 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:06.236+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:06.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:06.411+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:06.558 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:06.552+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:06.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:06.606+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:06.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:06.608+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:06.743 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:06.736+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:06.935 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:06.928+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:07.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:07.222+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:07.466 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:07.460+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:07.540 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:07.533+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:07.660 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:07.655+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:07.662 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:07.657+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:07.719 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:07.713+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:07.927 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:07.922+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:08.274 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:08.267+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:08.473 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:08.467+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:08.539 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:08.532+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:08.691 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:08.684+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:08.693 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:08.688+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:08.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:08.719+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:08.960 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:08.954+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:09.232 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:09.222+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:09.486 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:09.480+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:09.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:09.505+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:09.676 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:09.669+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:09.677 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:09.671+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:09.702 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:09.696+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:09.924 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:09.918+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:10.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:10.203+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:10.513 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:10.507+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:10.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:10.536+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:10.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:10.654+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:10.661 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:10.656+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:10.663 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:10.657+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:10.968 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:10.962+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:11.166 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:11.160+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:11.533 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:11.526+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:11.583 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:11.575+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:11.690 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:11.683+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:11.694 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:11.688+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:11.696 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:11.690+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:12.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:12.004+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:12.179 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:12.173+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:12.564 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:12.556+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:12.613 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:12.607+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:12.717 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:12.710+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:12.718 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:12.711+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:12.720 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:12.713+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:13.051 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:13.044+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:13.142 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:13.135+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:13.610 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:13.603+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:13.655 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:13.648+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:13.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:13.696+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:13.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:13.729+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:13.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:13.733+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:14.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:14.095+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:14.148 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:14.141+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:14.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:14.621+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:14.643 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:14.637+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:14.719 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:14.713+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:14.720 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:14.714+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:14.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:14.717+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:15.102 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:15.097+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:15.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:15.174+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:15.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:15.593+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:15.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:15.619+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:15.698 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:15.692+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:15.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:15.757+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:15.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:15.759+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:16.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:16.114+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:16.205 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:16.198+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:16.600 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:16.592+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:16.650 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:16.640+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:16.669 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:16.662+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:16.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:16.790+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:16.822 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:16.792+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:17.163 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:17.156+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:17.242 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:17.235+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:17.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:17.618+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:17.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:17.648+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:17.698 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:17.690+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:17.836 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:17.828+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:17.838 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:17.831+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:18.141 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:18.134+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:18.231 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:18.223+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:18.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:18.633+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:18.655 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:18.648+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:18.711 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:18.704+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:18.864 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:18.858+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:18.864 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:18.859+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:18.966 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:07:18.955+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e888 v888) 2019-11-29T20:07:19.177 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:19.172+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:19.227 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:19.221+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:19.614 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:19.607+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:19.637 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:19.630+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:19.756 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:19.749+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:19.850 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:19.843+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:19.851 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:19.845+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:20.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:20.176+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:20.202 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:20.195+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:20.232 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:20.223+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:20.664 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:20.656+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:20.674 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:20.666+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:20.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:20.758+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:20.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:20.848+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:20.855 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:20.850+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:21.166 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:21.159+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:21.215 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:21.207+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:21.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:21.218+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:21.670 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:21.663+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:21.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:21.677+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:21.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:21.718+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:21.816 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:21.806+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:21.817 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:21.808+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:22.174 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:22.166+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:22.217 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:22.210+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:22.237 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:22.230+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:22.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:22.617+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:22.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:22.639+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:22.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:22.680+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:22.769 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:22.762+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:22.772 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:22.765+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:23.174 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:23.165+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:23.219 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:23.211+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:23.231 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:23.224+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:23.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:23.666+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:23.682 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:23.671+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:23.686 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:23.679+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:23.728 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:23.719+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:23.729 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:23.722+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:23.977 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:07:23.971+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e888 v888) 2019-11-29T20:07:24.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:24.179+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:24.230 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:24.221+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:24.264 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:24.257+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:24.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:24.632+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:24.666 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:24.659+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:24.703 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:24.695+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:24.746 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:24.740+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:24.749 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:24.743+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:25.180 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:25.173+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:25.206 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:25.198+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:25.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:25.230+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:25.629 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:25.623+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:25.688 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:25.681+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:25.697 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:25.689+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:25.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:25.755+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:25.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:25.756+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:26.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:26.151+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:26.197 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:26.191+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:26.287 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:26.277+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:26.633 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:26.624+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:26.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:26.679+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:26.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:26.717+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:26.790 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:26.783+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:26.791 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:26.785+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:27.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:27.165+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:27.244 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:27.239+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:27.299 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:27.293+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:27.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:27.609+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:27.685 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:27.678+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:27.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:27.737+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:27.762 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:27.755+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:27.763 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:27.757+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:28.174 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:28.167+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:28.284 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:07:28.278+0000 1694c700 -1 osd.2 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.268565+0000 front 2019-11-29T20:06:05.430214+0000 (oldest deadline 2019-11-29T20:07:19.590294+0000) 2019-11-29T20:07:28.339 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:28.329+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:28.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:07:28.616+0000 1694c700 -1 osd.5 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.065424+0000 front 2019-11-29T20:06:04.126621+0000 (oldest deadline 2019-11-29T20:06:46.651019+0000) 2019-11-29T20:07:28.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:07:28.682+0000 1694c700 -1 osd.6 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:05.428768+0000 front 2019-11-29T20:06:05.268407+0000 (oldest deadline 2019-11-29T20:06:49.273485+0000) 2019-11-29T20:07:28.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:28.729+0000 1694c700 -1 osd.0 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:06:15.403256+0000 (oldest deadline 2019-11-29T20:06:55.403256+0000) 2019-11-29T20:07:28.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:07:28.733+0000 1694c700 -1 osd.0 888 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e885) 2019-11-29T20:07:28.760 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:07:28.753+0000 1694c700 -1 osd.7 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:04.772856+0000 front 2019-11-29T20:06:05.879412+0000 (oldest deadline 2019-11-29T20:06:45.852536+0000) 2019-11-29T20:07:29.063 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:07:29.055+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e888 v888) 2019-11-29T20:07:29.132 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:07:29.126+0000 1694c700 -1 osd.1 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:02.430857+0000 front 2019-11-29T20:06:02.412588+0000 (oldest deadline 2019-11-29T20:06:47.606697+0000) 2019-11-29T20:07:29.303 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:07:29.297+0000 1694c700 -1 osd.4 888 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:06:01.339673+0000 front 2019-11-29T20:06:01.252676+0000 (oldest deadline 2019-11-29T20:06:45.874079+0000) 2019-11-29T20:07:59.808 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:07:59.798+0000 30f82700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:00.324 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:00.279+0000 3578b700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:00.385 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:00.374+0000 3578b700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:00.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:00.954+0000 36f8e700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:01.119 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:01.103+0000 31783700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:01.546 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:01.497+0000 37f90700 -1 osd.3 893 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:02.109 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:08:02.079+0000 34f8a700 -1 osd.3 894 build_incremental_map_msg missing incremental map 893 2019-11-29T20:08:48.110 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:48.104+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:49.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:49.079+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:50.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:50.097+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:51.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:51.065+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:52.032 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:52.026+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:53.007 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:53.001+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:54.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:54.026+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:55.071 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:55.061+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:56.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:56.091+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:57.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:57.116+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:58.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:58.126+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:08:59.094 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:08:59.089+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:00.100 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:00.090+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:00.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:00.094+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:00.169 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:00.162+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:00.494 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:00.488+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:00.988 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:00.981+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:01.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:01.064+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:01.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:01.144+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:01.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:01.147+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:01.179 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:01.172+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:01.482 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:01.468+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:01.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:01.721+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:02.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:02.020+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:02.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:02.040+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:02.142 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:02.135+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:02.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:02.140+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:02.156 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:02.151+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:02.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:02.489+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:02.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:02.690+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:03.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:03.017+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:03.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:03.067+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:03.116 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:03.108+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:03.121 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:03.114+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:03.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:03.119+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:03.543 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:03.531+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:03.573 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:03.565+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:03.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:03.694+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:04.058 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:04.052+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:04.070 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:04.064+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:04.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:04.132+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:04.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:04.134+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:04.167 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:04.159+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:04.537 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:04.529+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:04.538 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:04.532+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:04.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:04.708+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:05.016 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:05.010+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:05.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:05.094+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:05.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:05.094+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:05.103 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:05.097+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:05.161 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:05.154+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:05.519 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:05.512+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:05.589 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:05.581+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:05.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:05.721+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:06.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:06.030+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:06.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:06.084+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:06.092 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:06.086+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:06.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:06.109+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:06.178 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:06.172+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:06.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:06.514+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:06.594 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:06.587+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:06.695 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:06.688+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:07.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:07.017+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:07.051 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:07.043+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:07.051 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:07.046+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:07.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:07.121+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:07.162 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:07.150+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:07.571 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:07.564+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:07.637 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:07.630+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:07.683 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:07.675+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:08.031 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:08.023+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:08.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:08.046+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:08.058 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:08.048+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:08.137 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:08.131+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:08.137 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:08.129+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:08.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:08.599+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:08.640 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:08.633+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:08.673 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:08.666+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:09.043 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:09.036+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:09.092 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:09.081+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:09.093 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:09.086+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:09.102 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:09.095+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:09.177 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:09.170+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:09.619 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:09.612+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:09.698 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:09.676+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:09.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:09.717+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:10.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:10.014+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:10.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:10.048+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:10.056 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:10.051+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:10.170 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:10.147+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:10.170 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:10.153+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:10.657 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:10.650+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:10.706 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:10.697+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:10.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:10.711+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:11.041 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:11.033+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:11.042 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:11.036+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:11.072 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:11.066+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:11.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:11.123+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:11.142 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:11.136+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:11.712 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:11.706+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:11.719 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:11.713+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:11.757 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:11.751+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:12.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:12.039+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:12.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:12.051+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:12.062 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:12.053+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:12.158 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:12.151+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:12.172 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:12.165+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:12.733 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:12.727+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:12.736 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:12.728+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:12.741 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:12.735+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:13.055 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:13.046+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:13.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:13.060+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:13.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:13.064+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:13.145 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:13.138+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:13.149 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:13.143+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:13.766 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:13.757+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:13.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:13.754+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:13.766 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:13.758+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:14.033 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:14.021+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:14.036 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:14.027+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:14.107 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:14.100+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:14.140 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:14.134+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:14.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:14.170+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:14.742 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:14.736+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:14.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:14.738+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:14.779 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:14.772+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:15.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:15.061+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:15.069 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:15.064+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:15.119 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:15.112+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:15.162 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:15.156+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:15.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:15.199+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:15.718 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:15.713+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:15.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:15.737+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:15.763 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:15.756+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:16.106 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:16.094+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:16.114 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:16.107+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:16.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:16.108+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:16.190 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:16.179+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:16.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:16.206+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:16.688 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:16.681+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:16.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:16.754+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:16.780 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:16.773+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:17.061 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:17.053+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:17.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:17.137+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:17.145 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:17.140+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:17.216 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:17.210+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:17.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:17.213+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:17.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:17.699+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:17.732 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:17.722+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:17.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:17.806+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:18.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:18.030+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:18.126 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:18.118+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:18.128 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:18.122+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:18.182 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:18.176+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:18.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:18.194+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:18.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:18.665+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:18.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:18.679+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:18.870 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:18.858+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:19.017 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:19.002+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:19.140 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:19.130+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:19.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:19.133+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:19.188 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:19.180+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:19.260 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:19.253+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:19.646 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:19.641+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:19.647 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:19.639+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:19.875 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:19.869+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:20.015 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:20.008+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:20.124 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:20.116+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:20.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:20.120+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:20.186 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:20.179+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:20.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:20.289+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:20.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:20.648+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:20.667 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:20.655+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:20.916 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:20.909+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:21.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:21.040+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:21.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:21.109+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:21.117 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:21.112+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:21.140 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:21.134+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:21.341 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:21.333+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:21.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:21.637+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:21.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:21.675+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:21.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:21.894+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:22.093 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:22.080+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:22.111 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:22.103+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:22.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:22.121+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:22.130 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:22.125+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:22.295 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:22.289+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:22.627 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:22.619+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:22.717 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:22.710+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:22.892 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:22.885+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:23.070 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:23.065+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:23.136 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:23.129+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:23.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:23.140+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:23.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:23.143+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:23.335 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:23.328+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:23.652 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:23.646+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:23.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:23.758+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:23.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:23.848+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:24.051 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:24.042+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:24.157 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:24.149+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:24.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:24.152+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:24.192 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:24.185+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:24.322 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:24.315+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:24.613 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:24.606+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:24.804 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:24.797+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:24.899 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:24.891+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:25.045 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:25.037+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:25.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:25.181+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:25.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:25.196+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:25.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:25.201+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:25.361 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:25.354+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:25.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:25.596+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:25.804 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:25.798+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:25.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:25.847+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:26.025 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:26.019+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:26.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:26.189+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:26.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:26.199+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:26.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:26.202+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:26.402 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:26.395+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:26.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:26.622+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:26.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:26.783+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:26.901 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:26.893+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:26.983 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:26.977+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:27.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:27.190+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:27.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:27.193+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:27.246 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:27.237+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:27.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:27.378+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:27.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:27.601+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:27.792 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:27.786+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:27.898 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:27.893+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:27.997 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:53:36.132 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.016 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:53:36.197 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.017 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:53:36.198 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.018 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:53:36.153 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.020 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:53:36.201 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.022 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:53:36.202 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.034 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:28.027+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:28.185 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:28.178+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:28.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:28.183+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:28.263 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:53:36.441 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.684 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:28.256+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:28.685 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:53:36.433 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:28.562+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:28.685 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:53:36.448 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:09:28.685 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:28.423+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:28.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:28.793+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:28.918 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:28.911+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:29.045 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:29.038+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:29.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:29.223+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:29.234 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:29.226+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:29.316 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:29.310+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:29.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:29.436+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:29.581 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:29.575+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:29.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:29.820+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:29.917 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:29.910+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:30.073 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:30.066+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:30.237 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:30.229+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:30.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:30.234+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:30.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:30.334+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:30.471 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:30.464+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:30.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:30.558+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:30.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:30.822+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:30.969 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:30.960+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:31.085 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:31.079+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:31.203 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:31.195+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:31.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:31.198+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:31.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:31.303+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:31.499 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:31.492+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:31.587 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:31.578+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:31.861 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:31.854+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:32.033 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:32.010+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:32.128 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:32.121+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:32.200 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:32.193+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:32.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:32.195+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:32.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:32.343+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:32.530 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:32.525+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:32.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:32.576+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:32.882 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:32.875+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:33.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:33.058+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:33.180 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:33.173+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:33.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:33.186+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:33.196 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:33.191+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:33.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:33.304+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:33.572 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:33.566+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:33.616 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:33.609+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:33.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:33.844+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:34.035 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:09:34.021+0000 1694c700 -1 osd.7 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:14.912011+0000 front 2019-11-29T20:08:14.922456+0000 (oldest deadline 2019-11-29T20:08:59.587502+0000) 2019-11-29T20:09:34.189 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:09:34.184+0000 1694c700 -1 osd.3 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.547659+0000 front 2019-11-29T20:08:18.332527+0000 (oldest deadline 2019-11-29T20:09:00.010999+0000) 2019-11-29T20:09:34.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:34.194+0000 1694c700 -1 osd.6 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.078751+0000 front 2019-11-29T20:08:15.634771+0000 (oldest deadline 2019-11-29T20:08:59.763603+0000) 2019-11-29T20:09:34.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:34.199+0000 1694c700 -1 osd.6 894 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:34.282 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:09:34.274+0000 1694c700 -1 osd.5 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:15.021467+0000 front 2019-11-29T20:08:15.023804+0000 (oldest deadline 2019-11-29T20:09:00.197304+0000) 2019-11-29T20:09:34.574 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:09:34.569+0000 1694c700 -1 osd.2 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.269210+0000 front 2019-11-29T20:08:17.277575+0000 (oldest deadline 2019-11-29T20:09:00.190612+0000) 2019-11-29T20:09:34.590 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:09:34.577+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e894 v894) 2019-11-29T20:09:34.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:09:34.631+0000 1694c700 -1 osd.4 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:18.962190+0000 front 2019-11-29T20:08:18.908969+0000 (oldest deadline 2019-11-29T20:09:01.176273+0000) 2019-11-29T20:09:34.845 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:09:34.840+0000 1694c700 -1 osd.1 894 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:08:17.522442+0000 front 2019-11-29T20:08:17.521736+0000 (oldest deadline 2019-11-29T20:09:02.797901+0000) 2019-11-29T20:09:35.213 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:35.208+0000 1694c700 -1 osd.6 895 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:09:36.330 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:09:36.321+0000 1694c700 -1 osd.6 896 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4528.0:81769 7.7 7:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=70b] snapc 0=[] ondisk+write+known_if_redirected e894) 2019-11-29T20:10:05.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:05.065+0000 1694c700 -1 osd.1 896 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:125140 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 191] snapc 0=[] ondisk+write+known_if_redirected e895) 2019-11-29T20:10:06.131 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:06.123+0000 1694c700 -1 osd.1 896 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:125140 5.5 5:a93a5511:::notify.2:head [watch reconnect cookie 821383552 gen 191] snapc 0=[] ondisk+write+known_if_redirected e895) 2019-11-29T20:10:13.079 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:13.074+0000 114ab700 -1 osd.0 900 build_incremental_map_msg missing incremental map 900 2019-11-29T20:10:14.088 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:14.081+0000 34789700 -1 osd.0 900 build_incremental_map_msg missing incremental map 900 2019-11-29T20:10:14.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:14.407+0000 32f86700 -1 osd.0 900 build_incremental_map_msg missing incremental map 900 2019-11-29T20:10:32.677 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:32.671+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:33.290 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:33.284+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:33.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:33.680+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:33.736 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:33.714+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:34.214 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:34.206+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:34.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:34.282+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:34.724 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:34.718+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:34.739 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:34.733+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:35.241 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:35.233+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:35.293 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:35.287+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:35.719 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:35.713+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:35.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:35.719+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:36.244 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:36.236+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:36.272 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:36.265+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:36.276 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:36.269+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:36.709 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:36.702+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:36.745 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:36.739+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:37.232 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:37.225+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:37.276 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:37.268+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:37.280 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:37.274+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:37.554 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:37.547+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:37.705 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:37.699+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:37.736 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:37.730+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:38.273 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:38.264+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:38.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:38.287+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:38.327 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:38.320+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:38.516 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:38.510+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:38.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:38.698+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:38.782 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:38.775+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:39.284 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:39.278+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:39.307 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:39.301+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:39.315 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:39.308+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:39.560 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:39.553+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:39.748 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:39.734+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:39.841 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:39.818+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:40.189 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:40.183+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:40.327 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:40.319+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:40.345 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:40.339+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:40.356 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:40.349+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:40.550 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:40.543+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:40.705 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:40.698+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:40.823 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:40.816+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:41.181 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:41.176+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:41.295 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:41.289+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:41.316 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:41.310+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:41.382 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:41.376+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:41.578 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:41.571+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:41.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:41.680+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:41.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:41.803+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:42.196 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:42.190+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:42.310 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:42.303+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:42.318 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:42.311+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:42.382 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:42.376+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:42.569 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:42.563+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:42.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:42.683+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:42.838 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:42.832+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:43.232 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:43.226+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:43.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:43.283+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:43.300 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:43.293+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:43.418 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:43.412+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:43.577 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:43.570+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:43.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:43.687+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:43.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:43.807+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:44.250 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:44.245+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:44.264 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:44.258+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:44.320 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:44.314+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:44.430 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:44.424+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:44.581 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:44.574+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:44.674 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:44.667+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:44.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:44.842+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:45.232 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:45.223+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:45.295 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:45.290+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:45.357 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:45.350+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:45.422 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:45.416+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:45.634 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:45.627+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:45.722 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:45.711+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:45.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:45.807+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:46.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:46.256+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:46.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:46.261+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:46.327 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:46.320+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:46.404 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:46.399+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:46.435 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:46.429+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:46.638 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:46.631+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:46.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:46.728+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:46.814 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:46.807+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:47.314 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:47.305+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:47.315 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:47.308+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:47.338 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:47.332+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:47.405 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:47.399+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:47.414 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:47.408+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:47.674 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:47.668+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:47.725 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:47.718+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:47.859 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:47.853+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:48.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:48.304+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:48.311 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:48.305+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:48.365 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:48.354+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:48.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:48.349+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:48.413 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:48.406+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:48.668 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:48.662+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:48.695 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:48.682+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:48.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:48.836+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:49.317 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:49.310+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:49.349 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:49.340+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:49.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:49.344+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:49.375 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:49.368+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:49.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:49.418+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:49.650 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:49.644+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:49.729 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:49.706+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:49.836 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:49.829+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:50.301 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:50.295+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:50.363 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:50.356+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:50.393 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:50.387+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:50.395 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:50.390+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:50.453 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:50.447+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:50.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:50.671+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:50.721 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:50.714+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:50.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:50.813+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:51.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:51.343+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:51.365 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:51.357+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:51.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:51.378+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:51.406 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:51.381+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:51.426 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:51.412+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:51.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:51.689+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:51.767 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:51.760+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:51.801 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:51.793+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:52.314 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:52.307+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:52.411 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:52.402+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:52.415 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:52.410+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:52.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:52.413+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:52.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:52.462+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:52.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:52.669+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:52.733 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:52.726+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:52.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:52.847+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:53.272 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:53.263+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:53.386 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:53.379+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:53.394 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:53.381+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:53.435 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:53.428+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:53.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:53.479+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:53.688 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:53.682+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:53.756 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:53.750+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:53.827 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:53.820+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:54.261 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:54.250+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:54.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:54.406+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:54.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:54.409+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:54.462 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:54.455+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:54.483 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:54.476+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:54.644 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:54.637+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:54.790 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:54.784+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:54.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:54.859+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:55.264 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:55.259+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:55.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:55.363+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:55.371 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:55.365+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:55.459 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:55.452+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:55.492 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:55.486+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:55.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:55.688+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:55.805 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:55.795+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:55.832 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:55.825+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:56.257 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:56.250+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:56.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:56.402+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:56.409 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:56.403+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:56.464 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:56.458+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:56.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:56.482+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:56.667 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:56.660+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:56.768 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:56.762+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:56.795 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:56.788+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:57.306 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:57.298+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:57.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:57.407+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:57.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:57.408+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:57.455 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:57.445+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:57.491 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:57.485+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:57.663 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:57.656+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:57.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:57.777+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:57.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:57.815+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:58.322 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:58.313+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:58.377 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:58.370+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:58.377 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:58.372+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:58.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:58.421+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:58.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:58.448+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:58.640 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:58.635+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:58.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:58.795+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:58.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:58.838+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:10:59.345 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:10:59.338+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:10:59.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:59.378+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:10:59.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:10:59.382+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:10:59.483 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:10:59.476+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:10:59.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:10:59.495+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:10:59.608 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:10:59.602+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:10:59.802 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:10:59.795+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:10:59.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:10:59.842+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:00.339 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:00.333+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:00.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:00.396+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:00.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:00.399+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:00.473 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:00.467+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:00.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:00.527+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:00.607 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:00.600+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:00.852 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:00.841+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:00.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:00.861+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:01.334 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:01.327+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:01.404 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:01.396+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:01.405 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:01.398+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:01.505 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:01.498+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:01.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:01.582+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:01.659 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:01.651+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:01.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:01.870+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:01.880 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:01.873+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:02.348 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:02.341+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:02.372 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:02.366+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:02.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:02.368+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:02.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:02.501+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:02.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:02.611+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:02.644 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:02.638+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:02.892 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:02.885+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:02.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:02.885+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:03.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:03.325+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:03.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:03.327+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:03.348 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:03.341+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:03.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:03.494+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:03.604 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:03.598+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:03.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:03.603+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:03.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:03.848+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:03.933 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:03.927+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:04.291 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:04.284+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:04.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:04.287+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:04.389 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:04.383+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:04.522 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:04.516+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:04.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:04.618+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:04.645 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:04.639+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:04.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:04.889+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:04.954 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:11:04.948+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e900 v900) 2019-11-29T20:11:04.977 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:04.970+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:05.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:05.259+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:05.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:05.261+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:05.428 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:05.421+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:05.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:05.487+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:05.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:05.611+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:05.623 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:05.616+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:05.871 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:05.863+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:06.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:05.998+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:06.230 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:06.223+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:06.232 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:06.227+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:06.481 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:06.474+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:06.515 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:06.507+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:06.627 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:06.620+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:06.656 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:06.649+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:06.913 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:06.903+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:06.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:06.959+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:07.255 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:07.247+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:07.256 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:07.250+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:07.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:07.472+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:07.525 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:07.517+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:07.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:07.653+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:07.670 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:07.662+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:07.866 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:07.860+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:08.014 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:08.007+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:08.245 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:08.237+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:08.246 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:08.239+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:08.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:08.517+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:08.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:08.527+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:08.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:08.624+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:08.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:08.715+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:08.860 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:08.853+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:09.051 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:09.043+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:09.262 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:09.256+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:09.266 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:09.260+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:09.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:09.515+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:09.578 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:09.571+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:09.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:09.629+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:09.677 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:09.669+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:09.871 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:09.863+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:09.984 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:11:09.976+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e900 v900) 2019-11-29T20:11:10.087 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:10.081+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:10.273 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:10.258+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:10.273 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:10.261+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:10.495 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:10.490+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:10.622 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:10.614+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:10.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:10.679+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:10.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:10.680+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:10.844 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:10.836+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:11.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:11.134+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:11.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:11.288+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:11.299 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:11.290+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:11.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:11.543+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:11.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:11.596+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:11.708 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:11.701+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:11.720 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:11.713+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:11.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:11.850+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:12.143 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:12.136+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:12.275 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:12.267+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:12.276 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:12.270+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:12.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:12.531+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:12.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:12.618+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:12.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:12.699+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:12.734 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:12.727+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:12.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:12.899+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:13.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:13.136+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:13.321 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:13.314+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:13.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:13.316+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:13.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:13.531+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:13.589 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:13.581+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:13.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:13.675+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:13.744 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:13.736+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:13.874 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:13.865+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:14.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:14.174+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:14.304 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:14.294+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:14.307 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:14.295+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:14.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:14.531+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:14.635 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:14.627+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:14.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:14.672+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:14.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:14.753+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:14.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:14.842+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:15.003 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:11:14.995+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e900 v900) 2019-11-29T20:11:15.136 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:15.128+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:15.312 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:15.307+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:15.313 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:15.308+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:15.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:15.570+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:15.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:15.619+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:15.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:15.630+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:15.762 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:15.756+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:15.853 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:15.847+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:16.152 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:16.145+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:16.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:16.316+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:16.327 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:16.318+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:16.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:16.524+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:16.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:16.623+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:16.680 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:16.673+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:16.731 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:16.726+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:16.881 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:16.874+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:17.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:17.134+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:17.333 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:17.327+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:17.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:17.329+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:17.521 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:17.514+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:17.646 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:17.638+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:17.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:17.687+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:17.716 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:17.709+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:17.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:17.860+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:18.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:18.117+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:18.390 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:18.383+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:18.391 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:18.384+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:18.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:18.528+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:18.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:18.631+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:18.668 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:18.657+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:18.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:18.758+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:18.858 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:18.851+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:19.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:19.077+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:19.372 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:19.366+0000 1694c700 -1 osd.0 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:10:06.223024+0000 (oldest deadline 2019-11-29T20:10:46.223024+0000) 2019-11-29T20:11:19.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:19.368+0000 1694c700 -1 osd.0 900 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:19.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:11:19.541+0000 1694c700 -1 osd.1 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:49.554776+0000 front 2019-11-29T20:09:49.546627+0000 (oldest deadline 2019-11-29T20:10:33.537524+0000) 2019-11-29T20:11:19.664 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:11:19.657+0000 1694c700 -1 osd.4 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.221571+0000 front 2019-11-29T20:09:50.204512+0000 (oldest deadline 2019-11-29T20:10:36.070252+0000) 2019-11-29T20:11:19.686 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:11:19.679+0000 1694c700 -1 osd.2 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.197704+0000 front 2019-11-29T20:09:51.194776+0000 (oldest deadline 2019-11-29T20:10:37.088447+0000) 2019-11-29T20:11:19.783 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:11:19.776+0000 1694c700 -1 osd.5 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:51.314440+0000 front 2019-11-29T20:09:51.366133+0000 (oldest deadline 2019-11-29T20:10:32.988898+0000) 2019-11-29T20:11:19.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:11:19.809+0000 1694c700 -1 osd.7 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:50.879765+0000 front 2019-11-29T20:09:50.873819+0000 (oldest deadline 2019-11-29T20:10:31.944535+0000) 2019-11-29T20:11:20.078 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:11:20.058+0000 1694c700 -1 osd.6 900 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:09:48.377368+0000 front 2019-11-29T20:09:48.499663+0000 (oldest deadline 2019-11-29T20:10:33.054139+0000) 2019-11-29T20:11:20.084 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:11:20.076+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 42sec e900 v900) 2019-11-29T20:11:20.448 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:11:20.439+0000 1694c700 -1 osd.0 901 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4528.0:80538 7.f 7.aabb27bf (undecoded) ondisk+retry+read+known_if_redirected e898) 2019-11-29T20:11:46.392 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:11:46.387+0000 3778f700 -1 osd.3 905 build_incremental_map_msg missing incremental map 905 2019-11-29T20:11:46.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:11:46.460+0000 3778f700 -1 osd.3 905 build_incremental_map_msg missing incremental map 905 2019-11-29T20:11:46.660 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:11:46.642+0000 31783700 -1 osd.3 905 build_incremental_map_msg missing incremental map 905 2019-11-29T20:11:46.800 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:11:46.793+0000 3778f700 -1 osd.3 905 build_incremental_map_msg missing incremental map 905 2019-11-29T20:11:49.582 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:11:49.572+0000 34f8a700 -1 osd.3 906 build_incremental_map_msg missing incremental map 905 2019-11-29T20:12:35.508 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:56:43.643 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.510 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:56:43.646 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.552 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:56:43.732 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.555 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:56:43.735 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.578 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:56:43.754 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.578 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:56:43.756 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.715 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:56:43.850 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.778 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:56:43.956 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:35.801 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:56:43.982 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:12:45.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:45.528+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:45.865 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:45.858+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:45.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:45.935+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:46.198 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:46.191+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:46.569 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:46.561+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:46.871 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:46.865+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:46.953 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:46.940+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:47.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:47.030+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:47.242 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:47.233+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:47.614 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:47.607+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:47.848 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:47.842+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:47.913 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:47.907+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:48.037 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:48.029+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:48.238 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:48.231+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:48.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:48.416+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:48.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:48.573+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:48.893 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:48.885+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:48.959 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:48.953+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:49.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:49.055+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:49.215 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:49.208+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:49.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:49.429+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:49.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:49.558+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:49.811 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:49.804+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:49.908 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:49.900+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:50.003 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:49.997+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:50.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:50.074+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:50.206 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:50.199+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:50.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:50.415+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:50.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:50.547+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:50.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:50.831+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:50.959 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:50.951+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:50.983 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:50.973+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:51.087 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:51.081+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:51.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:51.225+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:51.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:51.379+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:51.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:51.522+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:51.797 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:51.790+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:51.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:51.958+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:51.985 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:51.978+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:52.121 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:52.114+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:52.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:52.195+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:52.367 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:52.358+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:52.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:52.519+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:52.811 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:52.802+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:52.960 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:52.954+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:53.015 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:53.010+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:53.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:53.154+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:53.176 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:53.167+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:53.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:53.331+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:53.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:53.497+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:53.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:53.848+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:53.918 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:53.913+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:53.972 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:53.966+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:54.189 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:54.183+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:54.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:54.197+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:54.354 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:54.347+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:54.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:54.545+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:54.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:54.886+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:54.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:54.897+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:55.018 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:55.013+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:55.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:55.137+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:55.188 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:55.181+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:55.388 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:55.381+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:55.579 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:55.572+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:55.859 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:55.853+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:55.941 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:55.930+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:55.978 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:55.972+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:56.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:56.121+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:56.234 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:56.227+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:56.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:56.429+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:56.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:56.612+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:56.855 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:56.849+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:56.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:56.976+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:56.984 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:56.978+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:57.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:57.103+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:57.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:57.200+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:57.479 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:57.472+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:57.642 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:57.629+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:57.872 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:57.863+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:57.949 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:57.943+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:58.018 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:58.011+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:58.122 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:58.116+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:58.215 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:58.208+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:58.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:58.505+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:58.630 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:58.622+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:58.923 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:58.917+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:12:58.936 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:58.930+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:59.011 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:12:59.005+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:12:59.124 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:12:59.117+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:12:59.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:12:59.167+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:12:59.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:12:59.477+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:12:59.619 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:12:59.612+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:12:59.959 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:12:59.954+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:12:59.969 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:12:59.962+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:00.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:00.034+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:00.146 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:00.140+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:00.185 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:00.178+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:00.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:00.481+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:00.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:00.573+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:00.943 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:00.935+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:00.998 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:00.990+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:01.088 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:01.082+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:01.184 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:01.175+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:01.211 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:01.204+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:01.512 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:01.504+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:01.589 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:01.580+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:01.975 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:01.967+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:01.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:01.974+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:02.052 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:02.044+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:02.168 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:02.158+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:02.247 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:02.240+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:02.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:02.484+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:02.632 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:02.624+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:02.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:02.946+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:03.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:03.019+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:03.079 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:03.071+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:03.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:03.113+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:03.257 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:03.248+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:03.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:03.443+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:03.610 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:03.603+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:03.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:03.918+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:04.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:04.030+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:04.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:04.034+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:04.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:04.139+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:04.248 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:04.241+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:04.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:04.418+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:04.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:04.601+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:04.921 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:04.914+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:05.021 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:05.014+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:05.047 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:05.040+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:05.109 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:05.102+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:05.237 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:05.229+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:05.431 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:05.425+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:05.572 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:05.565+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:05.922 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:05.915+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:05.993 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:05.987+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:06.008 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:06.003+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:06.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:06.108+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:06.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:06.203+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:06.424 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:06.417+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:06.542 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:06.535+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:06.879 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:06.873+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:07.003 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:06.997+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:07.009 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:07.001+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:07.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:07.061+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:07.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:07.243+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:07.431 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:07.424+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:07.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:07.510+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:07.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:07.875+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:07.965 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:07.960+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:08.046 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:08.040+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:08.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:08.048+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:08.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:08.207+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:08.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:08.442+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:08.565 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:08.558+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:08.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:08.863+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:09.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:09.006+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:09.015 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:09.008+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:09.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:09.010+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:09.248 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:09.241+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:09.404 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:09.397+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:09.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:09.569+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:09.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:09.817+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:09.990 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:09.984+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:10.006 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:10.001+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:10.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:10.034+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:10.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:10.211+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:10.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:10.389+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:10.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:10.545+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:10.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:10.824+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:11.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:11.034+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:11.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:11.041+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:11.072 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:11.066+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:11.261 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:11.254+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:11.405 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:11.398+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:11.527 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:11.520+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:11.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:11.779+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:12.029 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:12.011+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:12.064 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:12.055+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:12.067 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:12.059+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:12.269 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:12.262+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:12.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:12.444+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:12.570 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:12.563+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:12.823 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:12.816+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:12.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:12.969+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:13.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:13.060+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:13.114 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:13.108+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:13.257 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:13.250+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:13.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:13.466+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:13.586 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:13.579+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:13.831 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:13.819+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:13.998 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:13.991+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:14.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:14.089+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:14.149 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:14.144+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:14.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:14.210+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:14.529 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:14.521+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:14.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:14.589+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:14.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:14.791+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:14.952 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:14.945+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:15.094 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:15.087+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:15.140 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:15.134+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:15.256 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:15.248+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:15.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:15.511+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:15.580 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:13:15.575+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e906 v906) 2019-11-29T20:13:15.620 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:15.613+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:15.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:15.844+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:15.985 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:15.975+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:16.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:16.096+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:16.154 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:16.147+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:16.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:16.255+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:16.528 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:16.521+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:16.604 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:16.597+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:16.836 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:16.830+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:17.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:17.012+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:17.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:17.074+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:17.182 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:17.176+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:17.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:17.288+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:17.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:17.507+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:17.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:17.630+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:17.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:17.848+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:18.045 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:18.038+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:18.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:18.126+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:18.211 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:18.204+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:18.309 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:18.300+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:18.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:18.468+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:18.692 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:18.684+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:18.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:18.900+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:19.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:19.052+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:19.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:19.144+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:19.244 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:19.239+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:19.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:19.313+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:19.490 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:19.483+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:19.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:19.684+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:19.867 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:13:19.861+0000 1694c700 -1 osd.1 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.407672+0000 front 2019-11-29T20:12:00.493014+0000 (oldest deadline 2019-11-29T20:12:45.677492+0000) 2019-11-29T20:13:20.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:20.078+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:20.184 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:13:20.177+0000 1694c700 -1 osd.2 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.029124+0000 front 2019-11-29T20:12:00.031480+0000 (oldest deadline 2019-11-29T20:12:45.787627+0000) 2019-11-29T20:13:20.285 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:13:20.280+0000 1694c700 -1 osd.3 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:11:59.553995+0000 front 2019-11-29T20:11:59.514549+0000 (oldest deadline 2019-11-29T20:12:45.407782+0000) 2019-11-29T20:13:20.358 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:13:20.351+0000 1694c700 -1 osd.7 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.925870+0000 front 2019-11-29T20:12:03.923330+0000 (oldest deadline 2019-11-29T20:12:46.118808+0000) 2019-11-29T20:13:20.540 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:13:20.533+0000 1694c700 -1 osd.4 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.604116+0000 front 2019-11-29T20:12:03.630839+0000 (oldest deadline 2019-11-29T20:12:48.269111+0000) 2019-11-29T20:13:20.661 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:13:20.655+0000 1694c700 -1 osd.6 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:00.611565+0000 front 2019-11-29T20:12:00.755525+0000 (oldest deadline 2019-11-29T20:12:45.279485+0000) 2019-11-29T20:13:20.664 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:13:20.656+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e906 v906) 2019-11-29T20:13:21.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:13:21.078+0000 1694c700 -1 osd.5 906 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:12:03.838595+0000 front 2019-11-29T20:12:03.846036+0000 (oldest deadline 2019-11-29T20:12:49.127614+0000) 2019-11-29T20:13:21.275 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:57:29.410 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.285 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:57:29.420 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.291 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:57:29.472 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.291 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:57:29.471 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.292 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:57:29.474 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.295 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:57:29.475 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.362 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:08:57:29.497 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.373 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:08:57:29.553 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:21.380 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:08:57:29.560 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:13:48.185 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:13:48.172+0000 2184f700 -1 reset not still connected to 0xea8b000 2019-11-29T20:13:48.185 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:13:48.172+0000 2184f700 -1 reset not still connected to 0x1cc80610 2019-11-29T20:14:18.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:18.680+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:19.509 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:19.502+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:19.665 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:19.658+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:19.674 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:19.668+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:19.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:19.684+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:20.553 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:20.547+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:20.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:20.680+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:20.690 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:20.684+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:20.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:20.707+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:20.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:20.899+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:21.601 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:21.594+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:21.657 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:21.650+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:21.694 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:21.688+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:21.733 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:21.727+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:21.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:21.752+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:21.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:21.852+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:22.609 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:22.592+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:22.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:22.638+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:22.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:22.728+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:22.776 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:22.769+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:22.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:22.781+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:22.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:22.813+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:23.595 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:23.589+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:23.621 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:23.613+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:23.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:23.737+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:23.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:23.772+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:23.804 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:23.798+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:23.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:23.806+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:24.209 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:24.202+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:24.567 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:24.561+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:24.625 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:24.618+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:24.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:24.729+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:24.747 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:24.740+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:24.797 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:24.791+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:24.826 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:24.820+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:25.237 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:25.232+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:25.536 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:25.531+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:25.667 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:25.661+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:25.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:25.689+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:25.787 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:25.782+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:25.788 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:25.783+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:25.806 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:25.798+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:26.221 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:26.216+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:26.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:26.542+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:26.703 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:26.696+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:26.721 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:26.716+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:26.758 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:26.752+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:26.799 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:26.793+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:26.831 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:26.826+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:27.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:27.265+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:27.571 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:27.564+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:27.680 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:27.674+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:27.721 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:27.716+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:27.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:27.726+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:27.815 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:27.806+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:27.844 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:27.838+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:28.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:28.304+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:28.578 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:28.572+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:28.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:28.702+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:28.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:28.706+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:28.765 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:28.759+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:28.821 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:28.815+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:28.825 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:28.818+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:29.290 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:29.286+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:29.575 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:29.567+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:29.733 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:29.727+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:29.751 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:29.744+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:29.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:29.793+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:29.827 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:29.821+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:29.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:29.837+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:30.320 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:30.313+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:30.326 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:30.319+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:30.622 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:30.616+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:30.754 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:30.748+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:30.770 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:30.763+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:30.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:30.834+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:30.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:30.852+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:30.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:30.855+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:31.316 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:31.308+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:31.317 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:31.311+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:31.649 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:31.643+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:31.739 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:31.732+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:31.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:31.775+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:31.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:31.856+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:31.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:31.866+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:31.912 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:31.905+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:32.360 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:32.354+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:32.360 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:32.355+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:32.658 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:32.653+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:32.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:32.689+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:32.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:32.768+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:32.861 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:32.854+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:32.906 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:32.900+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:32.942 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:32.935+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:33.402 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:33.392+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:33.403 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:33.393+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:33.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:33.664+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:33.709 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:33.704+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:33.824 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:33.818+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:33.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:33.826+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:33.900 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:33.894+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:33.928 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:33.922+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:34.369 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:34.362+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:34.370 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:34.364+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:34.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:34.657+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:34.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:34.681+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:34.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:34.831+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:34.872 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:34.865+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:34.929 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:34.923+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:34.948 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:34.942+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:35.418 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:35.412+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:35.420 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:35.415+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:35.678 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:35.673+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:35.724 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:35.718+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:35.801 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:35.794+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:35.853 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:35.846+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:35.903 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:35.896+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:35.986 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:35.980+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:36.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:36.436+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:36.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:36.440+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:36.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:36.706+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:36.747 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:36.741+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:36.756 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:36.750+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:36.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:36.854+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:36.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:36.889+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:36.992 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:36.986+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:37.439 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:37.433+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:37.442 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:37.437+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:37.709 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:37.703+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:37.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:37.734+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:37.754 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:37.748+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:37.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:37.848+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:37.888 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:37.882+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:38.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:38.034+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:38.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:38.424+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:38.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:38.426+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:38.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:38.690+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:38.752 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:38.746+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:38.775 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:38.768+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:38.866 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:38.860+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:38.943 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:38.937+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:39.074 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:39.068+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:39.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:39.440+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:39.447 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:39.442+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:39.746 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:39.741+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:39.765 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:39.759+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:39.767 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:39.762+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:39.840 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:39.830+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:39.916 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:39.909+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:40.047 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:40.041+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:40.466 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:40.459+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:40.467 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:40.462+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:40.706 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:40.700+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:40.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:40.738+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:40.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:40.802+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:40.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:40.836+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:40.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:40.863+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:41.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:41.035+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:41.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:41.425+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:41.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:41.429+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:41.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:41.707+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:41.759 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:41.753+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:41.795 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:41.790+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:41.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:41.866+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:41.891 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:41.885+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:42.059 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:42.053+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:42.432 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:42.425+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:42.433 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:42.428+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:42.700 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:42.695+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:42.764 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:42.758+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:42.803 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:42.796+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:42.850 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:42.843+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:42.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:42.886+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:43.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:43.108+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:43.427 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:43.421+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:43.429 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:43.424+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:43.660 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:43.653+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:43.800 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:43.788+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:43.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:43.843+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:43.900 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:43.893+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:43.936 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:43.931+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:44.162 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:44.156+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:44.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:44.430+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:44.440 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:44.434+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:44.675 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:44.669+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:44.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:44.800+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:44.818 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:44.812+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:44.878 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:44.871+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:44.910 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:44.903+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:45.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:45.122+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:45.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:45.470+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:45.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:45.472+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:45.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:45.656+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:45.779 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:45.773+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:45.809 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:45.802+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:45.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:45.871+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:45.894 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:45.888+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:46.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:46.139+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:46.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:46.517+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:46.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:46.518+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:46.708 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:46.701+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:46.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:46.814+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:46.832 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:46.826+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:46.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:46.834+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:46.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:46.853+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:47.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:47.122+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:47.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:47.541+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:47.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:47.542+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:47.667 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:47.661+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:47.841 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:47.835+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:47.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:47.843+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:47.850 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:47.844+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:47.873 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:47.867+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:48.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:48.146+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:48.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:48.565+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:48.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:48.567+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:48.716 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:48.711+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:48.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:48.808+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:48.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:48.860+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:48.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:48.885+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:48.924 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:48.918+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:49.153 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:49.146+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:49.550 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:49.543+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:49.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:49.545+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:49.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:49.666+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:49.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:49.856+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:49.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:49.856+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:49.930 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:49.923+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:49.945 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:49.939+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:50.130 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:50.124+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:50.567 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:50.559+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:50.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:50.561+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:50.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:50.661+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:50.839 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:50.830+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:50.898 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:50.891+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:50.905 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:50.899+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:50.916 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:50.910+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:51.029 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:14:51.024+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e912 v912) 2019-11-29T20:14:51.117 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:51.111+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:51.548 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:51.541+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:51.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:51.544+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:51.674 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:51.667+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:51.861 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:51.854+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:52.690 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:51.883+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:52.690 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:52.563+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:52.690 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:52.565+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:52.690 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:52.660+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:52.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:51.866+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:52.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:51.940+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:52.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:52.119+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:52.869 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:52.862+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:52.907 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:52.901+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:52.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:52.933+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:52.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:52.934+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:53.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:53.076+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:53.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:53.547+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:53.553 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:53.548+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:53.702 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:53.697+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:53.845 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:53.839+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:53.897 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:53.890+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:53.924 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:53.911+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:53.932 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:53.926+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:54.091 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:54.084+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:54.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:54.538+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:54.546 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:54.540+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:54.693 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:54.686+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:54.822 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:54.815+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:54.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:54.893+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:54.922 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:54.915+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:54.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:54.917+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:55.114 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:55.107+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:55.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:55.522+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:55.530 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:55.524+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:55.684 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:55.678+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:55.860 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:55.852+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:55.892 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:55.885+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:55.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:55.906+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:55.931 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:55.924+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:56.059 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:14:56.045+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e912 v912) 2019-11-29T20:14:56.092 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:56.085+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:56.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:56.490+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:56.496 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:56.491+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:56.664 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:56.658+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:56.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:56.850+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:56.884 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:56.877+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:56.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:56.893+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:56.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:56.921+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:57.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:57.071+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:57.456 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:57.449+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:57.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:57.452+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:57.697 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:57.691+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:57.874 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:57.867+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:57.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:57.872+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:57.896 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:57.889+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:57.927 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:57.920+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:58.051 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:58.044+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:58.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:58.420+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:58.426 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:58.421+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:58.681 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:58.675+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:58.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:58.842+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:58.895 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:58.888+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:58.911 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:58.906+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:58.967 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:58.960+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:14:59.023 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:14:59.016+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:14:59.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:59.415+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:14:59.422 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:14:59.417+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:14:59.692 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:14:59.686+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:14:59.870 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:14:59.862+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:14:59.889 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:14:59.880+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:14:59.902 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:14:59.895+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:14:59.942 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:14:59.936+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:15:00.049 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:15:00.042+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:15:00.376 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:15:00.371+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:15:00.378 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:15:00.373+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:15:00.701 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:15:00.694+0000 1694c700 -1 osd.1 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:33.558265+0000 front 2019-11-29T20:13:33.547067+0000 (oldest deadline 2019-11-29T20:14:19.111673+0000) 2019-11-29T20:15:00.852 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:15:00.845+0000 1694c700 -1 osd.6 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:37.146125+0000 front 2019-11-29T20:13:37.279863+0000 (oldest deadline 2019-11-29T20:14:18.772747+0000) 2019-11-29T20:15:00.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:15:00.893+0000 1694c700 -1 osd.2 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:34.896118+0000 front 2019-11-29T20:13:34.743177+0000 (oldest deadline 2019-11-29T20:14:20.582167+0000) 2019-11-29T20:15:00.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:15:00.908+0000 1694c700 -1 osd.5 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.600744+0000 front 2019-11-29T20:13:35.426230+0000 (oldest deadline 2019-11-29T20:14:19.469171+0000) 2019-11-29T20:15:00.925 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:15:00.918+0000 1694c700 -1 osd.4 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.237289+0000 front 2019-11-29T20:13:34.578125+0000 (oldest deadline 2019-11-29T20:14:18.651614+0000) 2019-11-29T20:15:01.019 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:15:01.012+0000 1694c700 -1 osd.7 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:13:35.493797+0000 front 2019-11-29T20:13:35.452225+0000 (oldest deadline 2019-11-29T20:14:21.309068+0000) 2019-11-29T20:15:01.131 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:15:01.121+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 46sec e912 v912) 2019-11-29T20:15:01.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:15:01.337+0000 1694c700 -1 osd.0 912 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:13:49.776779+0000 (oldest deadline 2019-11-29T20:14:29.776779+0000) 2019-11-29T20:15:01.344 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:15:01.340+0000 1694c700 -1 osd.0 912 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:124265 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e910) 2019-11-29T20:15:56.759 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:00:04.894 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.768 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:00:04.904 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.850 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:00:05.031 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.852 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:00:05.032 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.854 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:00:05.035 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.857 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:00:05.038 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:56.967 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:00:05.102 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:57.097 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:00:05.261 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:15:57.097 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:00:05.268 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:16:32.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:32.107+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:32.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:32.458+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:33.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:33.066+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:33.177 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:33.161+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:33.250 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:33.242+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:33.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:33.461+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:34.017 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:34.012+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:34.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:34.065+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:34.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:34.149+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:34.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:34.231+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:34.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:34.287+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:34.456 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:34.446+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:34.635 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:34.627+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:34.980 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:34.975+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:35.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:35.061+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:35.160 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:35.151+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:35.224 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:35.217+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:35.334 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:35.322+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:35.491 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:35.482+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:35.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:35.587+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:36.026 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:36.019+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:36.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:36.036+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:36.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:36.112+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:36.273 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:36.265+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:36.304 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:36.298+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:36.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:36.468+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:36.630 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:36.623+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:37.047 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:37.037+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:37.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:37.054+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:37.090 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:37.085+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:37.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:37.252+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:37.336 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:37.324+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:37.486 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:37.479+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:37.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:37.641+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:38.017 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:38.007+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:38.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:38.014+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:38.099 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:38.092+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:38.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:38.226+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:38.356 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:38.349+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:38.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:38.509+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:38.604 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:38.597+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:38.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:38.975+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:38.987 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:38.979+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:39.079 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:39.072+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:39.279 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:39.271+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:39.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:39.360+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:39.561 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:39.553+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:39.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:39.619+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:40.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:39.993+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:40.008 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:40.001+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:40.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:40.089+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:40.315 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:40.308+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:40.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:40.357+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:40.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:40.563+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:40.646 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:40.639+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:40.967 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:40.960+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:41.041 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:41.035+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:41.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:41.097+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:41.309 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:41.302+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:41.333 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:41.327+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:41.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:41.587+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:41.686 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:41.681+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:41.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:41.958+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:42.054 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:42.047+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:42.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:42.116+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:42.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:42.326+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:42.362 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:42.355+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:42.622 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:42.616+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:42.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:42.716+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:42.985 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:42.979+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:43.078 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:43.072+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:43.132 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:43.126+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:43.384 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:43.378+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:43.408 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:43.401+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:43.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:43.612+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:43.698 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:43.690+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:43.963 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:43.957+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:44.106 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:44.099+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:44.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:44.105+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:44.382 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:44.375+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:44.429 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:44.423+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:44.662 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:44.654+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:44.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:44.718+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:44.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:44.936+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:45.091 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:45.084+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:45.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:45.155+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:45.372 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:45.365+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:45.433 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:45.428+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:45.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:45.690+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:45.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:45.711+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:45.941 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:45.935+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:46.087 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:46.080+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:46.149 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:46.143+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:46.375 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:46.368+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:46.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:46.398+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:46.683 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:46.676+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:46.737 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:46.728+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:46.942 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:46.934+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:47.125 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:47.118+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:47.139 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:47.132+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:47.331 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:47.324+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:47.409 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:47.402+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:47.695 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:47.686+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:47.747 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:47.739+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:47.943 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:47.936+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:48.127 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:48.122+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:48.155 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:48.149+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:48.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:48.362+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:48.390 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:48.383+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:48.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:48.722+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:48.797 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:48.790+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:48.980 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:48.974+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:49.107 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:49.101+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:49.127 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:49.121+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:49.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:49.391+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:49.417 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:49.411+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:49.699 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:49.692+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:49.759 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:49.753+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:50.026 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:50.016+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:50.081 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:50.075+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:50.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:50.114+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:50.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:50.377+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:50.459 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:50.452+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:50.666 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:50.659+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:50.812 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:50.804+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:51.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:51.011+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:51.096 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:51.090+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:51.116 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:51.109+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:51.358 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:51.352+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:51.447 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:51.440+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:51.697 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:51.691+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:51.835 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:51.828+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:52.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:52.000+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:52.080 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:52.074+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:52.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:52.092+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:52.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:52.305+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:52.461 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:52.454+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:52.730 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:52.723+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:52.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:52.852+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:53.036 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:53.031+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:53.078 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:53.072+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:53.106 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:53.098+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:53.366 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:53.357+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:53.426 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:53.419+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:53.767 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:53.759+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:53.880 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:53.874+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:54.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:54.012+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:54.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:54.079+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:54.104 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:54.097+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:54.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:54.323+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:54.383 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:54.377+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:54.761 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:54.752+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:54.889 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:54.882+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:55.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:55.054+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:55.079 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:55.074+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:55.114 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:55.108+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:55.363 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:55.356+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:55.368 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:55.362+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:55.795 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:55.788+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:55.943 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:55.936+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:56.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:56.067+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:56.075 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:56.068+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:56.099 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:56.092+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:56.345 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:56.338+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:56.398 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:56.390+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:56.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:56.802+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:56.962 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:56.955+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:57.047 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:57.041+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:57.064 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:57.057+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:57.126 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:57.119+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:57.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:57.374+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:57.441 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:57.434+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:57.838 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:57.829+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:57.947 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:57.939+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:58.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:58.037+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:58.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:58.048+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:58.141 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:58.135+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:58.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:58.408+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:58.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:58.443+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:58.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:58.833+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:58.974 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:58.968+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:16:59.024 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:16:59.017+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:16:59.071 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:16:59.065+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:16:59.192 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:16:59.186+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:16:59.446 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:16:59.438+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:16:59.498 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:16:59.491+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:16:59.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:16:59.821+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:16:59.975 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:16:59.964+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:00.064 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:00.056+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:00.072 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:00.066+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:00.171 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:00.164+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:00.443 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:00.437+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:00.528 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:00.517+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:00.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:00.854+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:00.972 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:00.965+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:01.074 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:01.068+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:01.118 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:01.112+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:01.188 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:01.179+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:01.410 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:01.402+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:01.486 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:01.479+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:01.850 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:01.843+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:01.944 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:01.936+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:02.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:02.116+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:02.128 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:02.122+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:02.147 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:02.141+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:02.400 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:02.394+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:02.453 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:02.447+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:02.855 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:02.848+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:02.973 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:02.966+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:03.111 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:03.104+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:03.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:03.141+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:03.189 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:03.182+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:03.366 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:03.359+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:03.428 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:03.423+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:03.889 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:03.882+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:04.027 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:04.020+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:04.085 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:04.079+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:04.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:04.179+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:04.224 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:04.215+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:04.340 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:04.334+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:04.443 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:04.435+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:04.904 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:04.893+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:05.073 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:05.065+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:05.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:05.117+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:05.199 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:05.192+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:05.264 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:05.255+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:05.368 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:05.362+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:05.466 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:05.458+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:05.906 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:05.899+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:06.041 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:06.034+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:06.098 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:06.092+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:06.239 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:17:06.233+0000 1694c700 -1 osd.1 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:46.958373+0000 front 2019-11-29T20:15:46.562211+0000 (oldest deadline 2019-11-29T20:16:31.231922+0000) 2019-11-29T20:17:06.256 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:06.248+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:06.371 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:17:06.364+0000 1694c700 -1 osd.7 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.670460+0000 front 2019-11-29T20:15:49.714367+0000 (oldest deadline 2019-11-29T20:16:33.049119+0000) 2019-11-29T20:17:06.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:17:06.508+0000 1694c700 -1 osd.2 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.551951+0000 front 2019-11-29T20:15:50.484492+0000 (oldest deadline 2019-11-29T20:16:33.960371+0000) 2019-11-29T20:17:06.967 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:17:06.950+0000 1694c700 -1 osd.5 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:50.359570+0000 front 2019-11-29T20:15:50.360235+0000 (oldest deadline 2019-11-29T20:16:34.397333+0000) 2019-11-29T20:17:07.011 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:17:06.998+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 46sec e918 v918) 2019-11-29T20:17:07.037 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:17:07.030+0000 1694c700 -1 osd.4 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.223707+0000 front 2019-11-29T20:15:49.258474+0000 (oldest deadline 2019-11-29T20:16:32.106278+0000) 2019-11-29T20:17:07.135 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:17:07.115+0000 1694c700 -1 osd.6 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:49.249544+0000 front 2019-11-29T20:15:49.242923+0000 (oldest deadline 2019-11-29T20:16:33.086196+0000) 2019-11-29T20:17:07.237 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:17:07.218+0000 1694c700 -1 osd.3 918 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:15:47.945391+0000 front 2019-11-29T20:15:47.840374+0000 (oldest deadline 2019-11-29T20:16:33.115009+0000) 2019-11-29T20:17:17.373 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:01:25.506 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.381 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:01:25.561 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.381 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:01:25.561 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.381 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:01:25.516 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.384 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:01:25.564 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.384 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:01:25.566 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.473 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:01:25.608 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.482 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:01:25.663 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:17.489 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:01:25.669 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:17:40.879 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:17:40.842+0000 31783700 -1 osd.0 924 build_incremental_map_msg missing incremental map 924 2019-11-29T20:17:41.148 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:17:41.123+0000 3678d700 -1 osd.0 924 build_incremental_map_msg missing incremental map 924 2019-11-29T20:17:41.224 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:17:41.198+0000 31f84700 -1 osd.0 924 build_incremental_map_msg missing incremental map 924 2019-11-29T20:17:41.441 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:17:41.401+0000 3578b700 -1 osd.0 924 build_incremental_map_msg missing incremental map 924 2019-11-29T20:17:41.764 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:17:41.755+0000 36f8e700 -1 osd.0 924 build_incremental_map_msg missing incremental map 924 2019-11-29T20:18:06.482 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:06.474+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:06.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:06.633+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:07.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:07.427+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:07.444 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:07.436+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:07.661 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:07.652+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:08.122 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:08.116+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:08.445 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:08.438+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:08.477 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:08.471+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:08.496 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:08.490+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:08.676 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:08.668+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:09.087 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:09.080+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:09.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:09.442+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:09.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:09.442+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:09.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:09.499+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:09.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:09.504+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:09.716 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:09.708+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:10.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:10.126+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:10.429 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:10.421+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:10.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:10.443+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:10.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:10.540+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:10.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:10.542+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:10.692 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:10.684+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:10.995 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:10.989+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:11.092 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:11.087+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:11.412 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:11.405+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:11.482 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:11.473+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:11.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:11.502+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:11.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:11.509+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:11.726 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:11.720+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:12.009 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:12.004+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:12.136 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:12.130+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:12.402 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:12.396+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:12.490 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:12.484+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:12.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:12.506+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:12.549 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:12.541+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:12.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:12.677+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:12.966 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:12.960+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:13.094 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:13.088+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:13.391 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:13.384+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:13.466 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:13.459+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:13.517 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:13.505+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:13.534 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:13.528+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:13.703 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:13.697+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:13.993 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:13.988+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:14.105 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:14.099+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:14.396 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:14.385+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:14.447 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:14.438+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:14.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:14.504+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:14.532 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:14.522+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:14.756 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:14.749+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:15.044 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:15.038+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:15.114 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:15.098+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:15.446 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:18:15.437+0000 1694c700 -1 osd.4 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.384557+0000 front 2019-11-29T20:17:22.426791+0000 (oldest deadline 2019-11-29T20:18:06.437086+0000) 2019-11-29T20:18:15.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:15.478+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:15.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:15.479+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:15.498 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:15.492+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:15.539 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:15.533+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:15.793 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:15.786+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:16.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:16.055+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:16.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:16.139+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:16.445 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:16.439+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:16.449 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:16.443+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:16.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:16.525+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:16.557 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:16.547+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:16.797 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:16.789+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:17.039 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:17.026+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:17.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:17.152+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:17.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:17.478+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:17.485 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:17.480+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:17.510 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:17.505+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:17.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:17.552+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:17.830 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:17.821+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:18.018 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:18.012+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:18.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:18.162+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:18.467 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:18.461+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:18.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:18.523+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:18.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:18.528+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:18.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:18.530+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:18.848 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:18.842+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:19.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:19.056+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:19.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:19.188+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:19.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:19.479+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:19.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:19.507+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:19.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:19.510+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:19.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:19.526+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:19.881 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:19.872+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:20.081 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:20.075+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:20.182 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:20.176+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:20.476 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:20.469+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:20.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:20.474+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:20.513 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:20.507+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:20.521 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:20.515+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:20.837 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:20.830+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:21.052 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:21.045+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:21.191 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:21.185+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:21.465 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:21.447+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:21.465 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:21.449+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:21.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:21.523+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:21.555 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:21.549+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:21.878 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:21.870+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:22.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:22.031+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:22.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:22.159+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:22.450 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:22.444+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:22.453 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:22.448+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:22.499 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:22.492+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:22.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:22.561+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:22.891 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:22.884+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:23.007 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:23.000+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:23.140 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:23.134+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:23.434 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:23.428+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:23.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:23.431+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:23.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:23.495+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:23.562 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:23.556+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:23.909 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:23.897+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:23.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:23.968+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:24.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:24.117+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:24.462 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:24.456+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:24.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:24.470+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:24.477 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:24.472+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:24.577 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:24.571+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:24.934 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:24.927+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:25.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:25.006+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:25.136 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:25.129+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:25.423 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:25.417+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:25.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:25.514+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:25.522 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:25.516+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:25.628 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:25.621+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:25.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:25.935+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:26.005 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:25.999+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:26.146 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:26.140+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:26.395 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:26.389+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:26.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:26.471+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:26.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:26.474+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:26.589 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:26.579+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:26.985 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:26.979+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:27.056 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:27.050+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:27.155 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:27.146+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:27.380 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:27.375+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:27.502 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:27.497+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:27.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:27.498+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:27.593 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:27.586+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:27.962 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:27.954+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:28.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:28.028+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:28.196 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:28.190+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:28.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:28.403+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:28.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:28.507+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:28.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:28.508+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:28.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:28.630+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:28.936 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:28.930+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:29.028 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:29.021+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:29.248 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:29.241+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:29.435 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:29.428+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:29.529 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:29.519+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:29.532 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:29.521+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:29.684 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:29.677+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:29.955 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:29.940+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:30.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:30.013+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:30.265 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:30.259+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:30.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:30.465+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:30.571 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:30.566+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:30.572 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:30.567+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:30.664 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:30.658+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:30.964 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:30.958+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:30.980 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:30.974+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:31.232 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:31.225+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:31.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:31.450+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:31.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:31.609+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:31.616 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:31.610+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:31.686 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:31.680+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:32.017 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:32.008+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:32.027 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:32.022+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:32.267 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:32.260+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:32.501 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:32.496+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:32.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:32.581+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:32.588 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:32.583+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:32.665 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:32.641+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:33.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:32.998+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:33.055 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:33.048+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:33.270 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:33.264+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:33.545 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:33.535+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:33.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:33.563+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:33.570 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:33.564+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:33.624 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:33.618+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:33.986 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:33.980+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:34.104 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:34.096+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:34.247 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:34.241+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:34.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:34.557+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:34.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:34.579+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:34.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:34.580+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:34.612 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:34.605+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:34.943 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:34.936+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:35.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:35.140+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:35.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:35.260+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:35.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:35.528+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:35.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:35.574+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:35.582 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:35.575+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:35.650 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:35.634+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:35.968 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:35.959+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:36.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:36.153+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:36.247 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:36.241+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:36.550 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:36.542+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:36.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:36.544+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:36.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:36.556+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:36.675 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:36.669+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:36.929 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:36.922+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:37.124 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:37.118+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:37.238 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:37.231+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:37.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:37.501+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:37.507 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:37.502+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:37.563 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:37.556+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:37.640 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:37.635+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:37.977 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:37.971+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:38.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:38.075+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:38.289 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:38.282+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:38.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:38.488+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:38.495 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:38.490+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:38.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:38.573+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:38.679 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:38.673+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:38.989 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:38.983+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:39.085 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:39.078+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:39.278 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:39.270+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:39.537 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:39.532+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:39.541 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:39.535+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:39.550 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:39.544+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:39.672 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:39.666+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:39.953 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:39.947+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:40.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:40.069+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:40.266 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:40.255+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:40.501 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:40.496+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:40.504 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:40.499+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:40.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:40.566+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:40.667 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:40.661+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:40.968 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:40.962+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:41.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:41.030+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:41.297 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:41.291+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:41.491 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:41.484+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:41.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:41.486+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:41.529 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:41.523+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:41.673 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:41.667+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:41.957 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:41.951+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:42.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:42.071+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:42.336 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:42.330+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:42.358 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:18:42.350+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e925 v925) 2019-11-29T20:18:42.531 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:42.526+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:42.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:42.529+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:42.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:42.544+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:42.711 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:42.704+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:42.969 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:42.965+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:43.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:43.076+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:43.293 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:43.287+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:43.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:43.538+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:43.584 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:43.578+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:43.587 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:43.582+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:43.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:43.667+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:43.970 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:43.964+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:44.057 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:44.048+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:44.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:44.282+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:44.549 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:44.543+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:44.634 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:44.628+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:44.635 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:44.627+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:44.637 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:44.631+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:44.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:44.924+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:45.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:45.004+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:45.303 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:45.294+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:45.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:45.523+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:45.637 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:45.632+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:45.638 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:45.634+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:45.656 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:45.649+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:45.954 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:45.948+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:46.007 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:46.000+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:46.302 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:46.291+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:46.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:46.499+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:46.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:46.609+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:46.615 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:46.611+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:18:46.670 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:18:46.663+0000 1694c700 -1 osd.6 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:24.065584+0000 front 2019-11-29T20:17:24.629606+0000 (oldest deadline 2019-11-29T20:18:08.153004+0000) 2019-11-29T20:18:46.930 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:18:46.924+0000 1694c700 -1 osd.2 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:25.041458+0000 front 2019-11-29T20:17:25.026230+0000 (oldest deadline 2019-11-29T20:18:10.294140+0000) 2019-11-29T20:18:47.041 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:18:47.034+0000 1694c700 -1 osd.7 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.737361+0000 front 2019-11-29T20:17:23.711852+0000 (oldest deadline 2019-11-29T20:18:06.464238+0000) 2019-11-29T20:18:47.328 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:18:47.320+0000 1694c700 -1 osd.5 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:22.512847+0000 front 2019-11-29T20:17:22.511380+0000 (oldest deadline 2019-11-29T20:18:07.773514+0000) 2019-11-29T20:18:47.438 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:18:47.420+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 45sec e925 v925) 2019-11-29T20:18:47.489 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:18:47.482+0000 1694c700 -1 osd.1 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:17:23.468106+0000 front 2019-11-29T20:17:23.491547+0000 (oldest deadline 2019-11-29T20:18:07.379761+0000) 2019-11-29T20:18:47.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:47.578+0000 1694c700 -1 osd.0 925 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:17:35.095056+0000 (oldest deadline 2019-11-29T20:18:15.095056+0000) 2019-11-29T20:18:47.585 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:18:47.579+0000 1694c700 -1 osd.0 925 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e922) 2019-11-29T20:19:20.700 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:19:20.694+0000 3578b700 -1 osd.3 931 build_incremental_map_msg missing incremental map 931 2019-11-29T20:19:21.189 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:19:21.150+0000 34f8a700 -1 osd.3 931 build_incremental_map_msg missing incremental map 931 2019-11-29T20:19:21.267 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:19:21.261+0000 124ad700 -1 osd.3 931 build_incremental_map_msg missing incremental map 931 2019-11-29T20:19:21.530 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:19:21.343+0000 31783700 -1 osd.3 931 build_incremental_map_msg missing incremental map 931 2019-11-29T20:19:23.440 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:19:23.434+0000 30f82700 -1 osd.3 931 build_incremental_map_msg missing incremental map 931 2019-11-29T20:20:19.537 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:19.529+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:19.867 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:19.860+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:20.536 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:20.525+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:20.554 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:20.547+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:20.670 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:20.662+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:20.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:20.849+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:21.447 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:21.439+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:21.573 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:21.556+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:21.573 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:21.564+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:21.656 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:21.650+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:21.868 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:21.858+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:22.436 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:22.428+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:22.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:22.544+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:22.609 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:22.600+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:22.655 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:22.648+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:22.655 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:22.650+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:22.846 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:22.838+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:23.202 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:23.194+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:23.470 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:23.462+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:23.590 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:23.582+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:23.621 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:23.613+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:23.626 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:23.618+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:23.653 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:23.647+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:23.873 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:23.865+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:24.233 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:24.228+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:24.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:24.445+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:24.594 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:24.586+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:24.613 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:24.607+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:24.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:24.616+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:24.635 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:24.628+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:24.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:24.849+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:25.233 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:25.223+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:25.407 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:25.399+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:25.616 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:25.610+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:25.628 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:25.621+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:25.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:25.638+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:25.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:25.664+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:25.857 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:25.850+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:26.258 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:26.250+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:26.360 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:26.354+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:26.608 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:26.601+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:26.649 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:26.642+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:26.668 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:26.663+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:26.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:26.706+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:26.816 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:26.809+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:27.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:27.238+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:27.406 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:27.400+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:27.586 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:27.580+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:27.641 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:27.636+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:27.653 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:27.647+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:27.757 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:27.750+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:27.794 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:27.787+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:28.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:28.215+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:28.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:28.364+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:28.562 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:28.556+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:28.621 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:28.614+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:28.651 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:28.645+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:28.736 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:28.729+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:28.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:28.759+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:29.181 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:29.172+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:29.398 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:29.392+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:29.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:29.580+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:29.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:29.652+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:29.672 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:29.666+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:29.714 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:29.707+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:29.722 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:29.716+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:30.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:30.223+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:30.420 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:30.412+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:30.570 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:30.563+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:30.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:30.632+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:30.669 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:30.662+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:30.741 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:30.734+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:30.755 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:30.745+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:31.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:31.212+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:31.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:31.448+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:31.605 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:31.598+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:31.681 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:31.675+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:31.695 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:31.687+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:31.762 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:31.756+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:31.765 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:31.758+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:32.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:32.233+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:32.500 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:32.494+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:32.637 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:32.630+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:32.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:32.670+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:32.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:32.725+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:32.760 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:32.753+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:32.787 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:32.780+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:33.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:33.239+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:33.551 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:33.544+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:33.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:33.594+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:33.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:33.705+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:33.751 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:33.743+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:33.774 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:33.767+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:33.809 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:33.801+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:34.224 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:34.218+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:34.564 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:34.558+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:34.613 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:34.606+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:34.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:34.682+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:34.776 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:34.766+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:34.779 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:34.773+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:34.795 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:34.790+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:35.251 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:35.245+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:35.583 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:35.577+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:35.592 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:35.585+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:35.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:35.692+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:35.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:35.722+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:35.760 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:35.753+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:35.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:35.800+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:36.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:36.229+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:36.563 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:36.557+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:36.578 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:36.572+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:36.691 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:36.684+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:36.733 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:36.726+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:36.751 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:36.744+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:36.857 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:36.851+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:37.240 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:37.233+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:37.526 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:37.519+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:37.589 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:37.583+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:37.647 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:37.640+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:37.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:37.702+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:37.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:37.724+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:37.846 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:37.840+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:38.219 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:38.212+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:38.488 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:38.481+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:38.552 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:38.546+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:38.624 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:38.617+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:38.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:38.722+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:38.773 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:38.766+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:38.818 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:38.813+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:39.176 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:39.170+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:39.477 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:39.470+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:39.509 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:39.502+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:39.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:39.628+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:39.766 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:39.760+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:39.825 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:39.818+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:39.849 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:39.844+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:40.156 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:40.151+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:40.503 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:40.496+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:40.505 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:40.499+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:40.678 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:40.671+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:40.773 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:40.766+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:40.864 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:40.857+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:40.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:40.863+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:41.168 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:41.161+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:41.469 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:41.464+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:41.522 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:41.516+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:41.665 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:41.659+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:41.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:41.738+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:41.876 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:41.870+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:41.888 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:41.880+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:42.173 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:42.167+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:42.479 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:42.472+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:42.554 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:42.547+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:42.640 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:42.633+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:42.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:42.718+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:42.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:42.835+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:42.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:42.926+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:43.150 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:43.143+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:43.515 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:43.508+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:43.523 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:43.516+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:43.616 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:43.610+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:43.774 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:43.762+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:43.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:43.840+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:43.939 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:43.933+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:44.126 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:44.120+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:44.484 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:44.478+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:44.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:44.571+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:44.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:44.617+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:44.734 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:44.727+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:44.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:44.836+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:44.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:44.919+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:45.119 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:45.112+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:45.536 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:45.530+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:45.590 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:45.582+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:45.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:45.617+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:45.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:45.681+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:45.871 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:45.865+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:45.892 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:45.885+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:46.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:46.137+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:46.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:46.512+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:46.574 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:46.567+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:46.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:46.584+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:46.745 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:46.732+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:46.867 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:46.861+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:46.931 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:46.925+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:47.178 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:47.171+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:47.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:47.483+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:47.588 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:47.577+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:47.613 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:47.607+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:47.764 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:47.757+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:47.893 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:47.887+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:47.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:47.948+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:48.182 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:48.174+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:48.527 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:48.521+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:48.616 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:48.609+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:48.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:48.629+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:48.798 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:48.792+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:48.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:48.898+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:48.987 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:48.981+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:49.175 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:49.165+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:49.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:49.517+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:49.625 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:49.617+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:49.664 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:49.657+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:49.819 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:49.810+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:49.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:49.944+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:50.006 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:49.999+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:50.143 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:50.135+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:50.518 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:50.511+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:50.588 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:50.581+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:50.702 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:50.696+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:50.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:50.799+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:50.922 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:50.914+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:51.010 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:51.005+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:51.129 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:51.123+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:51.554 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:51.547+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:51.610 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:51.604+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:51.687 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:51.679+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:51.854 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:51.847+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:51.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:51.939+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:52.044 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:20:52.036+0000 1694c700 -1 osd.1 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:33.966419+0000 front 2019-11-29T20:19:33.997795+0000 (oldest deadline 2019-11-29T20:20:19.851195+0000) 2019-11-29T20:20:52.128 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:20:52.122+0000 1694c700 -1 osd.2 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:36.918158+0000 front 2019-11-29T20:19:36.919084+0000 (oldest deadline 2019-11-29T20:20:22.751615+0000) 2019-11-29T20:20:52.578 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:20:52.572+0000 1694c700 -1 osd.3 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:35.914720+0000 front 2019-11-29T20:19:36.019289+0000 (oldest deadline 2019-11-29T20:20:21.740507+0000) 2019-11-29T20:20:52.590 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:20:52.583+0000 1694c700 -1 osd.6 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.942393+0000 front 2019-11-29T20:19:37.907912+0000 (oldest deadline 2019-11-29T20:20:21.366057+0000) 2019-11-29T20:20:52.734 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:20:52.727+0000 1694c700 -1 osd.7 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.105434+0000 front 2019-11-29T20:19:37.043258+0000 (oldest deadline 2019-11-29T20:20:19.315226+0000) 2019-11-29T20:20:52.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:20:52.867+0000 1694c700 -1 osd.5 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:34.923112+0000 front 2019-11-29T20:19:34.921182+0000 (oldest deadline 2019-11-29T20:20:20.191769+0000) 2019-11-29T20:20:52.887 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:20:52.877+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 41sec e931 v931) 2019-11-29T20:20:52.952 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:20:52.947+0000 1694c700 -1 osd.4 931 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:19:37.540064+0000 front 2019-11-29T20:19:37.547121+0000 (oldest deadline 2019-11-29T20:20:19.233832+0000) 2019-11-29T20:20:58.081 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:06.216 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.127 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:06.262 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.170 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:06.350 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.181 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:06.361 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.182 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:06.363 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.199 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:06.372 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.376 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:06.557 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.379 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:06.559 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:20:58.500 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:06.636 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.317 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:17.453 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.331 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:17.465 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.336 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:17.517 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.337 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:17.518 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.340 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:17.520 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.341 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:17.522 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.373 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:05:17.554 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.373 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:05:17.553 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:09.394 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:05:17.529 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:21:51.222 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:51.216+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:51.333 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:51.325+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:52.030 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:52.023+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:52.193 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:52.181+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:52.239 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:52.233+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:52.342 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:52.336+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:53.039 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:53.032+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:53.194 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:53.188+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:53.234 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:53.227+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:53.336 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:53.327+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:53.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:53.499+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:54.048 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:54.041+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:54.169 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:54.164+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:54.258 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:54.251+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:54.317 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:54.307+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:54.527 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:54.519+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:55.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:55.070+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:55.184 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:55.177+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:55.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:55.264+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:55.297 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:55.289+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:55.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:55.557+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:56.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:56.045+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:56.234 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:56.227+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:56.260 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:56.253+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:56.265 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:56.259+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:56.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:56.571+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:57.109 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:57.103+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:57.208 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:57.201+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:57.271 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:57.264+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:57.281 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:57.274+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:57.549 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:57.544+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:57.788 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:21:57.783+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:21:58.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:58.149+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:58.211 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:58.205+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:58.252 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:58.246+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:58.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:58.277+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:58.547 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:58.541+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:58.779 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:21:58.773+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:21:59.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:21:59.196+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:21:59.235 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:21:59.230+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:21:59.250 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:21:59.244+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:21:59.260 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:21:59.255+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:21:59.527 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:21:59.521+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:21:59.765 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:21:59.758+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:00.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:00.167+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:00.237 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:00.230+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:00.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:00.274+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:00.301 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:00.295+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:00.516 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:00.509+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:00.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:00.746+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:01.163 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:01.157+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:01.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:01.229+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:01.245 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:01.240+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:01.325 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:01.319+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:01.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:01.527+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:01.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:01.736+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:01.747 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:01.738+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:02.213 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:02.206+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:02.257 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:02.252+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:02.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:02.267+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:02.291 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:02.285+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:02.545 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:02.538+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:02.776 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:02.770+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:02.777 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:02.772+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:03.215 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:03.209+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:03.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:03.250+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:03.267 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:03.261+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:03.296 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:03.291+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:03.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:03.578+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:03.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:03.733+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:03.740 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:03.735+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:04.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:04.198+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:04.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:04.233+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:04.262 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:04.256+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:04.291 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:04.285+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:04.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:04.619+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:04.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:04.727+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:04.739 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:04.729+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:05.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:05.186+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:05.269 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:05.262+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:05.277 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:05.271+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:05.282 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:05.275+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:05.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:05.633+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:05.758 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:05.752+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:05.761 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:05.756+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:06.179 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:06.169+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:06.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:06.255+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:06.271 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:06.263+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:06.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:06.286+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:06.658 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:06.652+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:06.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:06.792+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:06.799 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:06.794+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:07.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:07.177+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:07.262 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:07.256+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:07.274 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:07.266+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:07.307 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:07.301+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:07.702 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:07.693+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:07.754 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:07.747+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:07.755 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:07.749+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:08.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:08.169+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:08.246 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:08.240+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:08.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:08.258+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:08.280 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:08.275+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:08.708 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:08.701+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:08.768 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:08.762+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:08.771 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:08.767+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:09.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:09.152+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:09.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:09.238+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:09.250 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:09.244+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:09.280 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:09.274+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:09.697 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:09.691+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:09.737 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:09.731+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:09.738 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:09.733+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:10.157 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:10.150+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:10.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:10.205+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:10.282 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:10.276+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:10.285 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:10.279+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:10.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:10.673+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:10.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:10.779+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:10.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:10.782+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:11.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:11.142+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:11.211 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:11.205+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:11.287 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:11.281+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:11.317 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:11.311+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:11.643 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:11.636+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:11.809 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:11.804+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:11.811 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:11.806+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:12.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:12.153+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:12.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:12.206+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:12.278 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:12.269+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:12.288 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:12.281+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:12.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:12.671+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:12.820 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:12.814+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:12.821 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:12.815+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:13.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:13.145+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:13.192 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:13.185+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:13.274 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:13.263+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:13.319 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:13.314+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:13.686 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:13.680+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:13.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:13.774+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:13.780 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:13.775+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:14.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:14.182+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:14.236 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:14.229+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:14.245 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:14.238+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:14.338 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:14.332+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:14.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:14.652+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:14.796 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:14.784+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:14.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:14.787+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:15.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:15.151+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:15.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:15.221+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:15.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:15.227+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:15.369 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:15.363+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:15.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:15.617+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:15.808 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:15.802+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:15.809 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:15.803+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:16.112 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:16.106+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:16.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:16.190+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:16.203 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:16.197+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:16.415 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:16.409+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:16.611 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:16.605+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:16.787 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:16.782+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:16.789 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:16.784+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:17.120 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:17.114+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:17.204 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:17.198+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:17.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:17.243+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:17.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:17.444+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:17.630 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:17.624+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:17.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:17.790+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:17.797 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:17.791+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:18.173 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:18.166+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:18.175 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:18.169+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:18.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:18.214+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:18.458 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:18.452+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:18.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:18.623+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:18.798 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:18.791+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:18.801 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:18.795+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:19.144 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:19.138+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:19.221 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:19.210+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:19.258 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:19.252+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:19.419 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:19.412+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:19.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:19.619+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:19.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:19.796+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:19.803 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:19.798+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:20.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:20.134+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:20.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:20.176+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:20.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:20.259+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:20.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:20.396+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:20.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:20.631+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:20.757 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:20.751+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:20.757 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:20.753+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:21.105 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:21.099+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:21.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:21.175+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:21.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:21.244+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:21.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:21.445+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:21.685 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:21.676+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:21.733 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:21.726+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:21.734 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:21.728+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:22.096 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:22.090+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:22.192 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:22.186+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:22.293 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:22.286+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:22.437 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:22.432+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:22.666 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:22.654+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:22.699 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:22.691+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:22.700 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:22.694+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:23.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:23.071+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:23.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:23.192+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:23.295 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:23.289+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:23.467 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:22:23.460+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e937 v937) 2019-11-29T20:22:23.471 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:23.461+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:23.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:23.651+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:23.679 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:23.673+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:23.680 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:23.675+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:24.040 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:24.032+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:24.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:24.203+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:24.263 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:24.257+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:24.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:24.503+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:24.659 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:24.653+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:24.660 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:24.654+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:24.672 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:24.666+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:25.003 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:24.994+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:25.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:25.199+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:25.289 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:25.283+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:25.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:25.552+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:25.644 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:25.632+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:25.646 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:25.634+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:25.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:25.650+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:26.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:26.039+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:26.207 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:26.201+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:26.297 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:26.291+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:26.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:26.533+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:26.629 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:26.623+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:26.630 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:26.624+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:26.689 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:26.683+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:27.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:27.093+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:27.167 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:27.161+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:27.275 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:27.269+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:27.494 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:27.488+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:27.598 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:27.591+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:27.602 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:27.597+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:27.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:27.674+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:28.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:28.123+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:28.153 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:28.146+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:28.300 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:28.295+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:28.458 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:28.453+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:28.485 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:22:28.479+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e937 v937) 2019-11-29T20:22:28.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:28.640+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:28.648 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:28.642+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:28.706 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:28.700+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:29.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:29.097+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:29.116 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:29.110+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:29.305 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:29.299+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:29.474 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:29.468+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:29.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:29.604+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:29.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:29.608+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:29.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:29.670+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:30.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:30.074+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:30.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:30.118+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:30.270 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:30.263+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:30.476 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:30.469+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:30.633 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:30.620+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:30.633 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:30.622+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:30.731 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:30.716+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:31.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:31.109+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:31.144 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:31.139+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:31.284 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:31.278+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:31.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:31.474+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:31.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:31.603+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:31.610 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:31.604+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:31.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:31.763+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:32.136 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:32.129+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:32.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:32.158+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:32.242 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:32.236+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:32.448 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:32.443+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:32.651 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:32.644+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:32.652 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:32.645+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:32.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:22:32.788+0000 1694c700 -1 osd.4 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.365888+0000 front 2019-11-29T20:21:09.380294+0000 (oldest deadline 2019-11-29T20:21:52.856216+0000) 2019-11-29T20:22:33.151 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:22:33.143+0000 1694c700 -1 osd.6 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.174280+0000 front 2019-11-29T20:21:08.180609+0000 (oldest deadline 2019-11-29T20:21:51.662867+0000) 2019-11-29T20:22:33.152 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:22:33.145+0000 1694c700 -1 osd.7 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:09.748727+0000 front 2019-11-29T20:21:09.760555+0000 (oldest deadline 2019-11-29T20:21:51.353379+0000) 2019-11-29T20:22:33.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:33.235+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:33.495 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:22:33.490+0000 1694c700 -1 osd.1 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:08.689165+0000 front 2019-11-29T20:21:08.609894+0000 (oldest deadline 2019-11-29T20:21:50.843788+0000) 2019-11-29T20:22:33.566 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:22:33.558+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e937 v937) 2019-11-29T20:22:33.647 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:33.642+0000 1694c700 -1 osd.0 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:21:21.158699+0000 (oldest deadline 2019-11-29T20:22:01.158699+0000) 2019-11-29T20:22:33.650 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:33.645+0000 1694c700 -1 osd.0 937 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:22:34.198 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:22:34.193+0000 1694c700 -1 osd.2 937 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:21:05.429742+0000 front 2019-11-29T20:21:05.461563+0000 (oldest deadline 2019-11-29T20:21:50.623831+0000) 2019-11-29T20:22:34.748 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:22:34.699+0000 1694c700 -1 osd.0 938 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e936) 2019-11-29T20:23:04.387 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:23:04.355+0000 34f8a700 -1 osd.3 942 build_incremental_map_msg missing incremental map 942 2019-11-29T20:23:04.894 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:23:04.840+0000 35f8c700 -1 osd.3 942 build_incremental_map_msg missing incremental map 942 2019-11-29T20:23:05.177 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:23:05.155+0000 3578b700 -1 osd.3 942 build_incremental_map_msg missing incremental map 942 2019-11-29T20:23:07.713 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:23:07.692+0000 34f8a700 -1 osd.3 942 build_incremental_map_msg missing incremental map 942 2019-11-29T20:24:05.735 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:05.729+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:06.141 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:06.132+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:06.441 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:06.434+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:06.751 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:06.744+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:07.090 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:07.081+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:07.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:07.173+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:07.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:07.307+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:07.413 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:07.404+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:07.548 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:07.540+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:07.723 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:07.717+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:07.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:07.887+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:08.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:08.072+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:08.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:08.137+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:08.367 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:08.360+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:08.451 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:08.445+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:08.517 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:08.511+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:08.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:08.686+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:08.898 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:08.891+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:09.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:09.126+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:09.153 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:09.143+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:09.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:09.401+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:09.434 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:09.426+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:09.548 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:09.542+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:09.684 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:09.679+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:09.864 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:09.854+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:10.126 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:10.114+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:10.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:10.169+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:10.387 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:10.381+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:10.418 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:10.403+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:10.592 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:10.586+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:10.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:10.648+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:10.861 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:10.854+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:11.135 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:11.128+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:11.158 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:11.150+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:11.417 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:11.410+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:11.422 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:11.414+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:11.595 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:11.588+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:11.636 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:11.631+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:11.816 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:11.809+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:12.101 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:24:12.092+0000 1694c700 -1 osd.4 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.255004+0000 front 2019-11-29T20:23:21.251537+0000 (oldest deadline 2019-11-29T20:24:05.925574+0000) 2019-11-29T20:24:12.203 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:12.195+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:12.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:12.424+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:12.448 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:12.442+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:12.614 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:12.608+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:12.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:12.664+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:12.811 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:12.803+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:13.198 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:13.191+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:13.411 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:13.398+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:13.443 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:13.434+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:13.582 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:13.576+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:13.701 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:13.690+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:13.782 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:13.774+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:14.210 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:14.203+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:14.403 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:14.396+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:14.426 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:14.420+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:14.539 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:14.533+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:14.660 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:14.654+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:14.829 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:14.823+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:15.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:15.171+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:15.365 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:15.358+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:15.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:15.406+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:15.497 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:15.491+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:15.701 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:15.694+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:15.868 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:15.861+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:16.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:16.126+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:16.377 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:16.368+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:16.453 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:16.445+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:16.533 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:16.525+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:16.750 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:16.743+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:16.851 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:16.844+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:17.159 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:17.152+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:17.373 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:17.357+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:17.493 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:17.486+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:17.564 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:17.557+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:17.790 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:17.785+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:17.836 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:17.829+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:18.175 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:18.167+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:18.416 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:18.396+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:18.512 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:18.503+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:18.594 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:18.587+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:18.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:18.788+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:18.800 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:18.794+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:19.189 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:19.183+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:19.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:19.390+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:19.537 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:19.530+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:19.558 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:19.551+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:19.846 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:19.839+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:19.855 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:19.849+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:20.216 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:20.209+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:20.361 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:20.355+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:20.522 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:20.515+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:20.540 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:20.533+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:20.876 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:20.869+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:20.887 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:20.881+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:21.206 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:21.199+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:21.350 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:21.343+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:21.510 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:21.504+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:21.542 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:21.527+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:21.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:21.896+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:21.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:21.900+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:22.190 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:22.183+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:22.399 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:22.392+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:22.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:22.491+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:22.498 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:22.490+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:22.890 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:22.885+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:22.901 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:22.895+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:23.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:23.168+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:23.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:23.355+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:23.506 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:23.500+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:23.546 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:23.527+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:23.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:23.842+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:23.916 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:23.910+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:24.139 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:24.133+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:24.340 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:24.331+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:24.487 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:24.469+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:24.563 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:24.557+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:24.873 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:24.866+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:24.956 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:24.949+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:25.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:25.098+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:25.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:25.309+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:25.449 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:25.442+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:25.588 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:25.582+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:25.891 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:25.885+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:25.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:25.943+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:26.118 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:26.111+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:26.272 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:26.265+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:26.442 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:26.431+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:26.631 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:26.623+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:26.915 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:26.908+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:26.923 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:26.915+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:27.129 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:27.123+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:27.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:27.221+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:27.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:27.450+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:27.605 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:27.594+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:27.897 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:27.891+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:27.937 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:27.930+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:28.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:28.136+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:28.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:28.221+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:28.443 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:28.435+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:28.579 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:28.574+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:28.884 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:28.877+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:28.961 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:28.955+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:29.160 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:29.154+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:29.256 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:29.251+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:29.444 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:29.437+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:29.617 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:29.612+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:29.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:29.838+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:29.954 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:29.947+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:30.181 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:30.175+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:30.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:30.243+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:30.497 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:30.491+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:30.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:30.587+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:30.821 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:30.814+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:30.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:30.968+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:31.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:31.146+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:31.291 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:31.283+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:31.547 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:31.535+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:31.587 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:31.580+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:31.864 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:31.856+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:31.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:31.948+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:32.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:32.157+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:32.319 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:32.312+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:32.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:32.579+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:32.625 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:32.617+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:32.822 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:32.815+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:33.007 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:33.000+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:33.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:33.129+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:33.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:33.330+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:33.559 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:33.551+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:33.660 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:33.653+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:33.805 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:33.797+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:34.060 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:34.053+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:34.148 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:34.141+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:34.303 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:34.297+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:34.579 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:34.571+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:34.713 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:34.697+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:34.805 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:34.793+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:35.058 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:35.052+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:35.171 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:35.164+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:35.295 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:35.287+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:35.561 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:35.554+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:35.716 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:35.709+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:35.765 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:35.759+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:36.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:36.046+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:36.135 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:36.124+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:36.301 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:36.294+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:36.557 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:36.551+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:36.750 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:36.744+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:36.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:36.787+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:37.049 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:37.043+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:37.098 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:37.092+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:37.276 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:37.269+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:37.586 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:37.580+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:37.806 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:37.798+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:37.810 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:37.802+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:38.005 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:37.998+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:38.154 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:24:38.147+0000 1694c700 -1 osd.7 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.832161+0000 front 2019-11-29T20:23:22.833613+0000 (oldest deadline 2019-11-29T20:24:06.269151+0000) 2019-11-29T20:24:38.318 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:24:38.311+0000 1694c700 -1 osd.6 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.701258+0000 front 2019-11-29T20:23:21.772648+0000 (oldest deadline 2019-11-29T20:24:06.947365+0000) 2019-11-29T20:24:38.562 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:24:38.555+0000 1694c700 -1 osd.1 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.435243+0000 front 2019-11-29T20:23:21.458834+0000 (oldest deadline 2019-11-29T20:24:06.113666+0000) 2019-11-29T20:24:38.818 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:24:38.812+0000 1694c700 -1 osd.3 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.927539+0000 front 2019-11-29T20:23:22.971847+0000 (oldest deadline 2019-11-29T20:24:07.014439+0000) 2019-11-29T20:24:38.837 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:24:38.832+0000 1694c700 -1 osd.2 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:21.183314+0000 front 2019-11-29T20:23:20.971792+0000 (oldest deadline 2019-11-29T20:24:05.059127+0000) 2019-11-29T20:24:38.964 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:24:38.955+0000 1694c700 -1 osd.5 942 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:23:22.379804+0000 front 2019-11-29T20:23:22.362379+0000 (oldest deadline 2019-11-29T20:24:07.568113+0000) 2019-11-29T20:24:39.002 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:24:38.995+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e942 v942) 2019-11-29T20:25:05.513 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:05.346+0000 2184f700 -1 reset not still connected to 0x1021e5b0 2019-11-29T20:25:05.520 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:05.346+0000 2184f700 -1 reset not still connected to 0x1587e0c0 2019-11-29T20:25:08.666 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:09:16.801 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.679 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:09:16.814 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.690 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:09:16.871 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.699 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:09:16.875 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.700 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:09:16.880 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.703 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:09:16.884 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:08.931 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:09:17.066 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:09.137 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:09:17.123 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:09.137 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:09:17.205 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:25:36.525 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:36.518+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:36.590 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:36.583+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:37.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:37.156+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:37.572 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:37.565+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:37.602 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:37.595+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:37.980 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:37.968+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:38.134 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:38.127+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:38.166 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:38.159+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:38.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:38.542+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:38.628 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:38.621+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:39.000 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:38.992+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:39.117 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:39.110+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:39.159 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:39.153+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:39.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:39.557+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:39.678 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:39.669+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:40.008 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:40.001+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:40.134 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:40.127+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:40.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:40.149+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:40.538 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:40.530+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:40.694 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:40.686+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:41.040 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:41.032+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:41.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:41.120+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:41.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:41.144+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:41.422 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:41.417+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:41.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:41.543+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:41.741 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:41.734+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:42.000 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:41.991+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:42.021 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:42.015+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:42.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:42.102+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:42.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:42.107+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:42.439 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:42.434+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:42.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:42.540+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:42.777 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:42.771+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:43.010 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:43.000+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:43.015 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:43.009+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:43.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:43.057+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:43.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:43.142+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:43.400 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:43.394+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:43.513 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:43.506+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:43.762 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:43.753+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:44.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:44.000+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:44.023 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:44.018+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:44.034 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:44.027+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:44.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:44.120+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:44.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:44.409+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:44.474 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:44.467+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:44.788 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:44.782+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:45.009 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:45.003+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:45.028 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:45.021+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:45.042 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:45.036+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:45.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:45.099+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:45.439 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:45.434+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:45.441 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:45.435+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:45.763 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:45.756+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:45.998 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:45.992+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:46.013 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:46.007+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:46.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:46.056+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:46.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:46.057+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:46.430 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:46.421+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:46.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:46.467+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:46.805 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:46.784+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:46.985 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:46.980+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:46.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:46.984+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:47.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:47.013+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:47.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:47.064+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:47.465 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:47.459+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:47.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:47.516+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:47.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:47.518+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:47.820 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:47.813+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:47.976 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:47.970+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:47.988 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:47.983+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:48.000 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:47.994+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:48.115 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:48.109+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:48.516 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:48.506+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:48.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:48.514+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:48.522 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:48.516+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:48.817 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:48.811+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:48.964 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:48.958+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:49.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:48.996+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:49.023 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:49.016+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:49.094 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:49.081+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:49.531 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:49.525+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:49.533 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:49.526+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:49.553 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:49.547+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:49.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:49.783+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:49.938 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:49.929+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:49.969 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:49.960+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:50.002 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:49.996+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:50.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:50.068+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:50.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:50.561+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:50.568 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:50.563+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:50.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:50.597+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:50.841 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:50.833+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:50.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:50.907+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:50.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:50.949+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:50.984 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:50.977+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:51.055 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:51.044+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:51.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:51.537+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:51.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:51.539+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:51.595 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:51.588+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:51.835 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:51.828+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:51.966 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:51.959+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:51.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:51.961+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:51.971 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:51.966+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:52.023 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:52.017+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:52.498 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:52.491+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:52.498 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:52.493+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:52.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:52.558+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:52.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:52.789+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:52.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:52.923+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:52.961 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:52.954+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:52.973 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:52.968+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:53.074 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:53.068+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:53.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:53.517+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:53.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:53.519+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:53.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:53.535+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:53.811 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:53.803+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:53.887 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:53.879+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:53.912 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:53.906+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:54.003 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:53.997+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:54.111 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:54.105+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:54.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:54.476+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:54.484 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:54.478+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:54.498 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:54.492+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:54.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:54.823+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:54.898 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:54.892+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:54.927 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:54.920+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:54.993 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:54.987+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:55.119 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:55.113+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:55.462 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:55.457+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:55.465 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:55.460+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:55.486 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:55.479+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:55.793 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:55.786+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:55.870 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:55.865+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:55.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:55.939+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:55.953 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:55.947+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:56.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:56.082+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:56.445 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:56.439+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:56.457 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:56.451+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:56.461 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:56.456+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:56.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:56.828+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:56.848 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:56.842+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:56.926 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:56.920+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:56.962 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:56.955+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:57.141 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:57.136+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:57.416 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:57.410+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:57.417 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:57.412+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:57.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:57.437+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:57.857 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:57.848+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:57.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:57.850+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:57.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:57.938+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:58.020 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:58.012+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:58.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:58.132+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:58.413 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:58.407+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:58.414 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:58.408+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:58.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:58.415+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:58.834 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:58.827+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:58.909 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:58.885+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:58.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:58.967+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:25:59.050 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:25:59.043+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:25:59.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:25:59.102+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:25:59.388 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:59.382+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:25:59.389 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:25:59.384+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:25:59.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:25:59.462+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:25:59.849 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:25:59.842+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:25:59.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:25:59.858+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:25:59.971 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:25:59.964+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:00.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:00.075+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:00.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:00.077+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:00.365 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:00.360+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:00.367 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:00.361+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:00.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:00.484+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:00.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:00.823+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:00.880 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:00.874+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:00.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:00.988+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:01.055 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:01.049+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:01.122 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:01.116+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:01.349 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:01.342+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:01.353 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:01.346+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:01.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:01.442+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:01.855 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:01.848+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:01.931 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:01.924+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:01.977 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:01.970+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:02.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:02.015+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:02.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:02.101+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:02.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:02.306+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:02.318 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:02.308+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:02.440 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:02.435+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:02.866 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:02.860+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:02.952 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:02.944+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:02.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:02.944+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:02.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:02.986+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:03.143 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:03.137+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:03.292 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:03.284+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:03.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:03.286+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:03.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:03.474+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:03.884 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:03.879+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:03.937 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:03.931+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:03.994 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:03.988+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:04.012 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:04.005+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:04.107 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:04.100+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:04.251 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:04.244+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:04.252 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:04.247+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:04.506 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:04.501+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:04.857 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:04.851+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:04.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:04.888+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:04.981 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:04.968+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:05.030 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:05.024+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:05.156 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:05.145+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:05.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:05.263+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:05.270 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:05.265+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:05.552 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:05.546+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:05.843 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:05.836+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:05.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:05.898+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:06.006 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:05.998+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:06.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:06.029+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:06.187 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:06.181+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:06.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:06.276+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:06.285 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:06.278+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:06.508 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:06.502+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:06.814 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:06.809+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:06.933 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:06.928+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:06.990 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:06.985+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:06.995 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:06.989+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:07.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:07.201+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:07.309 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:07.302+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:07.310 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:07.305+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:07.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:07.475+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:07.779 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:07.773+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:07.977 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:07.971+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:08.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:08.015+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:08.046 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:08.040+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:08.204 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:08.198+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:08.307 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:08.301+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:08.308 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:08.302+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:08.451 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:08.444+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:08.830 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:08.823+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:08.958 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:08.952+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:08.994 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:08.988+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:09.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:09.084+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:09.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:09.196+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:09.269 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:09.260+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:09.273 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:09.267+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:09.429 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:09.423+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:09.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:09.784+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:09.967 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:09.961+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:09.992 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:09.986+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:10.111 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:10.106+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:10.249 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:10.240+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:10.313 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:10.305+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:10.319 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:10.309+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:10.434 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:10.429+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:10.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:10.834+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:10.967 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:10.961+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:11.021 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:11.015+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:11.115 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:11.105+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:11.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:11.239+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:11.324 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:11.317+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:11.325 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:11.319+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:11.426 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:11.420+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:11.844 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:11.838+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:11.997 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:11.988+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:12.049 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:12.042+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:12.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:12.059+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:12.258 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:12.253+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:12.293 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:12.288+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:12.296 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:12.291+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:12.414 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:12.402+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:12.896 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:12.890+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:13.020 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:13.012+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:13.090 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:13.084+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:13.104 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:13.098+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:13.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:13.232+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:13.331 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:13.325+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:13.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:13.330+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:13.421 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:13.412+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:13.907 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:13.901+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:14.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:14.048+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:14.128 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:14.123+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:14.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:14.126+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:14.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:14.221+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:14.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:14.339+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:14.347 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:14.341+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:14.413 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:14.407+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:14.664 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:26:14.655+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e949 v949) 2019-11-29T20:26:14.935 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:14.928+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:15.057 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:15.052+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:15.102 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:15.096+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:15.174 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:15.167+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:15.230 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:15.223+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:15.345 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:15.338+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:15.346 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:15.340+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:15.389 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:15.383+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:15.940 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:15.934+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:16.041 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:16.036+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:16.060 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:16.052+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:16.134 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:16.128+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:16.282 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:16.276+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:16.379 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:16.374+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:16.392 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:16.385+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:16.393 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:16.388+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:16.984 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:16.978+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:17.030 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:17.024+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:17.086 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:17.080+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:17.170 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:17.164+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:17.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:17.256+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:17.356 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:17.350+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:17.383 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:17.377+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:17.385 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:17.379+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:17.976 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:17.970+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:18.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:18.056+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:18.066 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:18.060+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:18.125 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:18.120+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:18.262 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:18.255+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:18.379 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:18.374+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:18.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:18.376+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:18.400 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:18.394+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:18.990 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:26:18.983+0000 1694c700 -1 osd.5 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:50.933483+0000 front 2019-11-29T20:24:50.967891+0000 (oldest deadline 2019-11-29T20:25:36.172914+0000) 2019-11-29T20:26:19.022 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:19.015+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:19.084 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:26:19.077+0000 1694c700 -1 osd.6 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.916471+0000 front 2019-11-29T20:24:55.751730+0000 (oldest deadline 2019-11-29T20:25:37.427796+0000) 2019-11-29T20:26:19.127 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:26:19.122+0000 1694c700 -1 osd.1 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:55.968502+0000 front 2019-11-29T20:24:56.020771+0000 (oldest deadline 2019-11-29T20:25:41.255491+0000) 2019-11-29T20:26:19.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:26:19.233+0000 1694c700 -1 osd.7 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:54.560177+0000 front 2019-11-29T20:24:54.619284+0000 (oldest deadline 2019-11-29T20:25:37.335388+0000) 2019-11-29T20:26:19.398 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:19.392+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:19.399 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:19.394+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:19.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:26:19.417+0000 1694c700 -1 osd.4 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:52.368930+0000 front 2019-11-29T20:24:52.588309+0000 (oldest deadline 2019-11-29T20:25:36.442368+0000) 2019-11-29T20:26:19.746 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:26:19.738+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 48sec e949 v949) 2019-11-29T20:26:20.060 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:26:20.055+0000 1694c700 -1 osd.2 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:24:51.199295+0000 front 2019-11-29T20:24:51.235375+0000 (oldest deadline 2019-11-29T20:25:37.070216+0000) 2019-11-29T20:26:20.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:20.413+0000 1694c700 -1 osd.0 949 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:25:07.194040+0000 (oldest deadline 2019-11-29T20:25:47.194040+0000) 2019-11-29T20:26:20.419 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:20.414+0000 1694c700 -1 osd.0 949 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:26:21.483 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:26:21.462+0000 1694c700 -1 osd.0 950 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:125744 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e946) 2019-11-29T20:27:52.025 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:52.018+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:52.627 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:52.620+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:52.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:52.845+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:53.071 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:53.063+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:53.443 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:53.435+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:53.478 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:53.473+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:53.621 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:53.616+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:53.622 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:53.613+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:53.679 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:53.672+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:53.885 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:53.877+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:54.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:54.087+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:54.471 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:54.464+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:54.480 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:54.474+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:54.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:54.631+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:54.663 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:54.658+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:54.726 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:54.719+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:54.844 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:54.838+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:55.135 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:55.128+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:55.464 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:55.457+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:55.468 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:55.462+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:55.596 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:55.588+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:55.664 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:55.656+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:55.737 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:55.730+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:55.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:55.892+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:56.135 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:56.127+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:56.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:56.418+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:56.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:56.435+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:56.568 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:56.562+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:56.707 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:56.701+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:56.732 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:56.724+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:56.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:56.943+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:57.117 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:57.110+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:57.421 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:57.416+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:57.436 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:57.429+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:57.574 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:57.565+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:57.725 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:57.707+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:57.756 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:57.748+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:57.909 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:57.903+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:58.129 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:58.121+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:58.436 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:58.427+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:58.449 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:58.441+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:58.603 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:58.595+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:58.683 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:58.675+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:58.747 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:58.741+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:58.890 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:58.883+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:27:59.162 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:27:59.154+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:27:59.417 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:27:59.410+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:27:59.490 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:27:59.484+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:27:59.560 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:27:59.552+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:27:59.707 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:27:59.699+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:27:59.728 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:27:59.722+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:27:59.890 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:27:59.883+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:00.180 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:00.172+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:00.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:00.451+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:00.506 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:00.499+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:00.599 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:00.591+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:00.663 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:00.655+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:00.736 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:00.729+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:00.937 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:00.917+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:01.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:01.154+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:01.455 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:01.449+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:01.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:01.498+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:01.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:01.545+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:01.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:01.618+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:01.745 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:01.737+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:01.964 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:01.958+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:02.161 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:02.154+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:02.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:02.493+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:02.525 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:02.518+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:02.534 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:02.526+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:02.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:02.597+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:02.740 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:02.734+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:02.961 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:02.955+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:03.210 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:03.204+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:03.478 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:03.470+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:03.547 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:03.541+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:03.569 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:03.563+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:03.625 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:03.616+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:03.753 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:03.747+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:03.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:03.926+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:04.229 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:04.222+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:04.512 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:04.504+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:04.513 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:04.506+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:04.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:04.580+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:04.592 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:04.586+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:04.782 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:04.774+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:04.891 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:04.882+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:05.293 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:05.272+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:05.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:05.467+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:05.510 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:05.503+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:05.606 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:05.599+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:05.621 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:05.613+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:05.826 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:05.817+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:05.871 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:05.860+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:06.322 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:06.316+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:06.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:06.446+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:06.519 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:06.512+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:06.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:06.556+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:06.668 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:06.662+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:06.860 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:06.852+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:06.875 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:06.869+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:07.345 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:07.338+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:07.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:07.431+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:07.520 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:07.513+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:07.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:07.580+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:07.708 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:07.701+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:07.838 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:07.831+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:07.854 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:07.847+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:08.363 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:08.350+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:08.607 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:08.461+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:08.607 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:08.540+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:08.607 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:08.576+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:08.756 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:08.749+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:08.800 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:08.795+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:08.830 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:08.824+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:09.335 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:09.329+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:09.506 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:09.498+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:09.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:09.536+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:09.587 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:09.579+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:09.713 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:09.705+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:09.806 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:09.796+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:09.845 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:09.838+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:10.339 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:10.332+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:10.469 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:10.463+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:10.556 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:10.550+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:10.618 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:10.611+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:10.768 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:10.761+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:10.791 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:10.782+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:10.893 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:10.887+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:11.387 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:11.379+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:11.508 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:11.503+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:11.538 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:11.530+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:11.621 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:11.613+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:11.729 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:11.721+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:11.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:11.779+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:11.889 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:11.882+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:12.352 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:12.344+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:12.507 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:12.499+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:12.525 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:12.518+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:12.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:12.626+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:12.751 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:12.746+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:12.779 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:12.773+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:12.846 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:12.840+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:13.348 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:13.342+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:13.485 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:13.477+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:13.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:13.485+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:13.639 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:13.633+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:13.716 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:13.706+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:13.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:13.733+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:13.856 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:13.850+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:14.317 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:14.310+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:14.483 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:14.475+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:14.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:14.518+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:14.687 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:14.681+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:14.689 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:14.682+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:14.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:14.712+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:14.828 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:14.819+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:15.309 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:15.298+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:15.484 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:15.477+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:15.529 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:15.522+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:15.666 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:15.659+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:15.681 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:15.674+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:15.685 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:15.678+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:15.868 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:15.859+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:16.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:16.315+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:16.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:16.461+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:16.533 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:16.526+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:16.659 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:16.653+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:16.668 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:16.662+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:16.669 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:16.661+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:16.916 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:16.910+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:17.362 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:17.353+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:17.524 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:17.508+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:17.550 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:17.543+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:17.633 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:17.627+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:17.644 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:17.637+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:17.693 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:17.685+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:17.914 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:17.907+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:18.397 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:18.391+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:18.480 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:18.471+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:18.587 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:18.580+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:18.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:18.599+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:18.671 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:18.664+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:18.683 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:18.678+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:18.875 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:18.869+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:19.425 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:19.418+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:19.439 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:19.433+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:19.605 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:19.599+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:19.632 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:19.625+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:19.633 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:19.623+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:19.665 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:19.659+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:19.905 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:19.896+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:20.383 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:20.376+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:20.472 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:20.465+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:20.604 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:20.598+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:20.648 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:20.640+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:20.648 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:20.641+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:20.649 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:20.642+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:20.910 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:20.904+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:21.369 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:21.363+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:21.443 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:21.437+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:21.566 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:21.559+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:21.628 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:21.622+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:21.651 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:21.644+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:21.683 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:21.677+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:21.951 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:21.945+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:22.412 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:22.405+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:22.432 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:22.426+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:22.544 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:22.538+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:22.605 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:22.597+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:22.645 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:22.639+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:22.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:22.672+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:23.002 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:22.994+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:23.407 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:23.396+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:23.454 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:23.448+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:23.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:23.516+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:23.634 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:23.627+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:23.667 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:23.660+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:23.705 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:23.700+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:23.981 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:23.971+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:24.360 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:24.353+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:24.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:28:24.451+0000 1694c700 -1 osd.5 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.090559+0000 front 2019-11-29T20:27:07.975259+0000 (oldest deadline 2019-11-29T20:27:52.641503+0000) 2019-11-29T20:28:24.543 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:28:24.536+0000 1694c700 -1 osd.1 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:06.637617+0000 front 2019-11-29T20:27:06.559965+0000 (oldest deadline 2019-11-29T20:27:52.412607+0000) 2019-11-29T20:28:24.623 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:28:24.616+0000 1694c700 -1 osd.7 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.670582+0000 front 2019-11-29T20:27:08.517275+0000 (oldest deadline 2019-11-29T20:27:53.018826+0000) 2019-11-29T20:28:24.660 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:28:24.653+0000 1694c700 -1 osd.6 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.994174+0000 front 2019-11-29T20:27:09.995417+0000 (oldest deadline 2019-11-29T20:27:53.155176+0000) 2019-11-29T20:28:24.710 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:24.705+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:28:24.969 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:28:24.961+0000 1694c700 -1 osd.3 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:08.663245+0000 front 2019-11-29T20:27:08.691057+0000 (oldest deadline 2019-11-29T20:27:52.556004+0000) 2019-11-29T20:28:25.240 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:28:25.232+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e956 v956) 2019-11-29T20:28:25.360 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:28:25.341+0000 1694c700 -1 osd.4 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.979145+0000 front 2019-11-29T20:27:09.743535+0000 (oldest deadline 2019-11-29T20:27:51.321422+0000) 2019-11-29T20:28:25.765 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:28:25.753+0000 1694c700 -1 osd.2 956 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:27:09.795416+0000 front 2019-11-29T20:27:09.794066+0000 (oldest deadline 2019-11-29T20:27:53.247954+0000) 2019-11-29T20:29:01.653 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:09.788 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.669 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:09.805 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.673 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:09.854 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.677 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:09.858 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.683 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:09.864 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.687 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:09.867 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.931 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:10.067 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.957 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:10.138 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:01.993 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:10.173 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.725 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:28.861 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.727 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:28.863 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.751 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:28.932 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.752 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:28.934 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.753 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:28.934 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.760 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:28.941 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.776 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:28.912 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.786 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:28.967 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:20.805 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:28.986 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:24.453 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:24.446+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:24.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:24.577+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:25.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:25.183+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:25.399 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:25.392+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:25.497 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:25.488+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:25.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:25.526+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:25.625 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:25.618+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:26.170 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:26.163+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:26.375 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:26.368+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:26.489 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:26.481+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:26.578 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:26.572+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:26.585 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:26.578+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:26.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:26.794+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:27.211 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:27.203+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:27.392 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:27.386+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:27.504 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:27.497+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:27.544 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:27.537+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:27.560 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:27.549+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:27.762 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:27.756+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:28.264 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:28.256+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:28.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:28.359+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:28.547 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:28.539+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:28.548 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:28.540+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:28.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:28.562+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:28.788 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:28.782+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:29.261 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:29.249+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:29.385 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:29.379+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:29.517 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:29.510+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:29.522 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:29.515+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:29.544 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:29.537+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:29.776 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:29.768+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:30.118 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:30.113+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:30.259 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:30.252+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:30.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:30.344+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:30.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:30.482+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:30.519 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:30.512+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:30.559 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:30.551+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:30.798 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:30.791+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:30.919 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:39.054 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.955 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:39.136 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.956 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:39.137 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.958 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:39.138 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.963 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:39.098 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.985 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:13:39.166 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:30.997 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:13:39.133 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:31.010 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:39.190 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:31.048 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:13:39.228 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:29:31.101 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:31.093+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:31.279 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:31.268+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:31.318 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:31.312+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:31.502 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:31.495+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:31.540 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:31.534+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:31.593 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:31.587+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:31.760 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:31.755+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:32.123 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:32.117+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:32.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:32.246+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:32.310 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:32.304+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:32.528 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:32.521+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:32.542 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:32.535+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:32.556 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:32.551+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:32.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:32.735+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:33.084 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:33.080+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:33.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:33.244+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:33.330 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:33.325+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:33.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:33.482+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:33.530 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:33.523+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:33.532 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:33.525+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:33.753 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:33.747+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:34.120 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:34.114+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:34.242 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:34.236+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:34.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:34.322+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:34.465 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:34.459+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:34.511 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:34.502+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:34.570 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:34.563+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:34.724 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:34.719+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:35.164 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:35.154+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:35.208 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:35.202+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:35.296 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:35.290+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:35.480 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:35.474+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:35.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:35.478+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:35.542 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:35.536+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:35.721 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:35.715+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:36.186 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:36.178+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:36.257 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:36.251+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:36.328 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:36.322+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:36.466 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:36.460+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:36.492 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:36.486+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:36.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:36.585+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:36.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:36.730+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:37.171 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:37.164+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:37.171 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:37.166+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:37.243 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:37.237+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:37.378 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:37.372+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:37.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:37.417+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:37.485 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:37.478+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:37.612 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:37.606+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:37.711 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:37.704+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:38.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:38.202+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:38.208 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:38.203+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:38.274 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:38.268+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:38.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:38.358+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:38.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:38.393+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:38.521 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:38.513+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:38.616 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:38.607+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:38.735 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:38.730+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:39.242 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:39.236+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:39.244 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:39.239+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:39.265 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:39.259+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:39.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:39.365+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:39.430 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:39.423+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:39.550 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:39.543+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:39.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:39.622+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:39.733 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:39.727+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:40.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:40.222+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:40.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:40.247+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:40.260 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:40.250+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:40.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:40.357+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:40.431 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:40.423+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:40.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:40.575+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:40.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:40.625+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:40.782 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:40.776+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:41.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:41.232+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:41.254 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:41.248+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:41.257 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:41.253+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:41.377 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:41.371+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:41.469 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:41.461+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:41.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:41.553+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:41.670 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:41.664+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:41.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:41.752+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:42.263 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:42.254+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:42.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:42.286+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:42.297 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:42.291+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:42.417 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:42.411+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:42.465 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:42.459+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:42.544 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:42.539+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:42.676 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:42.670+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:42.750 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:42.736+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:43.235 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:43.229+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:43.334 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:43.329+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:43.336 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:43.332+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:43.419 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:43.413+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:43.430 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:43.423+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:43.561 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:43.555+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:43.671 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:43.661+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:43.755 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:43.748+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:44.205 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:44.199+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:44.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:44.346+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:44.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:44.348+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:44.389 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:44.381+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:44.439 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:44.433+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:44.610 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:44.604+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:44.632 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:44.626+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:44.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:44.782+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:45.190 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:45.184+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:45.322 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:45.312+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:45.323 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:45.315+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:45.403 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:45.397+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:45.420 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:45.413+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:45.565 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:45.559+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:45.597 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:45.592+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:45.809 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:45.803+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:46.201 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:46.190+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:46.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:46.293+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:46.301 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:46.294+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:46.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:46.360+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:46.376 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:46.370+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:46.559 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:46.553+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:46.603 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:46.598+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:46.785 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:46.778+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:47.199 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:47.192+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:47.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:47.256+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:47.263 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:47.257+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:47.374 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:47.368+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:47.398 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:47.390+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:47.583 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:47.578+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:47.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:47.608+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:47.801 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:47.794+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:48.234 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:48.229+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:48.278 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:48.272+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:48.279 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:48.274+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:48.397 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:48.384+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:48.427 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:48.421+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:48.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:48.603+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:48.635 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:48.630+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:48.774 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:48.768+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:49.248 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:49.241+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:49.305 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:49.298+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:49.306 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:49.300+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:49.382 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:49.375+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:49.472 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:49.465+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:49.666 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:49.652+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:49.685 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:49.668+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:49.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:49.813+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:50.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:50.261+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:50.350 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:50.342+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:50.351 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:50.345+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:50.402 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:50.395+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:50.516 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:50.510+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:50.640 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:50.635+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:50.649 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:50.643+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:50.838 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:50.833+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:51.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:51.248+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:51.341 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:51.333+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:51.342 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:51.335+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:51.426 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:51.419+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:51.512 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:51.492+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:51.658 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:51.653+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:51.688 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:51.681+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:51.877 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:51.872+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:52.255 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:52.250+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:52.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:52.375+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:52.384 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:52.377+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:52.456 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:52.450+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:52.457 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:52.451+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:52.636 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:52.629+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:52.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:52.719+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:52.850 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:52.845+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:53.297 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:53.290+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:53.335 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:53.329+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:53.337 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:53.332+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:53.486 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:53.480+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:53.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:53.487+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:53.612 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:53.603+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:53.732 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:53.725+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:53.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:53.860+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:54.311 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:54.304+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:54.372 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:54.365+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:54.373 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:54.367+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:54.497 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:54.485+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:54.511 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:54.504+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:54.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:54.584+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:54.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:54.698+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:54.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:54.908+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:55.365 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:55.358+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:55.381 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:55.374+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:55.382 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:55.377+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:55.515 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:55.508+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:55.534 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:55.528+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:55.642 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:55.565+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:55.714 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:55.707+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:55.876 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:55.868+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:56.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:56.387+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:56.397 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:56.391+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:56.401 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:56.396+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:56.508 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:56.502+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:56.515 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:56.509+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:56.611 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:56.605+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:56.701 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:56.695+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:56.848 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:56.841+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:57.372 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:57.366+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:57.372 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:57.368+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:57.400 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:57.393+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:57.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:57.501+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:57.542 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:57.533+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:57.627 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:57.620+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:57.692 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:57.686+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:57.870 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:57.862+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:58.400 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:58.382+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:58.401 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:58.384+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:58.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:58.417+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:58.494 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:58.488+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:58.506 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:58.498+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:58.656 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:58.648+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:58.722 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:58.716+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:58.840 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:58.828+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:29:59.354 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:59.349+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:29:59.356 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:29:59.351+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:29:59.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:29:59.432+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:29:59.500 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:29:59.494+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:29:59.541 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:29:59.535+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:29:59.675 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:29:59.669+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:29:59.737 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:29:59.707+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:29:59.887 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:29:59.880+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:00.394 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:00.387+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:00.462 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:00.417+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:00.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:00.459+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:00.482 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:00.465+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:00.500 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:00.494+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:00.715 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:00.711+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:00.727 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:00.715+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:00.915 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:00.908+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:00.966 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:30:00.947+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e962 v962) 2019-11-29T20:30:01.381 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:01.376+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:01.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:01.450+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:01.486 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:01.481+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:01.488 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:01.483+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:01.526 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:01.520+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:01.729 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:01.720+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:01.743 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:01.734+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:01.899 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:01.893+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:02.338 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:02.332+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:02.442 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:02.436+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:02.492 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:02.486+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:02.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:02.515+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:02.521 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:02.517+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:02.727 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:02.721+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:02.749 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:02.736+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:02.925 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:02.919+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:03.326 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:03.320+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:03.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:03.457+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:03.525 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:03.519+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:03.527 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:03.522+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:03.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:03.529+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:03.781 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:03.772+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:03.789 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:03.778+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:03.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:03.887+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:04.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:04.294+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:04.504 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:04.490+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:04.514 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:04.509+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:04.514 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:04.505+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:04.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:04.511+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:04.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:04.815+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:04.832 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:04.826+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:04.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:04.913+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:05.327 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:05.321+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:05.489 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:05.480+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:05.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:05.498+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:05.504 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:05.499+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:05.540 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:05.533+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:05.787 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:05.780+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:05.788 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:05.783+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:05.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:05.941+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:05.977 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:30:05.972+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e962 v962) 2019-11-29T20:30:06.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:06.326+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:06.534 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:06.526+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:06.535 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:06.528+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:06.535 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:06.529+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:06.545 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:06.539+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:06.748 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:06.742+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:06.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:06.826+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:06.996 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:06.990+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:07.312 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:07.306+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:07.492 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:07.486+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:07.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:07.488+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:07.538 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:07.533+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:07.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:07.543+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:07.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:07.716+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:07.834 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:07.827+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:08.014 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:08.006+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:08.332 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:08.326+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:08.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:08.502+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:08.510 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:08.505+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:08.543 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:08.537+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:08.555 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:08.548+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:08.705 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:08.698+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:08.843 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:08.838+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:09.054 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:09.048+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:09.369 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:09.362+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:09.470 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:09.464+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:09.472 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:09.468+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:09.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:09.501+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:09.596 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:09.589+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:09.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:09.750+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:09.833 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:09.826+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:10.107 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:10.100+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:10.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:30:10.371+0000 1694c700 -1 osd.6 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:40.180736+0000 front 2019-11-29T20:28:40.280255+0000 (oldest deadline 2019-11-29T20:29:24.836994+0000) 2019-11-29T20:30:10.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:10.462+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:10.469 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:10.464+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:10.560 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:10.552+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:30:10.644 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:30:10.635+0000 1694c700 -1 osd.2 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:38.553140+0000 front 2019-11-29T20:28:38.619848+0000 (oldest deadline 2019-11-29T20:29:24.420297+0000) 2019-11-29T20:30:10.805 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:30:10.781+0000 1694c700 -1 osd.4 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.302512+0000 front 2019-11-29T20:28:42.413386+0000 (oldest deadline 2019-11-29T20:29:24.474116+0000) 2019-11-29T20:30:10.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:30:10.861+0000 1694c700 -1 osd.7 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.822210+0000 front 2019-11-29T20:28:41.865539+0000 (oldest deadline 2019-11-29T20:29:24.059940+0000) 2019-11-29T20:30:11.075 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:30:11.058+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 47sec e962 v962) 2019-11-29T20:30:11.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:30:11.106+0000 1694c700 -1 osd.1 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:41.717200+0000 front 2019-11-29T20:28:41.732241+0000 (oldest deadline 2019-11-29T20:29:26.370743+0000) 2019-11-29T20:30:11.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:11.505+0000 1694c700 -1 osd.0 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:28:56.378916+0000 (oldest deadline 2019-11-29T20:29:36.378916+0000) 2019-11-29T20:30:11.512 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:30:11.507+0000 1694c700 -1 osd.0 962 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e960) 2019-11-29T20:30:11.550 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:30:11.544+0000 1694c700 -1 osd.5 962 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:28:42.024220+0000 front 2019-11-29T20:28:42.019286+0000 (oldest deadline 2019-11-29T20:29:25.500988+0000) 2019-11-29T20:31:41.799 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:41.794+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:41.955 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:41.947+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:42.829 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:42.823+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:42.965 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:42.958+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:43.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:43.026+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:43.122 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:43.116+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:43.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:43.147+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:43.819 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:43.813+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:43.946 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:43.938+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:44.066 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:44.060+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:44.120 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:44.113+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:44.165 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:44.158+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:44.606 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:44.596+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:44.805 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:44.797+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:44.990 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:44.982+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:45.097 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:45.091+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:45.106 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:45.100+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:45.165 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:45.158+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:45.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:45.584+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:45.827 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:45.818+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:45.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:45.950+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:46.138 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:46.131+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:46.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:46.134+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:46.198 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:46.193+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:46.559 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:46.551+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:46.793 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:46.787+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:47.005 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:46.998+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:47.154 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:47.149+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:47.168 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:47.160+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:47.249 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:47.243+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:47.518 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:47.511+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:47.813 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:47.807+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:48.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:48.038+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:48.189 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:48.184+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:48.197 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:48.190+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:48.289 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:48.282+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:48.519 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:48.511+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:48.858 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:48.852+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:49.085 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:49.077+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:49.190 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:49.185+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:49.238 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:49.231+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:49.336 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:49.328+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:49.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:49.484+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:49.908 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:49.900+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:50.086 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:50.077+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:50.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:50.176+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:50.281 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:50.274+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:50.341 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:50.333+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:50.462 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:50.454+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:50.951 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:50.945+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:51.085 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:51.078+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:51.159 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:51.153+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:51.241 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:51.232+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:51.325 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:51.320+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:51.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:51.441+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:51.916 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:51.909+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:52.118 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:52.109+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:52.162 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:52.156+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:52.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:52.225+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:52.350 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:52.344+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:52.469 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:52.459+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:52.903 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:52.896+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:53.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:53.159+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:53.183 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:53.175+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:53.230 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:53.223+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:53.390 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:53.382+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:53.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:53.420+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:53.859 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:53.853+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:54.149 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:54.142+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:54.191 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:54.185+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:54.225 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:54.211+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:54.403 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:54.395+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:54.426 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:54.421+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:54.912 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:54.906+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:55.123 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:55.113+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:55.201 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:55.194+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:55.219 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:55.213+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:55.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:55.425+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:55.437 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:55.431+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:55.947 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:55.939+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:56.117 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:56.107+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:56.196 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:56.189+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:56.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:56.240+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:56.407 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:56.400+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:56.456 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:56.449+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:56.981 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:56.975+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:57.093 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:57.086+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:57.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:57.204+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:57.265 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:57.259+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:57.447 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:57.441+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:57.474 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:57.468+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:58.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:58.004+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:58.139 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:58.132+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:58.212 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:58.205+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:58.253 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:58.241+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:58.463 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:58.456+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:31:58.525 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:58.518+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:59.011 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:31:59.002+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:31:59.161 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:31:59.155+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:31:59.214 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:31:59.208+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:31:59.267 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:31:59.259+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:31:59.482 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:31:59.475+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:31:59.517 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:31:59.510+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:00.042 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:00.035+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:00.150 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:00.144+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:00.209 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:00.202+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:00.234 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:00.227+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:00.504 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:00.498+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:00.520 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:00.513+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:01.075 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:01.067+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:01.116 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:01.108+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:01.194 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:01.188+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:01.250 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:01.245+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:01.515 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:01.509+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:01.544 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:01.538+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:02.121 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:02.116+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:02.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:02.131+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:02.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:02.210+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:02.243 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:02.236+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:02.343 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:02.336+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:02.533 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:02.528+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:02.593 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:02.587+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:03.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:03.152+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:03.179 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:03.171+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:03.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:03.204+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:03.221 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:03.215+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:03.303 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:03.296+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:03.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:03.559+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:03.629 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:03.624+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:04.174 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:04.168+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:04.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:04.172+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:04.229 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:04.224+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:04.253 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:04.245+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:04.268 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:04.261+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:04.555 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:04.544+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:04.667 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:04.660+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:05.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:05.138+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:05.186 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:05.180+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:05.189 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:05.183+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:05.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:05.257+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:05.304 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:05.298+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:05.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:05.572+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:05.648 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:05.640+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:06.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:06.137+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:06.180 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:06.174+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:06.181 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:06.174+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:06.225 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:06.217+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:06.262 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:06.255+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:06.569 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:06.563+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:06.641 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:06.636+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:07.144 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:07.136+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:07.145 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:07.139+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:07.155 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:07.149+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:07.205 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:07.199+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:07.311 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:07.306+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:07.601 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:07.593+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:07.605 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:07.598+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:08.104 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:08.096+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:08.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:08.126+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:08.188 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:08.181+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:08.251 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:08.243+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:08.324 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:08.317+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:08.562 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:08.555+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:08.607 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:08.600+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:09.125 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:09.119+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:09.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:09.146+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:09.212 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:09.206+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:09.290 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:09.281+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:09.298 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:09.291+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:09.564 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:09.558+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:09.616 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:09.609+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:10.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:10.156+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:10.188 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:10.181+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:10.196 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:10.191+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:10.271 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:10.264+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:10.325 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:10.319+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:10.585 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:10.579+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:10.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:10.625+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:11.199 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:11.194+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:11.233 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:11.225+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:11.244 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:11.239+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:11.264 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:11.257+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:11.294 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:11.287+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:11.600 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:11.594+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:11.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:11.611+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:12.154 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:12.149+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:12.214 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:12.208+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:12.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:12.243+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:12.256 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:12.250+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:12.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:12.282+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:12.596 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:12.590+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:12.623 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:12.617+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:13.147 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:13.142+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:13.255 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:13.248+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:13.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:13.265+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:13.273 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:13.266+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:13.328 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:13.322+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:13.620 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:13.602+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:13.624 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:13.618+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:14.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:14.098+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:14.247 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:14.241+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:14.267 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:14.257+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:14.312 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:14.305+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:14.320 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:14.313+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:14.639 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:14.633+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:14.654 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:14.648+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:15.069 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:15.062+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:15.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:15.261+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:15.311 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:15.304+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:15.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:15.350+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:15.371 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:15.365+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:15.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:15.644+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:15.652 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:15.645+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:16.062 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:16.053+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:16.273 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:16.267+0000 1694c700 -1 osd.1 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.337443+0000 front 2019-11-29T20:30:57.218166+0000 (oldest deadline 2019-11-29T20:31:41.193276+0000) 2019-11-29T20:32:16.293 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:16.287+0000 1694c700 -1 osd.6 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.802122+0000 front 2019-11-29T20:30:59.783149+0000 (oldest deadline 2019-11-29T20:31:42.287774+0000) 2019-11-29T20:32:16.342 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:32:16.335+0000 1694c700 -1 osd.7 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:56.801499+0000 front 2019-11-29T20:31:00.802150+0000 (oldest deadline 2019-11-29T20:32:02.230793+0000) 2019-11-29T20:32:16.389 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:32:16.383+0000 1694c700 -1 osd.5 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:31:01.002947+0000 front 2019-11-29T20:30:59.402497+0000 (oldest deadline 2019-11-29T20:31:40.981105+0000) 2019-11-29T20:32:16.525 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:32:16.515+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e967 v967) 2019-11-29T20:32:16.619 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:32:16.613+0000 1694c700 -1 osd.4 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.849736+0000 front 2019-11-29T20:30:57.847407+0000 (oldest deadline 2019-11-29T20:31:43.643534+0000) 2019-11-29T20:32:16.683 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:32:16.668+0000 1694c700 -1 osd.3 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:57.042907+0000 front 2019-11-29T20:30:56.553265+0000 (oldest deadline 2019-11-29T20:31:42.386357+0000) 2019-11-29T20:32:17.040 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:32:17.035+0000 1694c700 -1 osd.2 967 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:30:59.822340+0000 front 2019-11-29T20:30:59.821317+0000 (oldest deadline 2019-11-29T20:31:42.693251+0000) 2019-11-29T20:32:48.553 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:48.546+0000 114ab700 -1 osd.6 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:32:48.582 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:48.570+0000 34f8a700 -1 osd.6 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:32:48.665 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:48.601+0000 11cac700 -1 osd.6 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:32:48.670 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:48.655+0000 3678d700 -1 osd.1 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:32:48.686 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:32:48.663+0000 31f84700 -1 osd.1 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:32:48.794 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:32:48.766+0000 11cac700 -1 osd.6 971 build_incremental_map_msg missing incremental map 971 2019-11-29T20:33:01.943 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:17:10.079 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:01.953 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:17:10.089 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:01.956 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:17:10.137 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:01.958 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:17:10.139 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:01.959 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:17:10.140 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:01.962 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:17:10.143 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:02.205 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:17:10.385 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:02.228 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:17:10.409 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:02.305 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:17:10.441 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:33:14.508 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:14.502+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:15.495 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:15.489+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:15.941 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:15.933+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:16.189 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:16.183+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:16.472 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:16.464+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:16.480 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:16.474+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:16.836 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:16.827+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:16.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:16.890+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:17.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:17.204+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:17.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:17.425+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:17.438 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:17.433+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:17.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:17.847+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:17.918 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:17.911+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:18.247 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:18.238+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:18.459 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:18.452+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:18.467 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:18.461+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:18.885 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:18.878+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:18.915 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:18.907+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:19.216 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:19.210+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:19.431 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:19.427+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:19.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:19.448+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:19.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:19.502+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:19.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:19.862+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:20.063 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:19.940+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:20.063 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:19.952+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:20.217 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:20.212+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:20.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:20.417+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:20.455 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:20.449+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:20.481 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:20.468+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:20.896 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:20.888+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:20.916 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:20.908+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:20.928 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:20.921+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:21.176 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:21.170+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:21.421 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:21.416+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:21.461 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:21.449+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:21.509 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:21.501+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:21.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:21.876+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:21.908 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:21.887+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:21.960 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:21.953+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:22.137 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:22.131+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:22.428 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:22.422+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:22.474 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:22.468+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:22.547 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:22.538+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:22.902 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:22.896+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:22.929 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:22.910+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:22.929 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:22.910+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:23.110 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:23.104+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:23.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:23.383+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:23.494 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:23.490+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:23.580 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:23.574+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:23.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:23.882+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:23.914 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:23.905+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:23.927 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:23.921+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:24.148 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:24.143+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:24.354 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:24.349+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:24.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:24.485+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:24.563 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:24.557+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:24.882 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:24.877+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:24.894 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:24.889+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:24.902 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:24.897+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:25.127 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:25.120+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:25.313 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:25.307+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:25.454 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:25.450+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:25.615 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:25.607+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:25.860 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:25.855+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:25.921 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:25.915+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:25.923 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:25.918+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:26.113 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:26.107+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:26.302 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:26.297+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:26.489 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:26.484+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:26.490 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:26.485+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:26.644 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:26.636+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:26.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:26.848+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:26.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:26.870+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:26.960 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:26.953+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:27.067 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:27.062+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:27.298 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:27.287+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:27.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:27.451+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:27.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:27.453+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:27.689 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:27.683+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:27.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:27.848+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:27.870 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:27.864+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:27.977 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:27.971+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:28.034 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:28.028+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:28.324 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:28.316+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:28.487 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:28.479+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:28.488 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:28.481+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:28.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:28.641+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:28.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:28.856+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:28.910 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:28.905+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:28.983 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:28.976+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:29.061 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:29.051+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:29.295 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:29.287+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:29.523 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:29.517+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:29.524 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:29.518+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:29.612 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:29.599+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:29.819 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:29.812+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:29.911 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:29.904+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:29.993 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:29.987+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:30.048 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:30.040+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:30.304 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:30.297+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:30.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:30.503+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:30.511 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:30.506+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:30.611 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:30.606+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:30.855 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:30.848+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:30.879 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:30.872+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:31.004 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:30.998+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:31.013 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:31.007+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:31.261 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:31.256+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:31.478 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:31.472+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:31.479 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:31.473+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:31.567 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:31.560+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:31.812 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:31.805+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:31.836 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:31.830+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:32.051 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:32.046+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:32.052 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:32.045+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:32.223 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:32.217+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:32.435 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:32.429+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:32.436 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:32.431+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:32.622 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:32.615+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:32.814 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:32.808+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:32.816 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:32.810+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:33.011 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:33.005+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:33.084 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:33.077+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:33.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:33.187+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:33.458 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:33.451+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:33.459 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:33.453+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:33.653 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:33.647+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:33.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:33.802+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:33.851 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:33.844+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:34.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:34.016+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:34.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:34.051+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:34.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:34.150+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:34.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:34.448+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:34.455 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:34.450+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:34.671 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:34.664+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:34.807 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:34.800+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:34.843 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:34.836+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:34.981 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:34.975+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:35.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:35.077+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:35.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:35.198+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:35.460 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:35.453+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:35.463 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:35.458+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:35.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:35.680+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:35.856 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:35.850+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:35.883 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:35.877+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:35.946 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:35.940+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:36.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:36.093+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:36.186 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:36.180+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:36.516 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:36.498+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:36.517 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:36.502+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:36.714 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:36.707+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:36.855 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:36.849+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:36.862 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:36.856+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:36.962 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:36.955+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:37.133 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:37.127+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:37.157 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:37.152+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:37.538 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:37.532+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:37.539 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:37.534+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:37.744 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:37.738+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:37.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:37.811+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:37.850 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:37.844+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:37.917 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:37.911+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:38.145 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:38.140+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:38.177 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:38.172+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:38.503 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:38.497+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:38.504 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:38.499+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:38.735 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:38.729+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:38.845 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:38.840+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:38.847 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:38.842+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:38.872 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:38.867+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:39.129 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:39.124+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:39.209 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:39.203+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:39.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:39.535+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:39.540 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:39.536+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:39.743 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:39.738+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:39.837 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:39.832+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:39.850 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:39.844+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:39.905 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:39.900+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:40.109 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:40.102+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:40.226 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:40.216+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:40.581 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:40.575+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:40.583 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:40.578+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:40.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:40.781+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:40.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:40.825+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:40.854 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:40.849+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:40.948 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:40.942+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:41.145 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:41.139+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:41.205 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:41.199+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:41.560 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:41.555+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:41.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:41.556+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:41.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:41.760+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:41.813 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:41.806+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:41.870 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:41.864+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:41.999 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:41.994+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:42.166 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:42.161+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:42.230 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:42.225+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:42.544 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:42.538+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:42.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:42.540+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:42.739 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:42.733+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:42.782 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:42.769+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:42.926 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:42.918+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:43.016 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:43.011+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:43.174 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:43.168+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:43.203 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:43.197+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:43.505 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:43.500+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:43.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:43.504+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:43.784 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:43.778+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:43.822 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:43.816+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:43.946 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:43.940+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:44.012 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:44.005+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:44.178 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:44.171+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:44.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:44.183+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:44.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:44.538+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:44.545 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:44.540+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:44.764 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:44.757+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:44.809 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:44.803+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:44.986 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:44.978+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:45.008 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:45.002+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:45.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:45.170+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:45.194 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:45.188+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:45.559 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:45.552+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:45.561 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:45.555+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:45.776 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:45.770+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:45.817 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:45.811+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:45.951 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:45.944+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:46.054 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:46.047+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:46.150 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:46.145+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:46.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:46.167+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:46.550 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:46.544+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:46.551 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:46.546+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:46.793 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:46.786+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:46.815 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:46.808+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:46.907 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:46.900+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:46.983 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:33:46.964+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e973 v973) 2019-11-29T20:33:47.082 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:47.076+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:47.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:47.130+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:47.202 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:47.197+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:47.600 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:47.594+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:47.602 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:47.595+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:47.815 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:47.809+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:47.816 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:47.810+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:47.877 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:47.871+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:48.097 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:48.087+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:48.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:48.166+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:48.179 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:48.173+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:48.624 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:48.618+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:48.625 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:48.620+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:48.808 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:48.802+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:48.841 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:48.835+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:48.869 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:48.863+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:49.058 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:49.052+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:49.149 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:49.144+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:49.168 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:49.163+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:49.672 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:49.666+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:49.673 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:49.668+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:49.788 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:49.781+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:49.810 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:49.805+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:49.861 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:49.855+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:50.024 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:50.017+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:50.134 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:50.129+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:50.153 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:50.147+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:50.632 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:50.626+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:50.635 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:50.630+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:50.780 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:50.774+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:50.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:50.816+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:50.829 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:50.823+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:51.006 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:51.000+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:51.163 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:51.156+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:51.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:51.183+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:51.613 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:51.606+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:51.614 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:51.609+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:51.787 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:51.781+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:51.829 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:51.823+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:51.877 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:51.870+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:51.984 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:33:51.979+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e973 v973) 2019-11-29T20:33:52.035 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:52.029+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:52.203 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:52.197+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:52.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:52.239+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:52.626 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:52.620+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:52.628 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:52.624+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:52.757 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:52.750+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:52.811 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:52.805+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:52.849 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:52.841+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:53.088 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:53.080+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:53.192 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:53.186+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:53.217 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:53.212+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:53.611 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:53.605+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:53.612 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:53.607+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:53.783 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:53.776+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:53.856 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:53.851+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:53.893 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:53.887+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:54.107 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:54.102+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:54.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:54.188+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:54.256 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:54.250+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:54.634 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:54.628+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:54.635 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:54.629+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:54.775 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:54.770+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:54.833 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:54.826+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:54.938 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:54.932+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:55.075 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:55.070+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:55.193 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:55.187+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:55.305 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:55.300+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:55.655 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:55.650+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:55.656 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:55.651+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:55.809 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:55.802+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:55.874 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:55.867+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:55.960 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:55.954+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:56.074 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:56.068+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:56.169 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:56.161+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:56.341 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:56.331+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:33:56.628 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:56.617+0000 1694c700 -1 osd.0 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 ever on either front or back, first ping sent 2019-11-29T20:32:46.185660+0000 (oldest deadline 2019-11-29T20:33:26.185660+0000) 2019-11-29T20:33:56.628 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:33:56.618+0000 1694c700 -1 osd.0 973 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:127027 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e971) 2019-11-29T20:33:56.826 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:33:56.821+0000 1694c700 -1 osd.6 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:31.813678+0000 front 2019-11-29T20:32:31.780520+0000 (oldest deadline 2019-11-29T20:33:16.189971+0000) 2019-11-29T20:33:56.828 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:33:56.822+0000 1694c700 -1 osd.4 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:32.478909+0000 front 2019-11-29T20:32:32.350692+0000 (oldest deadline 2019-11-29T20:33:15.233968+0000) 2019-11-29T20:33:56.933 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:33:56.926+0000 1694c700 -1 osd.7 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:34.070512+0000 front 2019-11-29T20:32:33.986539+0000 (oldest deadline 2019-11-29T20:33:16.262568+0000) 2019-11-29T20:33:57.074 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:33:57.064+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.3 [v2:172.21.15.182:6808/9956,v1:172.21.15.182:6809/9956] for 44sec e973 v973) 2019-11-29T20:33:57.121 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:33:57.113+0000 1694c700 -1 osd.2 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:29.438434+0000 front 2019-11-29T20:32:29.487251+0000 (oldest deadline 2019-11-29T20:33:15.282330+0000) 2019-11-29T20:33:57.140 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:33:57.135+0000 1694c700 -1 osd.1 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:28.105411+0000 front 2019-11-29T20:32:34.021445+0000 (oldest deadline 2019-11-29T20:33:13.997929+0000) 2019-11-29T20:33:57.362 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:33:57.357+0000 1694c700 -1 osd.5 973 heartbeat_check: no reply from 172.21.15.182:6812 osd.3 since back 2019-11-29T20:32:33.834959+0000 front 2019-11-29T20:32:33.850833+0000 (oldest deadline 2019-11-29T20:33:19.066580+0000) 2019-11-29T20:34:29.320 INFO:tasks.ceph.osd.3.smithi182.stderr:*** Caught signal (Segmentation fault) ** 2019-11-29T20:34:29.321 INFO:tasks.ceph.osd.3.smithi182.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T20:34:29.438 INFO:tasks.ceph.osd.3.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:34:29.438 INFO:tasks.ceph.osd.3.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:34:29.438 INFO:tasks.ceph.osd.3.smithi182.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T20:34:29.438 INFO:tasks.ceph.osd.3.smithi182.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T20:34:29.438 INFO:tasks.ceph.osd.3.smithi182.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T20:34:29.439 INFO:tasks.ceph.osd.3.smithi182.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T20:34:29.440 INFO:tasks.ceph.osd.3.smithi182.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T20:34:29.440 INFO:tasks.ceph.osd.3.smithi182.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:34:29.466 INFO:tasks.ceph.osd.3.smithi182.stderr:2019-11-29T20:34:29.460+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T20:34:29.466 INFO:tasks.ceph.osd.3.smithi182.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T20:34:29.467 INFO:tasks.ceph.osd.3.smithi182.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T20:34:29.468 INFO:tasks.ceph.osd.3.smithi182.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T20:34:29.469 INFO:tasks.ceph.osd.3.smithi182.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:34:29.469 INFO:tasks.ceph.osd.3.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:34:29.469 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: 0> 2019-11-29T20:34:29.460+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:34:29.889 INFO:tasks.ceph.osd.3.smithi182.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T20:34:29.890 INFO:tasks.ceph.osd.3.smithi182.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:34:29.891 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: -557> 2019-11-29T20:34:29.460+0000 114ab700 -1 *** Caught signal (Segmentation fault) ** 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: in thread 114ab700 thread_name:msgr-worker-0 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:34:30.251 INFO:tasks.ceph.osd.3.smithi182.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe89561] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100abc0] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1017963] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1017be0] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101813d] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1000dc4] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 8: (AsyncConnection::process()+0x794) [0xfdb414] 2019-11-29T20:34:30.252 INFO:tasks.ceph.osd.3.smithi182.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3c905] 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: 10: (()+0xd3a317) [0xe42317] 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: 11: (()+0x12121ff) [0x131a1ff] 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: 12: (()+0x7e65) [0xc093e65] 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: 13: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:34:30.253 INFO:tasks.ceph.osd.3.smithi182.stderr: 2019-11-29T20:34:34.282 INFO:tasks.ceph.osd.3.smithi182.stderr:daemon-helper: command crashed with signal 11 2019-11-29T20:34:35.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2019-11-29T20:34:42.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2019-11-29T20:34:48.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2019-11-29T20:34:54.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~19s 2019-11-29T20:35:01.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2019-11-29T20:35:07.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~32s 2019-11-29T20:35:13.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~38s 2019-11-29T20:35:19.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~44s 2019-11-29T20:35:25.123 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:25.116+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:26.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:26.135+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:26.144 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:26.138+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:26.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~51s 2019-11-29T20:35:26.355 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:26.349+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:27.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:27.126+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:27.187 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:27.180+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:27.315 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:27.308+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:28.165 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:28.158+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:28.180 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:28.174+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:28.298 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:28.290+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:28.536 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:28.530+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:29.194 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:29.188+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:29.199 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:29.191+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:29.312 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:29.305+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:29.551 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:29.544+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:30.025 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:30.014+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:30.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:30.183+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:30.214 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:30.207+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:30.291 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:30.285+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:30.579 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:30.569+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:30.638 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:30.631+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:31.019 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:31.011+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:31.202 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:31.195+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:31.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:31.218+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:31.280 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:31.270+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:31.565 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:31.558+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:31.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:31.640+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:32.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:32.052+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:32.161 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:32.155+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:32.186 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:32.180+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:32.243 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:32.237+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:32.617 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:32.608+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:32.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~57s 2019-11-29T20:35:32.678 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:32.671+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:33.074 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:33.067+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:33.169 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:33.156+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:33.238 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:33.231+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:33.283 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:33.278+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:33.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:33.622+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:33.714 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:33.705+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:34.064 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:34.057+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:34.179 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:34.173+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:34.217 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:34.189+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:34.318 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:34.312+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:34.595 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:34.587+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:34.732 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:34.726+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:35.115 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:35.108+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:35.151 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:35.144+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:35.184 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:35.178+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:35.295 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:35.289+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:35.589 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:35.582+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:35.727 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:35.719+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:36.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:36.064+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:36.153 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:36.146+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:36.180 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:36.173+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:36.311 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:36.304+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:36.638 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:36.631+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:36.726 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:36.718+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:37.075 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:37.068+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:37.154 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:37.147+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:37.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:37.169+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:37.299 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:37.292+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:37.695 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:37.685+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:37.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:37.699+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:38.059 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:38.052+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:38.105 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:38.100+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:38.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:38.194+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:38.269 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:38.263+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:38.677 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:38.666+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:38.696 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:38.688+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:38.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~63s 2019-11-29T20:35:39.072 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:39.064+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:39.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:39.092+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:39.226 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:39.220+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:39.286 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:39.280+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:39.647 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:39.639+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:39.729 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:39.722+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:40.047 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:40.040+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:40.117 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:40.112+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:40.265 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:40.258+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:40.283 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:40.277+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:40.651 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:40.643+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:40.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:40.714+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:41.000 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:40.995+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:41.130 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:41.123+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:41.253 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:41.246+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:41.329 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:41.322+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:41.637 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:41.626+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:41.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:41.738+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:42.026 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:42.020+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:42.088 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:42.080+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:42.306 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:42.291+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:42.371 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:42.364+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:42.687 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:42.679+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:42.775 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:42.769+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:43.044 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:43.037+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:43.092 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:43.086+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:43.325 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:43.317+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:43.382 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:43.376+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:43.691 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:43.682+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:43.805 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:43.799+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:44.088 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:44.080+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:44.120 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:44.113+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:44.360 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:44.353+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:44.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:44.377+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:44.707 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:44.700+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:44.794 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:44.787+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:45.103 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:45.097+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:45.138 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:45.131+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:45.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~69s 2019-11-29T20:35:45.360 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:45.353+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:45.369 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:45.363+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:45.709 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:45.703+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:45.748 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:45.742+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:46.104 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:46.097+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:46.116 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:46.110+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:46.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:46.331+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:46.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:46.400+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:46.718 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:46.709+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:46.764 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:46.757+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:47.101 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:47.093+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:47.137 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:47.130+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:47.393 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:47.386+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:47.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:47.434+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:47.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:47.712+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:47.766 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:47.759+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:48.110 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:48.097+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:48.151 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:48.145+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:48.396 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:48.380+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:48.422 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:48.415+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:48.678 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:48.672+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:48.765 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:48.759+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:49.075 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:49.069+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:49.159 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:49.153+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:49.375 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:49.369+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:49.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:49.375+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:49.642 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:49.635+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:49.789 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:49.782+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:50.145 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:50.122+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:50.207 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:50.201+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:50.401 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:50.392+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:50.423 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:50.415+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:50.596 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:50.589+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:50.747 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:50.740+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:51.092 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:51.086+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:51.223 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:51.218+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:51.402 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:51.396+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:51.428 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:51.408+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:51.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~76s 2019-11-29T20:35:51.650 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:51.643+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:51.786 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:51.770+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:52.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:52.084+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:52.201 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:52.196+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:52.415 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:52.409+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:52.448 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:52.441+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:52.676 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:52.670+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:52.771 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:52.765+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:53.051 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:53.043+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:53.243 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:53.238+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:53.401 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:53.395+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:53.436 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:53.428+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:53.724 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:53.718+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:53.818 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:53.811+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:54.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:54.057+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:54.212 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:54.207+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:54.400 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:54.394+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:54.411 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:54.405+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:54.718 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:54.712+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:54.792 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:54.786+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:55.083 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:55.076+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:55.204 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:55.198+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:55.390 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:55.375+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:55.452 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:55.442+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:55.752 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:55.742+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:55.795 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:55.789+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:56.050 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:56.044+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:56.168 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:56.162+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:56.425 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:56.419+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:56.495 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:56.488+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:56.789 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:35:56.779+0000 1694c700 -1 osd.4 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.517057+0000 front 2019-11-29T20:34:43.060166+0000 (oldest deadline 2019-11-29T20:35:28.392946+0000) 2019-11-29T20:35:56.809 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:35:56.803+0000 1694c700 -1 osd.6 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.099916+0000 front 2019-11-29T20:34:43.971457+0000 (oldest deadline 2019-11-29T20:35:29.836965+0000) 2019-11-29T20:35:57.085 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:35:57.079+0000 1694c700 -1 osd.5 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.780860+0000 front 2019-11-29T20:34:44.226398+0000 (oldest deadline 2019-11-29T20:35:29.437496+0000) 2019-11-29T20:35:57.157 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:35:57.152+0000 1694c700 -1 osd.2 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:44.699159+0000 front 2019-11-29T20:34:44.697610+0000 (oldest deadline 2019-11-29T20:35:25.173905+0000) 2019-11-29T20:35:57.416 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:35:57.409+0000 1694c700 -1 osd.7 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:43.314770+0000 front 2019-11-29T20:34:44.872305+0000 (oldest deadline 2019-11-29T20:35:24.842644+0000) 2019-11-29T20:35:57.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:35:57.511+0000 1694c700 -1 osd.1 981 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:34:41.905198+0000 front 2019-11-29T20:34:41.566611+0000 (oldest deadline 2019-11-29T20:35:26.242662+0000) 2019-11-29T20:35:57.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~82s 2019-11-29T20:36:04.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~88s 2019-11-29T20:36:10.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2019-11-29T20:36:16.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~101s 2019-11-29T20:36:23.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~107s 2019-11-29T20:36:29.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~114s 2019-11-29T20:36:35.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2019-11-29T20:36:42.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2019-11-29T20:36:48.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~133s 2019-11-29T20:36:52.868 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:01.003 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:52.878 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:01.013 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:52.879 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:01.060 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:52.883 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:01.063 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:52.887 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:01.068 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:52.889 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:01.069 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:53.142 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:01.277 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:53.169 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:01.350 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:53.170 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:01.351 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:36:54.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2019-11-29T20:37:01.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~146s 2019-11-29T20:37:07.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~152s 2019-11-29T20:37:13.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~158s 2019-11-29T20:37:20.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~164s 2019-11-29T20:37:26.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~171s 2019-11-29T20:37:32.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~177s 2019-11-29T20:37:35.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:35.805+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:36.088 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:36.081+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:36.260 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:36.253+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:36.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:36.438+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:36.808 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:36.801+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:37.123 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:37.116+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:37.259 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:37.253+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:37.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:37.445+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:37.835 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:37.828+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:38.090 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:38.082+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:38.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:38.237+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:38.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:38.404+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:38.833 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:38.827+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:39.081 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:39.076+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:39.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~183s 2019-11-29T20:37:39.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:39.233+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:39.453 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:39.447+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:39.810 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:39.803+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:40.070 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:40.064+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:40.141 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:40.130+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:40.207 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:40.201+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:40.380 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:40.373+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:40.414 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:40.408+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:40.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:40.800+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:41.094 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:41.085+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:41.105 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:41.097+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:41.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:41.166+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:41.394 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:41.388+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:41.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:41.419+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:41.847 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:41.833+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:42.111 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:42.105+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:42.113 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:42.106+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:42.173 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:42.157+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:42.373 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:42.361+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:42.457 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:42.451+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:42.824 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:42.818+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:43.104 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:43.097+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:43.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:43.104+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:43.143 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:51.279 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.194 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:51.329 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.200 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:43.195+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:43.221 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:51.402 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.223 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:51.404 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.255 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:51.435 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.257 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:51.438 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.307 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:21:51.488 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.309 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:21:51.490 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.354 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:43.348+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:43.383 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:21:51.518 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:37:43.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:43.438+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:43.799 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:43.795+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:44.070 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:44.065+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:44.112 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:44.105+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:44.245 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:44.239+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:44.361 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:44.356+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:44.493 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:44.488+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:44.760 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:44.755+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:45.078 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:45.073+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:45.156 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:45.149+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:45.239 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:45.233+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:45.356 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:45.349+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:45.511 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:45.505+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:45.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2019-11-29T20:37:45.716 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:45.708+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:46.081 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:46.074+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:46.181 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:46.175+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:46.292 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:46.286+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:46.334 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:46.328+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:46.496 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:46.490+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:46.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:46.665+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:47.065 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:47.058+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:47.220 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:47.213+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:47.332 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:47.325+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:47.348 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:47.341+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:47.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:47.479+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:47.675 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:47.667+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:48.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:48.058+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:48.256 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:48.248+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:48.308 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:48.299+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:48.354 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:48.347+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:48.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:48.439+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:48.697 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:48.692+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:49.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:49.043+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:49.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:49.251+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:49.316 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:49.308+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:49.334 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:49.327+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:49.419 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:49.405+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:49.671 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:49.665+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:50.008 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:50.001+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:50.289 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:50.281+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:50.337 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:50.329+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:50.388 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:50.381+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:50.400 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:50.392+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:50.689 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:50.683+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:51.008 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:51.002+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:51.284 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:51.277+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:51.381 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:51.374+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:51.382 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:51.375+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:51.445 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:51.436+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:51.703 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:51.697+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:51.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~196s 2019-11-29T20:37:52.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:52.034+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:52.295 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:52.288+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:52.363 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:52.356+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:52.372 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:52.365+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:52.448 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:52.441+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:52.681 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:52.674+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:53.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:53.011+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:53.257 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:53.247+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:53.356 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:53.348+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:53.357 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:53.351+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:53.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:53.456+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:53.674 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:53.655+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:54.059 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:54.049+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:54.273 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:54.265+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:54.347 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:54.340+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:54.367 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:54.360+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:54.487 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:54.479+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:54.652 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:54.646+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:55.057 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:55.050+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:55.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:55.291+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:55.352 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:55.343+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:55.423 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:55.412+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:55.465 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:55.456+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:55.694 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:55.686+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:56.008 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:56.003+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:56.338 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:56.327+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:56.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:56.379+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:56.391 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:56.382+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:56.502 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:56.495+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:56.709 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:56.703+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:57.022 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:57.016+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:57.296 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:57.289+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:57.359 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:57.353+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:57.365 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:57.359+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:57.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:57.456+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:57.706 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:57.699+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:58.024 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:58.017+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:58.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2019-11-29T20:37:58.323 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:58.318+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:58.327 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:58.320+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:58.385 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:58.380+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:58.480 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:58.473+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:58.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:58.708+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:37:59.043 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:59.037+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:37:59.288 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:37:59.281+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:37:59.350 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:37:59.345+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:37:59.380 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:37:59.374+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:37:59.499 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:37:59.489+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:37:59.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:37:59.686+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:00.005 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:37:59.999+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:00.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:00.257+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:00.315 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:00.310+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:00.427 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:00.421+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:00.492 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:00.486+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:00.738 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:00.732+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:01.045 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:01.038+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:01.245 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:01.238+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:01.273 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:01.267+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:01.436 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:01.425+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:01.486 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:01.479+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:01.773 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:01.765+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:02.061 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:02.053+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:02.249 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:02.243+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:02.278 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:02.272+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:02.465 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:02.458+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:02.473 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:02.468+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:02.785 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:02.779+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:03.068 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:03.061+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:03.223 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:03.217+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:03.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:03.293+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:03.471 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:03.464+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:03.471 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:03.464+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:03.784 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:03.777+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:04.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:04.105+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:04.254 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:04.248+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:04.288 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:04.280+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:04.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~209s 2019-11-29T20:38:04.466 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:04.460+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:04.471 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:04.465+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:04.778 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:04.771+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:05.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:05.142+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:05.246 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:05.241+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:05.294 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:05.287+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:05.485 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:05.470+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:05.486 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:05.479+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:05.753 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:05.746+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:06.135 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:06.128+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:06.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:06.256+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:06.313 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:06.300+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:06.448 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:06.442+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:06.494 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:06.488+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:06.786 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:06.779+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:07.112 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:07.106+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:07.218 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:07.212+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:07.355 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:07.349+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:07.437 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:38:07.431+0000 1694c700 -1 osd.4 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:49.906814+0000 front 2019-11-29T20:36:50.009940+0000 (oldest deadline 2019-11-29T20:37:35.707226+0000) 2019-11-29T20:38:07.476 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:38:07.469+0000 1694c700 -1 osd.6 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.351383+0000 front 2019-11-29T20:36:50.512608+0000 (oldest deadline 2019-11-29T20:37:35.463658+0000) 2019-11-29T20:38:07.772 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:38:07.765+0000 1694c700 -1 osd.2 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:52.335147+0000 front 2019-11-29T20:36:52.300562+0000 (oldest deadline 2019-11-29T20:37:35.646845+0000) 2019-11-29T20:38:08.105 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:38:08.098+0000 1694c700 -1 osd.1 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.431543+0000 front 2019-11-29T20:36:54.413893+0000 (oldest deadline 2019-11-29T20:37:39.695459+0000) 2019-11-29T20:38:08.187 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:38:08.180+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e987 v987) 2019-11-29T20:38:08.223 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:38:08.218+0000 1694c700 -1 osd.7 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:54.891509+0000 front 2019-11-29T20:36:54.911410+0000 (oldest deadline 2019-11-29T20:37:39.551589+0000) 2019-11-29T20:38:08.391 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:38:08.379+0000 1694c700 -1 osd.5 987 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:36:50.758858+0000 front 2019-11-29T20:36:51.075120+0000 (oldest deadline 2019-11-29T20:37:35.777085+0000) 2019-11-29T20:38:10.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2019-11-29T20:38:17.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~221s 2019-11-29T20:38:23.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~228s 2019-11-29T20:38:29.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~234s 2019-11-29T20:38:36.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2019-11-29T20:38:42.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~247s 2019-11-29T20:38:48.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~253s 2019-11-29T20:38:55.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~259s 2019-11-29T20:38:57.243 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:38:57.137+0000 114ab700 -1 osd.0 993 build_incremental_map_msg missing incremental map 993 2019-11-29T20:39:01.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~266s 2019-11-29T20:39:07.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~272s 2019-11-29T20:39:13.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2019-11-29T20:39:20.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2019-11-29T20:39:26.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~291s 2019-11-29T20:39:32.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~297s 2019-11-29T20:39:39.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~303s 2019-11-29T20:39:39.251 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-11-29T20:39:39.251 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-master/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-11-29T20:39:51.382 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:51.376+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:51.680 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:51.671+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:51.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:51.976+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:52.412 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:52.407+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:52.687 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:52.680+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:52.941 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:52.933+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:53.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:53.440+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:53.660 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:53.655+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:53.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:53.898+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:53.925 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:53.920+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:54.421 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:54.415+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:54.616 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:54.610+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:54.889 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:54.883+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:54.977 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:54.971+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:55.363 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:39:55.356+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:39:55.393 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:55.387+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:55.644 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:55.638+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:55.905 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:55.899+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:55.939 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:55.933+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:56.125 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:39:56.119+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:39:56.332 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:39:56.324+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:39:56.387 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:56.381+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:56.649 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:56.643+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:56.888 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:56.882+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:56.981 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:56.974+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:57.122 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:39:57.117+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:39:57.380 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:39:57.374+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:39:57.407 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:57.401+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:57.688 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:57.681+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:57.854 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:57.847+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:58.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:58.004+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:58.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:39:58.154+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:39:58.376 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:58.370+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:58.403 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:39:58.398+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:39:58.721 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:58.715+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:58.831 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:58.826+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:39:59.037 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:39:59.030+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:39:59.131 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:39:59.126+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:39:59.365 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:39:59.360+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:39:59.399 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:39:59.393+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:39:59.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:39:59.718+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:39:59.859 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:39:59.850+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:00.038 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:00.032+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:00.115 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:00.110+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:00.418 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:00.412+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:00.445 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:00.438+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:00.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:00.725+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:00.817 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:00.811+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:01.011 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:01.005+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:01.123 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:01.117+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:01.392 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:01.386+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:01.457 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:01.448+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:01.693 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:01.687+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:01.779 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:01.773+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:02.010 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:02.003+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:02.101 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:02.094+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:02.351 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:02.347+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:02.496 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:02.489+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:02.675 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:02.668+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:02.788 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:02.780+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:02.983 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:02.971+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:03.107 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:03.101+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:03.389 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:03.384+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:03.531 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:03.525+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:03.715 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:03.709+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:03.777 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:03.771+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:04.021 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:04.014+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:04.068 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:04.061+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:04.362 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:04.356+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:04.539 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:04.533+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:04.681 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:04.675+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:04.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:04.814+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:05.044 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:05.036+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:05.054 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:05.047+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:05.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:05.407+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:05.558 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:05.552+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:05.675 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:05.668+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:05.842 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:05.834+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:06.088 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:06.080+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:06.091 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:06.083+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:06.407 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:06.401+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:06.523 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:06.517+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:06.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:06.637+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:06.823 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:06.816+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:07.089 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:07.079+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:07.089 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:07.081+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:07.433 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:07.428+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:07.528 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:07.522+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:07.637 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:07.630+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:07.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:07.784+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:08.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:08.037+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:08.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:08.134+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:08.461 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:08.456+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:08.520 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:08.515+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:08.611 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:08.604+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:08.800 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:08.793+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:09.051 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:09.043+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:09.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:09.150+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:09.423 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:09.412+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:09.511 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:09.504+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:09.661 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:09.654+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:09.791 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:09.784+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:10.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:10.009+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:10.145 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:10.129+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:10.432 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:10.426+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:10.488 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:10.478+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:10.671 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:10.663+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:10.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:10.754+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:11.017 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:11.010+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:11.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:11.155+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:11.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:11.406+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:11.526 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:11.518+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:11.626 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:11.618+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:11.770 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:11.762+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:12.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:12.057+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:12.154 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:12.147+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:12.453 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:12.447+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:12.486 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:12.480+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:12.595 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:12.588+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:12.746 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:12.738+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:13.086 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:13.079+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:13.182 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:13.175+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:13.440 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:13.434+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:13.470 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:13.464+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:13.636 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:13.629+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:13.750 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:13.743+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:14.061 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:14.055+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:14.170 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:14.164+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:14.410 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:14.404+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:14.493 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:14.487+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:14.654 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:14.647+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:14.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:14.752+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:15.064 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:15.058+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:15.147 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:15.132+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:15.388 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:15.382+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:15.465 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:15.459+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:15.700 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:15.694+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:15.733 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:15.723+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:16.113 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:16.106+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:16.133 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:16.126+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:16.418 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:16.412+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:16.423 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:16.417+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:16.677 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:16.670+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:16.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:16.710+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:17.102 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:17.096+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:17.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:17.156+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:17.405 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:17.399+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:17.418 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:17.413+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:17.704 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:17.698+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:17.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:17.702+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:18.081 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:18.075+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:18.165 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:18.159+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:18.412 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:18.406+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:18.444 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:18.438+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:18.727 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:18.719+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:18.735 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:18.730+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:19.084 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:19.078+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:19.164 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:19.158+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:19.450 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:19.443+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:19.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:19.473+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:19.727 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:19.721+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:19.730 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:19.724+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:20.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:20.125+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:20.187 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:20.181+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:20.405 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:20.399+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:20.516 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:20.509+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:20.723 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:20.717+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:20.735 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:20.728+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:21.150 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:21.144+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:21.180 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:21.174+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:21.370 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:21.365+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:21.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:21.479+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:21.719 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:21.713+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:21.767 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:21.760+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:22.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:22.117+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:22.159 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:22.153+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:22.375 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:22.371+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:22.517 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:22.511+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:22.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:22.762+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:22.803 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:22.792+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:23.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:23.133+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:23.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:23.175+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:23.367 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:23.359+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:23.485 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:23.479+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:23.754 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:40:23.750+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e993 v993) 2019-11-29T20:40:23.758 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:23.752+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:23.828 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:23.821+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:24.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:24.136+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:24.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:24.153+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:24.350 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:24.344+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:24.481 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:24.476+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:24.774 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:24.767+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:24.807 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:24.801+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:25.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:25.095+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:25.166 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:25.160+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:25.383 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:25.377+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:25.527 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:25.521+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:25.756 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:25.749+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:25.796 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:25.790+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:26.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:26.065+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:26.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:26.187+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:26.348 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:26.342+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:26.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:26.564+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:26.717 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:26.711+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:26.831 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:26.825+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:27.065 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:27.057+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:27.184 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:27.179+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:27.338 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:27.332+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:27.570 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:27.564+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:27.760 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:27.754+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:27.789 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:27.783+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:28.032 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:28.026+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:40:28.158 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:40:28.152+0000 1694c700 -1 osd.6 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.486423+0000 front 2019-11-29T20:39:10.285436+0000 (oldest deadline 2019-11-29T20:39:55.525204+0000) 2019-11-29T20:40:28.364 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:40:28.358+0000 1694c700 -1 osd.2 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:11.298987+0000 front 2019-11-29T20:39:11.298182+0000 (oldest deadline 2019-11-29T20:39:55.028173+0000) 2019-11-29T20:40:28.587 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:40:28.580+0000 1694c700 -1 osd.1 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.554206+0000 front 2019-11-29T20:39:07.656081+0000 (oldest deadline 2019-11-29T20:39:50.546319+0000) 2019-11-29T20:40:28.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:40:28.760+0000 1694c700 -1 osd.4 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:10.495847+0000 front 2019-11-29T20:39:10.221173+0000 (oldest deadline 2019-11-29T20:39:52.957272+0000) 2019-11-29T20:40:28.839 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:40:28.834+0000 1694c700 -1 osd.5 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:08.375951+0000 front 2019-11-29T20:39:08.373956+0000 (oldest deadline 2019-11-29T20:39:50.621495+0000) 2019-11-29T20:40:28.843 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:40:28.834+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 44sec e993 v993) 2019-11-29T20:40:29.036 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:40:29.030+0000 1694c700 -1 osd.7 993 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:39:07.603016+0000 front 2019-11-29T20:39:07.604361+0000 (oldest deadline 2019-11-29T20:39:51.663689+0000) 2019-11-29T20:41:08.509 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:41:08.502+0000 34f8a700 -1 osd.0 995 build_incremental_map_msg missing incremental map 993 2019-11-29T20:41:10.361 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:25:18.495 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.366 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:25:18.502 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.378 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:25:18.559 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.385 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:25:18.563 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.386 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:25:18.563 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.387 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:25:18.568 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.630 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:25:18.766 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.645 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:25:18.822 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:41:10.664 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:25:18.842 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:08.216 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:08.209+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:09.179 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:09.172+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:09.225 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:09.219+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:09.569 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:09.563+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:09.773 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:09.767+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:10.133 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:10.127+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:10.206 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:10.199+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:10.257 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:10.251+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:10.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:10.529+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:10.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:10.736+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:11.174 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:11.167+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:11.195 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:11.188+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:11.273 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:11.268+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:11.514 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:11.507+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:11.739 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:11.734+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:12.188 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:12.182+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:12.200 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:12.194+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:12.259 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:12.254+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:12.409 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:12.403+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:12.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:12.471+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:12.732 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:12.726+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:13.191 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:13.184+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:13.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:13.219+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:13.262 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:13.255+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:13.459 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:13.453+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:13.461 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:13.455+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:13.784 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:13.778+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:14.170 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:14.165+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:14.258 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:14.252+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:14.277 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:14.270+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:14.424 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:14.418+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:14.497 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:14.491+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:14.749 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:14.743+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:15.142 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:15.136+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:15.280 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:15.274+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:15.330 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:15.325+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:15.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:15.392+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:15.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:15.470+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:15.741 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:15.735+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:16.178 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:16.166+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:16.319 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:16.313+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:16.368 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:16.359+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:16.420 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:16.414+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:16.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:16.451+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:16.787 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:16.780+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:17.202 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:17.196+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:17.362 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:17.356+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:17.371 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:17.365+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:17.445 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:17.438+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:17.509 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:17.503+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:17.829 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:17.822+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:18.231 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:18.226+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:18.329 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:18.324+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:18.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:18.327+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:18.397 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:18.392+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:18.523 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:18.518+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:18.802 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:18.797+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:19.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:19.231+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:19.294 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:19.287+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:19.354 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:19.349+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:19.436 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:19.430+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:19.535 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:19.530+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:19.758 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:19.752+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:20.227 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:20.207+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:20.301 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:20.296+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:20.344 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:20.337+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:20.458 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:20.450+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:20.571 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:20.564+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:20.725 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:20.719+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:21.242 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:21.236+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:21.260 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:21.253+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:21.315 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:21.310+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:21.452 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:21.446+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:21.618 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:21.611+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:21.685 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:21.678+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:22.259 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:22.253+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:22.312 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:22.305+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:22.364 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:22.358+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:22.425 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:22.419+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:22.647 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:22.640+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:22.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:22.656+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:23.260 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:23.253+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:23.311 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:23.304+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:23.393 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:23.386+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:23.406 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:23.399+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:23.661 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:23.654+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:23.690 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:23.684+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:24.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:24.224+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:24.310 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:24.303+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:24.372 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:24.364+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:24.379 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:24.373+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:24.634 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:24.627+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:24.680 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:24.673+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:25.247 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:25.240+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:25.283 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:25.276+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:25.350 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:25.342+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:25.386 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:25.377+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:25.637 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:25.624+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:25.645 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:25.638+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:26.207 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:26.200+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:26.322 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:26.316+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:26.374 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:26.367+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:26.433 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:26.426+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:26.672 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:26.664+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:26.679 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:26.672+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:27.263 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:27.254+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:27.288 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:27.282+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:27.426 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:27.419+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:27.432 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:27.425+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:27.632 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:27.627+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:27.690 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:27.682+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:28.232 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:28.225+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:28.331 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:28.326+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:28.401 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:28.394+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:28.484 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:28.477+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:28.662 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:28.656+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:28.716 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:28.710+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:29.201 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:29.194+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:29.291 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:29.284+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:29.410 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:29.403+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:29.518 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:29.511+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:29.663 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:29.620+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:29.677 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:29.670+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:30.240 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:30.232+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:30.244 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:30.238+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:30.383 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:30.376+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:30.503 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:30.495+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:30.643 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:30.637+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:30.728 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:30.721+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:31.235 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:31.230+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:31.239 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:31.233+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:31.392 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:31.384+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:31.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:31.494+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:31.697 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:31.681+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:31.709 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:31.695+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:32.214 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:32.208+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:32.220 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:32.214+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:32.434 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:32.427+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:32.509 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:32.500+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:32.679 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:32.672+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:32.691 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:32.685+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:33.177 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:33.170+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:33.232 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:33.226+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:33.415 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:33.408+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:33.487 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:33.481+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:33.712 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:33.706+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:33.742 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:33.736+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:34.140 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:34.130+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:34.195 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:34.190+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:34.456 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:34.449+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:34.501 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:34.492+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:34.752 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:34.746+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:34.789 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:34.784+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:35.103 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:35.093+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:35.171 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:35.165+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:35.408 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:35.403+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:35.476 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:35.470+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:35.736 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:35.730+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:35.779 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:35.772+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:36.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:36.065+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:36.193 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:36.188+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:36.400 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:36.394+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:36.472 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:36.463+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:36.761 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:36.756+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:36.792 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:36.785+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:37.072 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:37.065+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:37.209 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:37.203+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:37.397 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:37.391+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:37.494 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:37.489+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:37.770 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:37.764+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:37.844 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:37.838+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:38.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:38.056+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:38.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:38.199+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:38.417 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:38.411+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:38.494 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:38.487+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:38.731 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:38.725+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:38.855 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:38.848+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:39.063 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:39.057+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:39.176 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:39.170+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:39.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:39.445+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:39.531 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:39.526+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:39.696 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:39.689+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:39.814 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:39.808+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:40.048 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:40.042+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:40.205 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:40.198+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:40.438 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:40.432+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:40.508 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:40.500+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:40.664 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:40.658+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:40.797 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:40.788+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:41.100 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:41.094+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:41.167 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:41.162+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:41.446 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:41.439+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:41.560 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:41.554+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:41.713 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:41.706+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:41.766 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:41.759+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:42.127 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:42.120+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:42.177 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:42.164+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:42.431 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:42.420+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:42.544 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:42.536+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:42.743 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:42.732+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:42.768 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:42.761+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:43.128 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:43.122+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:43.214 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:43.207+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:43.452 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:43.445+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:43.577 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:43.572+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:43.765 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:42:43.759+0000 1694c700 -1 osd.1 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:24.105297+0000 front 2019-11-29T20:41:24.106097+0000 (oldest deadline 2019-11-29T20:42:09.259525+0000) 2019-11-29T20:42:43.795 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:43.790+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:44.099 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:42:44.092+0000 1694c700 -1 osd.7 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:27.961684+0000 front 2019-11-29T20:41:27.979434+0000 (oldest deadline 2019-11-29T20:42:09.577366+0000) 2019-11-29T20:42:44.218 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:44.213+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:44.432 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:42:44.426+0000 1694c700 -1 osd.6 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:23.700064+0000 front 2019-11-29T20:41:24.084097+0000 (oldest deadline 2019-11-29T20:42:08.990281+0000) 2019-11-29T20:42:44.465 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:42:44.461+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 42sec e998 v998) 2019-11-29T20:42:44.588 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:42:44.581+0000 1694c700 -1 osd.5 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.746933+0000 front 2019-11-29T20:41:26.349315+0000 (oldest deadline 2019-11-29T20:42:11.522064+0000) 2019-11-29T20:42:44.767 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:42:44.761+0000 1694c700 -1 osd.4 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:26.760940+0000 front 2019-11-29T20:41:26.793210+0000 (oldest deadline 2019-11-29T20:42:09.432005+0000) 2019-11-29T20:42:45.245 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:45.239+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:46.248 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:42:46.242+0000 1694c700 -1 osd.2 998 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:41:25.003383+0000 front 2019-11-29T20:41:24.957404+0000 (oldest deadline 2019-11-29T20:42:08.192658+0000) 2019-11-29T20:42:49.792 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:26:57.928 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.843 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:26:57.979 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.872 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:26:58.053 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.874 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:26:58.055 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.933 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:26:58.114 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.943 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:26:58.123 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:49.985 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:26:58.120 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:50.010 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:26:58.191 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:42:50.082 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:26:58.263 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:28.947 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:28.940+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:29.487 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:29.481+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:29.898 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:29.891+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:29.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:29.894+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:30.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:30.476+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:30.881 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:30.859+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:30.881 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:30.860+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:31.259 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:31.253+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:31.466 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:31.460+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:31.585 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:31.578+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:31.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:31.854+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:31.871 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:31.865+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:31.990 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:31.983+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:32.236 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:32.229+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:32.476 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:32.471+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:32.589 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:32.581+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:32.849 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:32.843+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:32.921 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:32.914+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:32.972 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:32.966+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:33.226 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:33.219+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:33.496 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:33.490+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:33.570 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:33.564+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:33.874 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:33.868+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:33.965 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:33.960+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:33.970 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:33.964+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:34.222 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:34.216+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:34.485 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:34.478+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:34.574 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:34.568+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:34.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:34.857+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:34.991 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:34.984+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:35.018 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:35.012+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:35.271 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:35.265+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:35.448 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:35.444+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:35.489 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:28:43.625 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.529 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:28:43.665 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.573 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:28:43.754 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.577 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:28:43.758 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.609 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:28:43.790 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.612 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:28:43.793 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.617 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:35.612+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:35.654 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:28:43.790 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.700 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:28:43.881 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.759 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:28:43.938 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:44:35.835 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:35.829+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:35.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:35.950+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:36.037 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:36.031+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:36.266 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:36.257+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:36.484 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:36.477+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:36.634 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:36.627+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:36.831 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:36.824+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:36.969 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:36.961+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:37.062 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:37.057+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:37.254 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:37.248+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:37.480 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:37.475+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:37.611 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:37.604+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:37.836 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:37.830+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:38.002 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:37.997+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:38.021 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:38.016+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:38.212 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:38.206+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:38.468 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:38.462+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:38.590 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:38.585+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:38.848 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:38.842+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:38.975 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:38.969+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:39.020 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:39.013+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:39.223 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:39.217+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:39.433 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:39.424+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:39.624 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:39.618+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:39.901 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:39.895+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:39.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:39.946+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:40.006 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:40.000+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:40.263 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:40.257+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:40.433 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:40.428+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:40.607 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:40.601+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:40.878 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:40.869+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:40.955 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:40.948+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:41.040 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:41.033+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:41.238 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:41.231+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:41.440 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:41.434+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:41.601 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:41.593+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:41.864 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:41.856+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:41.967 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:41.962+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:42.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:42.012+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:42.218 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:42.211+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:42.483 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:42.477+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:42.639 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:42.632+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:42.902 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:42.895+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:42.984 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:42.978+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:43.058 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:43.053+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:43.224 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:43.215+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:43.517 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:43.510+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:43.623 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:43.616+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:43.880 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:43.874+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:43.952 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:43.945+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:44.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:44.050+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:44.211 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:44.204+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:44.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:44.536+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:44.645 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:44.636+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:44.860 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:44.851+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:44.917 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:44.910+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:45.103 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:45.097+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:45.173 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:45.166+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:45.558 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:45.550+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:45.691 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:45.684+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:45.858 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:45.847+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:45.914 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:45.906+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:46.110 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:46.105+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:46.209 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:46.198+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:46.522 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:46.514+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:46.718 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:46.712+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:46.838 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:46.831+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:46.869 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:46.863+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:47.069 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:47.063+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:47.195 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:47.187+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:47.540 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:47.534+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:47.711 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:47.705+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:47.822 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:47.817+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:47.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:47.876+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:48.066 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:48.050+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:48.194 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:48.187+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:48.590 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:48.583+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:48.746 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:48.740+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:48.851 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:48.844+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:48.899 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:48.887+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:49.075 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:49.070+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:49.175 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:49.168+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:49.547 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:49.540+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:49.729 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:49.721+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:49.865 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:49.858+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:49.894 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:49.888+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:50.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:50.054+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:50.145 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:50.134+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:50.554 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:50.548+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:50.724 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:50.717+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:50.863 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:50.858+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:50.921 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:50.912+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:51.108 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:51.102+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:51.125 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:51.119+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:51.610 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:51.603+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:51.698 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:51.692+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:51.862 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:51.856+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:51.883 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:51.876+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:52.073 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:52.067+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:52.165 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:52.159+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:52.579 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:52.574+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:52.663 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:52.659+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:52.898 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:52.891+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:52.900 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:52.893+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:53.060 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:53.053+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:53.197 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:53.191+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:53.577 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:53.570+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:53.712 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:53.702+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:53.885 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:53.880+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:53.944 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:53.938+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:54.034 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:54.028+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:54.249 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:54.243+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:54.564 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:54.559+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:54.708 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:54.701+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:54.845 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:54.839+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:54.908 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:54.903+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:55.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:55.013+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:55.279 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:55.273+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:55.595 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:55.590+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:55.723 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:55.717+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:55.859 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:55.852+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:55.934 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:55.928+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:56.019 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:56.013+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:56.265 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:56.258+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:56.599 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:56.594+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:56.731 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:56.724+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:56.892 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:56.886+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:56.904 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:56.899+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:57.000 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:56.994+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:57.240 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:57.234+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:57.576 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:57.570+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:57.726 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:57.721+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:57.917 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:57.911+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:57.942 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:57.936+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:57.967 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:57.959+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:58.297 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:58.284+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:58.553 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:58.547+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:58.748 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:58.741+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:58.907 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:58.901+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:58.961 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:58.951+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:44:59.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:44:59.010+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:44:59.301 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:44:59.295+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:44:59.537 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:44:59.532+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:44:59.772 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:44:59.766+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:44:59.927 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:44:59.921+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:44:59.954 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:44:59.946+0000 1694c700 -1 osd.6 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:00.007 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:00.000+0000 1694c700 -1 osd.1 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:00.321 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:00.315+0000 1694c700 -1 osd.4 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:00.549 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:00.543+0000 1694c700 -1 osd.7 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:00.790 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:00.786+0000 1694c700 -1 osd.5 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:00.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:00.882+0000 1694c700 -1 osd.2 1005 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:00.992 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:00.969+0000 1694c700 -1 osd.6 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:01.053 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:01.014+0000 1694c700 -1 osd.1 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:01.331 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:01.325+0000 1694c700 -1 osd.4 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:01.591 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:01.585+0000 1694c700 -1 osd.7 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:01.833 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:01.828+0000 1694c700 -1 osd.5 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:01.858 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:01.853+0000 1694c700 -1 osd.2 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:02.086 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:02.081+0000 1694c700 -1 osd.6 1006 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:02.185 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:02.157+0000 1694c700 -1 osd.1 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:02.657 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:02.565+0000 1694c700 -1 osd.4 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:02.669 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:02.632+0000 1694c700 -1 osd.7 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:02.843 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:02.838+0000 1694c700 -1 osd.5 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:02.886 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:02.880+0000 1694c700 -1 osd.2 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:03.154 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:03.148+0000 1694c700 -1 osd.1 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:03.156 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:03.127+0000 1694c700 -1 osd.6 1007 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:03.725 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:03.684+0000 1694c700 -1 osd.4 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:03.822 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:03.812+0000 1694c700 -1 osd.5 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:03.824 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:03.795+0000 1694c700 -1 osd.7 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:03.899 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:03.882+0000 1694c700 -1 osd.2 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:04.148 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:04.143+0000 1694c700 -1 osd.1 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:04.211 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:04.165+0000 1694c700 -1 osd.6 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:04.769 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:04.764+0000 1694c700 -1 osd.4 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:04.813 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:04.809+0000 1694c700 -1 osd.5 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:05.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:04.964+0000 1694c700 -1 osd.7 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:05.159 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:05.062+0000 1694c700 -1 osd.2 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:05.201 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:05.169+0000 1694c700 -1 osd.1 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:05.231 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:05.158+0000 1694c700 -1 osd.6 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:05.583 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:45:05.577+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e1005 v1005) 2019-11-29T20:45:05.821 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:05.727+0000 1694c700 -1 osd.4 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:05.858 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:05.853+0000 1694c700 -1 osd.5 1008 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:06.079 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:06.068+0000 1694c700 -1 osd.7 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:06.098 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:06.092+0000 1694c700 -1 osd.2 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:06.201 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:06.194+0000 1694c700 -1 osd.1 1009 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:06.217 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:06.212+0000 1694c700 -1 osd.6 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:06.761 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:06.756+0000 1694c700 -1 osd.4 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:06.982 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:06.923+0000 1694c700 -1 osd.5 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:07.125 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:07.088+0000 1694c700 -1 osd.7 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:07.132 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:07.127+0000 1694c700 -1 osd.2 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:07.198 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:07.194+0000 1694c700 -1 osd.6 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:07.209 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:07.190+0000 1694c700 -1 osd.1 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:07.762 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:07.757+0000 1694c700 -1 osd.4 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:08.008 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:08.003+0000 1694c700 -1 osd.5 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:08.123 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:08.118+0000 1694c700 -1 osd.7 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:08.161 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:08.156+0000 1694c700 -1 osd.6 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:08.179 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:08.174+0000 1694c700 -1 osd.2 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:08.230 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:08.223+0000 1694c700 -1 osd.1 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:08.808 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:08.802+0000 1694c700 -1 osd.4 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:09.098 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:09.021+0000 1694c700 -1 osd.5 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:09.145 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:09.137+0000 1694c700 -1 osd.2 1010 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:09.145 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:09.130+0000 1694c700 -1 osd.7 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:09.163 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:09.157+0000 1694c700 -1 osd.6 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:09.279 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:09.236+0000 1694c700 -1 osd.1 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:09.838 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:45:09.803+0000 1694c700 -1 osd.4 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:47.805887+0000 front 2019-11-29T20:43:47.807911+0000 (oldest deadline 2019-11-29T20:44:30.800136+0000) 2019-11-29T20:45:10.149 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:10.141+0000 1694c700 -1 osd.7 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.843962+0000 front 2019-11-29T20:43:46.845541+0000 (oldest deadline 2019-11-29T20:44:29.393042+0000) 2019-11-29T20:45:10.168 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:45:10.161+0000 1694c700 -1 osd.2 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:49.137030+0000 front 2019-11-29T20:43:48.670155+0000 (oldest deadline 2019-11-29T20:44:28.714316+0000) 2019-11-29T20:45:10.169 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:10.157+0000 1694c700 -1 osd.5 1011 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:10.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:45:10.205+0000 1694c700 -1 osd.6 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:43.460240+0000 front 2019-11-29T20:43:43.191689+0000 (oldest deadline 2019-11-29T20:44:29.049680+0000) 2019-11-29T20:45:10.339 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:45:10.318+0000 1694c700 -1 osd.1 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.290418+0000 front 2019-11-29T20:43:46.113305+0000 (oldest deadline 2019-11-29T20:44:31.942672+0000) 2019-11-29T20:45:10.626 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:45:10.622+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 47sec e1005 v1005) 2019-11-29T20:45:11.212 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:45:11.208+0000 1694c700 -1 osd.5 1012 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:43:46.278130+0000 front 2019-11-29T20:43:46.276729+0000 (oldest deadline 2019-11-29T20:44:31.570047+0000) 2019-11-29T20:45:15.237 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:29:23.373 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.249 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:29:23.384 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.252 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:29:23.434 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.259 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:29:23.440 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.259 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:29:23.441 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.267 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:29:23.448 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.335 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:29:23.516 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.340 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:29:23.472 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:15.372 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:29:23.553 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:45:23.683 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T20:45:23.581+0000 20e22700 -1 RGWWatcher::handle_error cookie 821331152 err (110) Connection timed out 2019-11-29T20:45:43.509 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:43.503+0000 1694c700 -1 osd.7 1030 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:44.571 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:44.541+0000 1694c700 -1 osd.7 1032 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:45.524 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:45.520+0000 1694c700 -1 osd.7 1032 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:46.592 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:46.587+0000 1694c700 -1 osd.7 1032 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:47.582 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:47.577+0000 1694c700 -1 osd.7 1034 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:48.578 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:48.574+0000 1694c700 -1 osd.7 1034 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:49.139 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:45:49.079+0000 2184f700 -1 reset not still connected to 0x397f4850 2019-11-29T20:45:49.140 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:45:49.079+0000 2184f700 -1 reset not still connected to 0x3a152e00 2019-11-29T20:45:49.626 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:49.621+0000 1694c700 -1 osd.7 1035 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:50.601 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:50.598+0000 1694c700 -1 osd.7 1035 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:51.566 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:51.560+0000 1694c700 -1 osd.7 1036 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:52.568 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:52.563+0000 1694c700 -1 osd.7 1036 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:53.534 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:53.530+0000 1694c700 -1 osd.7 1036 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:54.490 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:54.485+0000 1694c700 -1 osd.7 1036 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:55.987 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:55.952+0000 1694c700 -1 osd.7 1037 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:56.987 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:56.983+0000 1694c700 -1 osd.7 1038 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:58.018 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:58.014+0000 1694c700 -1 osd.7 1039 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:45:59.243 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:45:59.052+0000 1694c700 -1 osd.7 1040 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:00.068 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:00.064+0000 1694c700 -1 osd.7 1041 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:01.289 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:01.264+0000 1694c700 -1 osd.7 1042 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:02.409 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:02.341+0000 1694c700 -1 osd.7 1044 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:03.305 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:03.301+0000 1694c700 -1 osd.7 1044 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:04.324 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:04.314+0000 1694c700 -1 osd.7 1045 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:05.299 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:05.286+0000 1694c700 -1 osd.7 1046 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:06.014 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:30:14.150 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.024 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:30:14.160 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.041 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:30:14.222 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.055 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:30:14.236 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.070 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:30:14.251 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.081 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:30:14.260 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.141 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:30:14.277 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.180 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:30:14.361 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.206 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:30:14.387 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:46:06.276 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:06.272+0000 1694c700 -1 osd.7 1046 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:46:07.395 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:46:07.298+0000 1694c700 -1 osd.7 1046 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4358.0:128025 7.f 7.a7cf233f (undecoded) ondisk+retry+read+known_if_redirected e1014) 2019-11-29T20:47:04.107 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:04.096+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:04.466 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:04.459+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:04.827 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:04.820+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:04.881 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:04.875+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:05.141 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:05.134+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:05.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:05.453+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:05.840 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:05.833+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:05.842 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:05.837+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:06.181 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:06.174+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:06.461 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:06.454+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:06.832 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:06.826+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:06.892 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:06.884+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:07.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:07.042+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:07.221 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:07.212+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:07.465 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:07.457+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:07.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:07.664+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:07.862 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:07.855+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:07.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:07.867+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:08.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:08.062+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:08.210 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:08.201+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:08.485 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:08.477+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:08.661 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:08.649+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:08.891 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:08.885+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:08.910 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:08.899+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:09.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:09.044+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:09.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:09.244+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:09.475 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:09.467+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:09.655 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:09.628+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:09.865 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:09.859+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:09.957 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:09.950+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:10.053 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:10.033+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:10.245 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:10.238+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:10.443 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:10.436+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:10.653 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:10.647+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:10.837 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:10.827+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:11.005 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:10.994+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:11.012 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:11.006+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:11.234 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:11.227+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:11.476 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:11.468+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:11.691 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:11.685+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:11.861 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:11.850+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:12.013 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:12.004+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:12.032 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:12.025+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:12.193 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:12.185+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:12.481 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:12.474+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:12.656 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:12.649+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:12.892 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:12.883+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:13.049 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:13.043+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:13.053 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:13.046+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:13.239 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:13.232+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:13.473 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:13.466+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:13.673 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:13.666+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:13.917 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:13.907+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:14.033 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:14.026+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:14.079 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:14.072+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:14.226 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:14.219+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:14.457 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:14.447+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:14.708 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:14.701+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:14.939 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:14.932+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:15.037 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:15.031+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:15.087 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:15.078+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:15.282 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:15.266+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:15.449 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:15.438+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:15.705 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:15.687+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:15.960 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:15.947+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:16.024 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:16.015+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:16.132 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:16.123+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:16.268 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:16.258+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:16.470 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:16.462+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:16.678 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:16.672+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:17.001 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:16.993+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:17.010 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:17.004+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:17.101 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:17.094+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:17.223 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:17.216+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:17.423 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:17.417+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:17.698 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:17.692+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:17.998 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:17.984+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:18.022 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:18.011+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:18.071 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:18.064+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:18.228 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:18.221+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:18.477 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:18.464+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:18.714 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:18.708+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:19.016 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:19.010+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:19.062 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:19.055+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:19.068 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:19.063+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:19.220 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:19.211+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:19.505 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:19.497+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:19.737 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:19.731+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:20.046 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:20.039+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:20.050 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:20.043+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:20.055 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:20.050+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:20.254 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:20.247+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:20.521 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:20.509+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:20.745 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:20.734+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:21.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:21.008+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:21.030 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:21.024+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:21.071 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:21.065+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:21.251 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:21.245+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:21.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:21.543+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:21.782 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:21.776+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:22.016 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:21.982+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:22.017 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:21.979+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:22.038 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:22.032+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:22.271 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:22.263+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:22.584 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:22.577+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:22.813 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:22.807+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:22.948 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:22.943+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:23.036 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:23.029+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:23.044 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:23.036+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:23.275 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:23.264+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:23.595 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:23.589+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:23.814 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:23.809+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:23.960 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:23.945+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:24.003 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:23.997+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:24.070 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:24.063+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:24.323 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:24.317+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:24.582 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:24.576+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:24.811 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:24.806+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:24.966 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:24.959+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:25.029 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:25.024+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:25.048 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:25.042+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:25.278 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:25.271+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:25.557 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:25.551+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:25.793 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:25.783+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:25.970 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:25.964+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:25.989 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:25.982+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:26.081 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:26.075+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:26.249 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:26.236+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:26.534 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:26.529+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:26.812 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:26.806+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:26.930 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:26.924+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:27.046 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:27.035+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:27.124 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:27.118+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:27.261 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:27.252+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:27.493 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:27.487+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:27.867 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:27.860+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:27.897 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:27.892+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:28.037 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:28.030+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:28.108 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:28.101+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:28.281 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:28.275+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:28.526 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:28.520+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:28.849 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:28.842+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:28.857 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:28.851+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:29.066 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:29.059+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:29.148 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:29.142+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:29.236 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:29.229+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:29.489 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:29.482+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:29.874 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:29.862+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:29.875 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:29.869+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:30.083 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:30.077+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:30.160 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:30.154+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:30.224 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:30.218+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:30.480 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:30.471+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:30.883 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:30.877+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:30.903 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:30.895+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:31.051 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:31.044+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:31.185 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:31.179+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:31.268 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:31.263+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:31.524 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:31.518+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:31.873 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:31.868+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:31.884 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:31.873+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:32.082 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:32.076+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:32.228 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:32.220+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:32.287 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:32.279+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:32.548 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:32.541+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:32.838 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:32.832+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:32.869 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:32.863+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:33.052 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:33.045+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:33.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:33.193+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:33.309 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:33.300+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:33.577 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:33.572+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:33.801 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:33.791+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:33.825 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:33.819+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:34.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:34.071+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:34.176 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:34.170+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:34.337 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:34.330+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:34.628 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:34.622+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:34.804 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:34.793+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:34.866 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:34.861+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:35.067 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:35.060+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:35.165 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:35.159+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:35.326 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:35.319+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:35.680 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:35.670+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:35.802 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:35.797+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:35.919 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:35.913+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:36.060 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:36.054+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:36.159 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:36.153+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:36.253 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:47:36.249+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e1056 v1056) 2019-11-29T20:47:36.333 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:36.327+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:36.654 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:36.648+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:36.844 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:36.837+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:36.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:36.898+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:37.073 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:37.068+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:37.195 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:37.188+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:37.384 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:37.378+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:37.616 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:37.610+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:37.820 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:37.811+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:37.911 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:37.906+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:38.057 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:38.046+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:38.193 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:38.187+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:38.411 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:38.395+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:38.592 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:38.585+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:38.851 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:38.834+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:38.955 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:38.949+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:39.084 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:39.076+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:39.189 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:39.183+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:39.428 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:39.422+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:39.629 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:39.623+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:39.807 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:39.801+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:39.934 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:39.929+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:40.077 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:40.071+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:40.238 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:40.225+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:40.464 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:40.458+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:40.668 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:40.662+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:40.845 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:40.838+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:40.904 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:40.896+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:41.067 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:41.061+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:41.199 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:41.193+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:41.276 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:47:41.268+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e1056 v1056) 2019-11-29T20:47:41.491 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:41.484+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:41.687 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:41.681+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:41.803 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:41.798+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:41.950 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:41.943+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:42.095 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:42.089+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:42.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:42.224+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:42.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:42.498+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:42.689 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:42.676+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:42.765 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:42.759+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:42.949 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:42.943+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:43.116 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:43.105+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:43.209 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:43.197+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:43.504 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:43.495+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:43.636 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:43.630+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:43.797 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:43.792+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:43.976 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:43.971+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:44.166 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:44.160+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:44.231 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:44.224+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:44.542 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:44.536+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:44.602 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:44.589+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:44.827 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:44.819+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:44.958 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:44.944+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:45.167 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:45.161+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:45.194 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:45.188+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:45.535 INFO:tasks.ceph.osd.6.smithi114.stderr:2019-11-29T20:47:45.528+0000 1694c700 -1 osd.6 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:17.685491+0000 front 2019-11-29T20:46:17.867629+0000 (oldest deadline 2019-11-29T20:47:03.546193+0000) 2019-11-29T20:47:45.610 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:45.596+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:45.877 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:45.869+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:45.945 INFO:tasks.ceph.osd.1.smithi182.stderr:2019-11-29T20:47:45.928+0000 1694c700 -1 osd.1 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.538980+0000 front 2019-11-29T20:46:22.641835+0000 (oldest deadline 2019-11-29T20:47:04.217853+0000) 2019-11-29T20:47:46.183 INFO:tasks.ceph.osd.7.smithi114.stderr:2019-11-29T20:47:46.168+0000 1694c700 -1 osd.7 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:21.541203+0000 front 2019-11-29T20:46:21.647587+0000 (oldest deadline 2019-11-29T20:47:06.796603+0000) 2019-11-29T20:47:46.211 INFO:tasks.ceph.osd.5.smithi114.stderr:2019-11-29T20:47:46.196+0000 1694c700 -1 osd.5 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.868316+0000 front 2019-11-29T20:46:22.923335+0000 (oldest deadline 2019-11-29T20:47:04.529265+0000) 2019-11-29T20:47:46.371 INFO:tasks.ceph.mon.b.smithi114.stderr:2019-11-29T20:47:46.364+0000 1a899700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.0 [v2:172.21.15.182:6824/9950,v1:172.21.15.182:6825/9950] for 45sec e1056 v1056) 2019-11-29T20:47:46.645 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:46.634+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:46.891 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:46.886+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:47:47.631 INFO:tasks.ceph.osd.4.smithi114.stderr:2019-11-29T20:47:47.622+0000 1694c700 -1 osd.4 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:19.050142+0000 front 2019-11-29T20:46:19.059719+0000 (oldest deadline 2019-11-29T20:47:04.446772+0000) 2019-11-29T20:47:47.904 INFO:tasks.ceph.osd.2.smithi182.stderr:2019-11-29T20:47:47.896+0000 1694c700 -1 osd.2 1056 heartbeat_check: no reply from 172.21.15.182:6828 osd.0 since back 2019-11-29T20:46:22.745045+0000 front 2019-11-29T20:46:22.746534+0000 (oldest deadline 2019-11-29T20:47:06.821734+0000) 2019-11-29T20:48:25.837 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:32:33.972 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:25.853 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:32:33.983 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:25.857 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:32:34.035 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:25.857 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:32:34.036 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:25.863 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:32:34.042 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:25.864 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:32:34.042 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:26.048 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:32:34.213 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:26.074 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:32:34.255 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:26.127 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:32:34.263 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:48:38.916 INFO:tasks.ceph.osd.0.smithi182.stderr:*** Caught signal (Aborted) ** 2019-11-29T20:48:38.916 INFO:tasks.ceph.osd.0.smithi182.stderr: in thread 34f8a700 thread_name:tp_osd_tp 2019-11-29T20:48:39.015 INFO:tasks.ceph.osd.0.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:48:39.015 INFO:tasks.ceph.osd.0.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 2: (std::ostreambuf_iterator > std::num_put > >::_M_insert_int(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0) [0xc978a50] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 3: (std::num_put > >::do_put(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0xd) [0xc978d8d] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 4: (std::ostream& std::ostream::_M_insert(unsigned long)+0xbe) [0xc98502e] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 5: (operator<<(std::ostream&, pg_info_t const&)+0x263) [0x71d2e3] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 6: (operator<<(std::ostream&, PeeringState const&)+0x58) [0x91ecc8] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 7: (operator<<(std::ostream&, PG const&)+0x20) [0x76b6c0] 2019-11-29T20:48:39.016 INFO:tasks.ceph.osd.0.smithi182.stderr: 8: (PG::gen_prefix(std::ostream&) const+0x1ca) [0x76beaa] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 9: (PrimaryLogPG::do_read(PrimaryLogPG::OpContext*, OSDOp&)+0x2ca) [0x8174da] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x726f) [0x82583f] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 11: (cls_cxx_read2(void*, int, int, ceph::buffer::v14_2_0::list*, unsigned int)+0x165) [0x690b95] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 12: (()+0x22ffc) [0x209e8ffc] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 13: (()+0x15342) [0x209db342] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 14: (()+0x65bc3e) [0x763c3e] 2019-11-29T20:48:39.017 INFO:tasks.ceph.osd.0.smithi182.stderr: 15: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763fca] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 16: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822443] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 17: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x8318ef] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 18: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x83208c] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 19: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x8368ff] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 20: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c6fd] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 21: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc459] 2019-11-29T20:48:39.018 INFO:tasks.ceph.osd.0.smithi182.stderr: 22: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x913e12] 2019-11-29T20:48:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr: 23: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6eb5] 2019-11-29T20:48:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr: 24: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd118a] 2019-11-29T20:48:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr: 25: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd9590] 2019-11-29T20:48:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr: 26: (()+0x7e65) [0xc093e65] 2019-11-29T20:48:39.019 INFO:tasks.ceph.osd.0.smithi182.stderr: 27: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:48:39.047 INFO:tasks.ceph.osd.0.smithi182.stderr:2019-11-29T20:48:39.041+0000 34f8a700 -1 *** Caught signal (Aborted) ** 2019-11-29T20:48:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr: in thread 34f8a700 thread_name:tp_osd_tp 2019-11-29T20:48:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:48:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:48:39.048 INFO:tasks.ceph.osd.0.smithi182.stderr: 2: (std::ostreambuf_iterator > std::num_put > >::_M_insert_int(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0) [0xc978a50] 2019-11-29T20:48:39.049 INFO:tasks.ceph.osd.0.smithi182.stderr: 3: (std::num_put > >::do_put(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0xd) [0xc978d8d] 2019-11-29T20:48:39.049 INFO:tasks.ceph.osd.0.smithi182.stderr: 4: (std::ostream& std::ostream::_M_insert(unsigned long)+0xbe) [0xc98502e] 2019-11-29T20:48:39.049 INFO:tasks.ceph.osd.0.smithi182.stderr: 5: (operator<<(std::ostream&, pg_info_t const&)+0x263) [0x71d2e3] 2019-11-29T20:48:39.049 INFO:tasks.ceph.osd.0.smithi182.stderr: 6: (operator<<(std::ostream&, PeeringState const&)+0x58) [0x91ecc8] 2019-11-29T20:48:39.049 INFO:tasks.ceph.osd.0.smithi182.stderr: 7: (operator<<(std::ostream&, PG const&)+0x20) [0x76b6c0] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 8: (PG::gen_prefix(std::ostream&) const+0x1ca) [0x76beaa] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 9: (PrimaryLogPG::do_read(PrimaryLogPG::OpContext*, OSDOp&)+0x2ca) [0x8174da] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x726f) [0x82583f] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 11: (cls_cxx_read2(void*, int, int, ceph::buffer::v14_2_0::list*, unsigned int)+0x165) [0x690b95] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 12: (()+0x22ffc) [0x209e8ffc] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 13: (()+0x15342) [0x209db342] 2019-11-29T20:48:39.050 INFO:tasks.ceph.osd.0.smithi182.stderr: 14: (()+0x65bc3e) [0x763c3e] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 15: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763fca] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 16: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822443] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 17: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x8318ef] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 18: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x83208c] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 19: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x8368ff] 2019-11-29T20:48:39.051 INFO:tasks.ceph.osd.0.smithi182.stderr: 20: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c6fd] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 21: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc459] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 22: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x913e12] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 23: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6eb5] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 24: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd118a] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 25: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd9590] 2019-11-29T20:48:39.052 INFO:tasks.ceph.osd.0.smithi182.stderr: 26: (()+0x7e65) [0xc093e65] 2019-11-29T20:48:39.053 INFO:tasks.ceph.osd.0.smithi182.stderr: 27: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:48:39.053 INFO:tasks.ceph.osd.0.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:48:39.053 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:39.483 INFO:tasks.ceph.osd.0.smithi182.stderr: 0> 2019-11-29T20:48:39.041+0000 34f8a700 -1 *** Caught signal (Aborted) ** 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: in thread 34f8a700 thread_name:tp_osd_tp 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: 2: (std::ostreambuf_iterator > std::num_put > >::_M_insert_int(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0) [0xc978a50] 2019-11-29T20:48:39.484 INFO:tasks.ceph.osd.0.smithi182.stderr: 3: (std::num_put > >::do_put(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0xd) [0xc978d8d] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 4: (std::ostream& std::ostream::_M_insert(unsigned long)+0xbe) [0xc98502e] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 5: (operator<<(std::ostream&, pg_info_t const&)+0x263) [0x71d2e3] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 6: (operator<<(std::ostream&, PeeringState const&)+0x58) [0x91ecc8] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 7: (operator<<(std::ostream&, PG const&)+0x20) [0x76b6c0] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 8: (PG::gen_prefix(std::ostream&) const+0x1ca) [0x76beaa] 2019-11-29T20:48:39.485 INFO:tasks.ceph.osd.0.smithi182.stderr: 9: (PrimaryLogPG::do_read(PrimaryLogPG::OpContext*, OSDOp&)+0x2ca) [0x8174da] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x726f) [0x82583f] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 11: (cls_cxx_read2(void*, int, int, ceph::buffer::v14_2_0::list*, unsigned int)+0x165) [0x690b95] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 12: (()+0x22ffc) [0x209e8ffc] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 13: (()+0x15342) [0x209db342] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 14: (()+0x65bc3e) [0x763c3e] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 15: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763fca] 2019-11-29T20:48:39.486 INFO:tasks.ceph.osd.0.smithi182.stderr: 16: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822443] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 17: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x8318ef] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 18: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x83208c] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 19: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x8368ff] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 20: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c6fd] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 21: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc459] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 22: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x913e12] 2019-11-29T20:48:39.487 INFO:tasks.ceph.osd.0.smithi182.stderr: 23: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6eb5] 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: 24: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd118a] 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: 25: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd9590] 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: 26: (()+0x7e65) [0xc093e65] 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: 27: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:48:39.488 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:39.832 INFO:tasks.ceph.osd.0.smithi182.stderr: -8> 2019-11-29T20:48:39.041+0000 34f8a700 -1 *** Caught signal (Aborted) ** 2019-11-29T20:48:39.832 INFO:tasks.ceph.osd.0.smithi182.stderr: in thread 34f8a700 thread_name:tp_osd_tp 2019-11-29T20:48:39.833 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:39.833 INFO:tasks.ceph.osd.0.smithi182.stderr: ceph version 15.0.0-7809-g656c8e8 (656c8e8049c2c1acd363143c842c2edf1fe09b64) octopus (dev) 2019-11-29T20:48:39.833 INFO:tasks.ceph.osd.0.smithi182.stderr: 1: (()+0xf5f0) [0xc09b5f0] 2019-11-29T20:48:39.833 INFO:tasks.ceph.osd.0.smithi182.stderr: 2: (std::ostreambuf_iterator > std::num_put > >::_M_insert_int(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0) [0xc978a50] 2019-11-29T20:48:39.834 INFO:tasks.ceph.osd.0.smithi182.stderr: 3: (std::num_put > >::do_put(std::ostreambuf_iterator >, std::ios_base&, char, unsigned long) const+0xd) [0xc978d8d] 2019-11-29T20:48:39.834 INFO:tasks.ceph.osd.0.smithi182.stderr: 4: (std::ostream& std::ostream::_M_insert(unsigned long)+0xbe) [0xc98502e] 2019-11-29T20:48:39.834 INFO:tasks.ceph.osd.0.smithi182.stderr: 5: (operator<<(std::ostream&, pg_info_t const&)+0x263) [0x71d2e3] 2019-11-29T20:48:39.834 INFO:tasks.ceph.osd.0.smithi182.stderr: 6: (operator<<(std::ostream&, PeeringState const&)+0x58) [0x91ecc8] 2019-11-29T20:48:39.835 INFO:tasks.ceph.osd.0.smithi182.stderr: 7: (operator<<(std::ostream&, PG const&)+0x20) [0x76b6c0] 2019-11-29T20:48:39.835 INFO:tasks.ceph.osd.0.smithi182.stderr: 8: (PG::gen_prefix(std::ostream&) const+0x1ca) [0x76beaa] 2019-11-29T20:48:39.835 INFO:tasks.ceph.osd.0.smithi182.stderr: 9: (PrimaryLogPG::do_read(PrimaryLogPG::OpContext*, OSDOp&)+0x2ca) [0x8174da] 2019-11-29T20:48:39.835 INFO:tasks.ceph.osd.0.smithi182.stderr: 10: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x726f) [0x82583f] 2019-11-29T20:48:39.836 INFO:tasks.ceph.osd.0.smithi182.stderr: 11: (cls_cxx_read2(void*, int, int, ceph::buffer::v14_2_0::list*, unsigned int)+0x165) [0x690b95] 2019-11-29T20:48:39.836 INFO:tasks.ceph.osd.0.smithi182.stderr: 12: (()+0x22ffc) [0x209e8ffc] 2019-11-29T20:48:39.836 INFO:tasks.ceph.osd.0.smithi182.stderr: 13: (()+0x15342) [0x209db342] 2019-11-29T20:48:39.836 INFO:tasks.ceph.osd.0.smithi182.stderr: 14: (()+0x65bc3e) [0x763c3e] 2019-11-29T20:48:39.837 INFO:tasks.ceph.osd.0.smithi182.stderr: 15: (ClassHandler::ClassMethod::exec(void*, ceph::buffer::v14_2_0::list&, ceph::buffer::v14_2_0::list&)+0x5a) [0x763fca] 2019-11-29T20:48:39.837 INFO:tasks.ceph.osd.0.smithi182.stderr: 16: (PrimaryLogPG::do_osd_ops(PrimaryLogPG::OpContext*, std::vector >&)+0x3e73) [0x822443] 2019-11-29T20:48:39.837 INFO:tasks.ceph.osd.0.smithi182.stderr: 17: (PrimaryLogPG::prepare_transaction(PrimaryLogPG::OpContext*)+0x16f) [0x8318ef] 2019-11-29T20:48:39.837 INFO:tasks.ceph.osd.0.smithi182.stderr: 18: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x3ac) [0x83208c] 2019-11-29T20:48:39.838 INFO:tasks.ceph.osd.0.smithi182.stderr: 19: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x324f) [0x8368ff] 2019-11-29T20:48:39.838 INFO:tasks.ceph.osd.0.smithi182.stderr: 20: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xc8d) [0x83c6fd] 2019-11-29T20:48:39.838 INFO:tasks.ceph.osd.0.smithi182.stderr: 21: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x2f9) [0x6dc459] 2019-11-29T20:48:39.838 INFO:tasks.ceph.osd.0.smithi182.stderr: 22: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x62) [0x913e12] 2019-11-29T20:48:39.839 INFO:tasks.ceph.osd.0.smithi182.stderr: 23: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x945) [0x6f6eb5] 2019-11-29T20:48:39.839 INFO:tasks.ceph.osd.0.smithi182.stderr: 24: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x45a) [0xcd118a] 2019-11-29T20:48:39.839 INFO:tasks.ceph.osd.0.smithi182.stderr: 25: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xcd9590] 2019-11-29T20:48:39.839 INFO:tasks.ceph.osd.0.smithi182.stderr: 26: (()+0x7e65) [0xc093e65] 2019-11-29T20:48:39.840 INFO:tasks.ceph.osd.0.smithi182.stderr: 27: (clone()+0x6d) [0xd20b88d] 2019-11-29T20:48:39.840 INFO:tasks.ceph.osd.0.smithi182.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-29T20:48:39.840 INFO:tasks.ceph.osd.0.smithi182.stderr: 2019-11-29T20:48:43.754 INFO:tasks.ceph.osd.0.smithi182.stderr:daemon-helper: command crashed with signal 6 2019-11-29T20:53:34.111 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:37:42.247 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.115 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:37:42.251 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.138 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:37:42.320 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.141 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:37:42.323 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.146 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:37:42.327 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.152 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:37:42.333 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.361 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:37:42.542 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.397 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:37:42.533 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:53:34.398 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:37:42.580 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:27.973 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:38:36.109 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.029 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:38:36.165 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.039 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:38:36.220 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.069 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:38:36.249 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.094 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:38:36.230 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.108 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:38:36.289 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.110 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:38:36.292 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.126 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:38:36.307 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:54:28.175 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:38:36.357 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.087 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:42:40.223 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.107 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:42:40.243 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.117 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:42:40.299 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.122 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:42:40.304 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.131 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:42:40.312 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.135 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:42:40.316 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.321 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:42:40.502 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.357 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:42:40.538 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:32.359 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:42:40.495 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T20:58:58.588 INFO:tasks.rgw.client.0.smithi182.stdout:2019-11-29T20:58:58.563+0000 20e22700 -1 RGWWatcher::handle_error cookie 821383552 err (110) Connection timed out 2019-11-29T21:02:34.855 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:42.991 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:34.875 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:43.011 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:34.883 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:43.064 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:34.886 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:43.068 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:34.889 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:43.070 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:34.901 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:43.076 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:35.137 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:43.319 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:35.186 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:43.367 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:35.197 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:43.333 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.865 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:58.001 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.877 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:58.013 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.911 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:46:58.047 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.927 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:58.108 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.935 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:58.116 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.949 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:58.125 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.950 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:58.131 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.966 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:46:58.148 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:02:49.978 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:46:58.159 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:35.972 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:50:44.108 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:35.976 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:50:44.113 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.065 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:50:44.246 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.067 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:50:44.249 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.070 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:50:44.250 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.070 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:50:44.252 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.177 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:50:44.313 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.234 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:50:44.416 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:06:36.295 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:50:44.475 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.483 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:51:53.620 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.494 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:51:53.631 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.498 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:51:53.679 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.499 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:51:53.681 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.501 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:51:53.682 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.504 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:51:53.686 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.567 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:51:53.748 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.570 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:51:53.752 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:07:45.573 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:51:53.710 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.106 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:55:20.242 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.115 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:55:20.252 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.153 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:55:20.335 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.157 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:55:20.339 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.177 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:55:20.358 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.204 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:55:20.383 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.270 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:55:20.406 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.293 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:55:20.475 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:11:12.362 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:55:20.543 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.572 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:57:05.707 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.583 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:57:05.719 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.603 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:57:05.784 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.605 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:57:05.787 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.607 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:57:05.789 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.616 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:57:05.795 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.731 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:09:57:05.912 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.734 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:09:57:05.916 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:12:57.759 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:09:57:05.895 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.304 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:02:16.441 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.310 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:02:16.447 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.328 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:02:16.505 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.328 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:02:16.509 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.328 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:02:16.506 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.339 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:02:16.511 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.523 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:02:16.658 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.545 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:02:16.726 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:18:08.587 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:02:16.763 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.592 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:03:42.728 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.603 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:03:42.739 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.658 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:03:42.837 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.675 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:03:42.857 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.681 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:03:42.862 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.683 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:03:42.865 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.707 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:03:42.844 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.755 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:03:42.936 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:19:34.768 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:03:42.943 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.441 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:07:28.578 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.448 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:07:28.585 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.458 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:07:28.640 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.461 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:07:28.643 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.465 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:07:28.646 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.471 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:07:28.653 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.609 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:07:28.746 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.612 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:07:28.793 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:23:20.620 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:07:28.803 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.332 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:04.469 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.341 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:04.478 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.409 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:04.591 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.412 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:04.594 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.414 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:04.596 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.416 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:04.598 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.517 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:04.654 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.567 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:04.749 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:27:56.584 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:04.766 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.574 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:39.711 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.585 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:39.722 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.608 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:39.790 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.613 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:39.795 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.618 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:39.800 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.621 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:39.803 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.646 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:12:39.783 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.668 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:12:39.849 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:28:31.707 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:12:39.890 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.747 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:17:51.884 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.764 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:17:51.946 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.765 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:17:51.902 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.771 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:17:51.953 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.779 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:17:51.961 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.782 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:17:51.964 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.977 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:17:52.159 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:43.997 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:17:52.134 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:33:44.006 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:17:52.188 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.157 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:20:26.294 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.168 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:20:26.305 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.219 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:20:26.401 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.231 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:20:26.413 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.232 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:20:26.414 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.238 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:20:26.420 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.261 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:20:26.398 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.362 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:20:26.545 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:36:18.386 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:20:26.568 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.510 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:23:03.647 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.527 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:23:03.664 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.533 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:23:03.716 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.533 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:23:03.715 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.535 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:23:03.718 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.539 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:23:03.721 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.660 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:23:03.843 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.691 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:23:03.829 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:38:55.714 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:23:03.896 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.656 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:17.793 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.659 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:17.797 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.677 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:17.860 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.682 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:17.865 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.737 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:17.919 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.742 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:17.925 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.880 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:18.017 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.985 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:18.167 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:09.999 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:18.182 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.870 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:48.007 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.872 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:48.010 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.940 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:48.122 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.946 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:48.129 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.987 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:28:48.170 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.989 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:48.172 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.993 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:48.176 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:39.994 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:28:48.131 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:44:40.037 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:28:48.218 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.883 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:31:54.020 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.897 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:31:54.035 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.941 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:31:54.123 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.956 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:31:54.138 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.961 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:31:54.143 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:45.966 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:31:54.149 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:46.022 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:31:54.157 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:46.098 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:31:54.281 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:47:46.141 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:31:54.313 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.865 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:33:26.002 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.875 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:33:26.013 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.887 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:33:26.070 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.891 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:33:26.073 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.892 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:33:26.074 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.899 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:33:26.082 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.977 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:33:26.160 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.980 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:33:26.117 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:49:17.986 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:33:26.169 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.003 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:37:10.140 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.004 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:37:10.142 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.012 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:37:10.195 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.015 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:37:10.198 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.057 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:37:10.240 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.071 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:37:10.253 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.111 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:37:10.249 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.184 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:37:10.367 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:53:02.197 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:37:10.381 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.377 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:38:40.515 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.390 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:38:40.528 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.405 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:38:40.588 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.410 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:38:40.593 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.411 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:38:40.594 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.417 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:38:40.600 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.494 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:38:40.677 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.518 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:38:40.655 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:54:32.551 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:38:40.734 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.255 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:43:54.393 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.269 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:43:54.451 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.270 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:43:54.408 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.273 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:43:54.457 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.274 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:43:54.457 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.297 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:43:54.463 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.581 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:43:54.718 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.581 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:43:54.760 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T21:59:46.582 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:43:54.762 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.765 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:45:31.903 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.771 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:45:31.909 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.801 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:45:31.984 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.834 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:45:32.017 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.840 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:45:32.023 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.840 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:45:32.023 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.852 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:45:31.990 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.903 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:45:32.086 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:01:23.946 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:45:32.129 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.574 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:49:04.712 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.582 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:49:04.719 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.602 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:49:04.785 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.604 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:49:04.787 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.607 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:49:04.790 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.611 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:49:04.794 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.737 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:49:04.875 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.772 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:49:04.955 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:04:56.798 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:49:04.981 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.526 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:53:53.663 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.538 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:53:53.676 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.550 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:53:53.733 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.551 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:53:53.735 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.579 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:53:53.762 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.604 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:53:53.786 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.686 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:53:53.869 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.694 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:53:53.832 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:09:45.841 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:53:54.024 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.270 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:54:17.407 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.292 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:54:17.430 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.293 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:54:17.476 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.299 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:54:17.482 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.309 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:54:17.492 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.310 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:54:17.492 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.352 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:54:17.536 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.357 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:54:17.539 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:10:09.397 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:54:17.535 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.791 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:59:29.929 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.798 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:59:29.936 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.804 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:59:29.988 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.808 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:59:29.990 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.810 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:59:29.993 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:21.813 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:59:29.996 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:22.011 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:10:59:30.194 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:22.055 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:10:59:30.238 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:15:22.123 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:10:59:30.260 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.359 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:02:20.497 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.366 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:02:20.504 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.479 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:02:20.662 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.506 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:02:20.689 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.618 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:02:20.801 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.627 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:02:20.765 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.663 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:02:20.846 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.666 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:02:20.849 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:18:12.792 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:02:20.975 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.881 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:04:41.019 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.891 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:04:41.029 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.898 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:04:41.081 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.903 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:04:41.086 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.913 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:04:41.097 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:32.917 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:04:41.101 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:33.031 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:04:41.214 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:33.046 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:04:41.229 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:20:33.052 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:04:41.190 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.943 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:09:53.080 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.958 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:09:53.096 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.981 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:09:53.162 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.981 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:09:53.164 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.993 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:09:53.170 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:44.993 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:09:53.171 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:45.185 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:09:53.368 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:45.218 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:09:53.401 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:25:45.289 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:09:53.427 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.183 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:10:43.320 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.189 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:10:43.327 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.205 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:10:43.389 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.220 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:10:43.403 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.233 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:10:43.417 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.240 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:10:43.424 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.246 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:10:43.383 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.281 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:10:43.464 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:26:35.302 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:10:43.485 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.120 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:13:04.257 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.136 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:13:04.274 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.193 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:13:04.376 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.195 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:13:04.379 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.200 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:13:04.384 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.228 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:13:04.411 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.297 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:13:04.435 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.348 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:13:04.531 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:28:56.350 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:13:04.534 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.288 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:15:04.426 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.302 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:15:04.440 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.310 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:15:04.493 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.314 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:15:04.498 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.322 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:15:04.505 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.332 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:15:04.515 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.455 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:15:04.592 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.459 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:15:04.642 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:30:56.461 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:15:04.645 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.831 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:19:05.969 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.848 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:19:05.986 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.849 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:19:06.033 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.879 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:19:06.063 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.901 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:19:06.084 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:57.902 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:19:06.085 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:58.007 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:19:06.190 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:58.016 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:19:06.199 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:34:58.100 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:19:06.238 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.507 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:20:14.645 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.523 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:20:14.661 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.530 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:20:14.713 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.536 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:20:14.720 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.549 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:20:14.732 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.565 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:20:14.748 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.612 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:20:14.750 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.638 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:20:14.821 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:36:06.650 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:20:14.833 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.274 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:25:27.411 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.283 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:25:27.421 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.298 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:25:27.482 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.301 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:25:27.485 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.302 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:25:27.486 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.323 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:25:27.506 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.499 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:25:27.637 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.504 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:25:27.687 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:41:19.523 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:25:27.706 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.683 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:27:27.821 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.700 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:27:27.838 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.799 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:27:27.937 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.803 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:27:27.986 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.805 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:27:27.989 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.806 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:27:27.990 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.808 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:27:27.992 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.927 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:27:28.110 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:43:19.931 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:27:28.114 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.496 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:30:39.630 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.501 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:30:39.639 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.519 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:30:39.702 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.528 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:30:39.709 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.529 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:30:39.709 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.538 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:30:39.722 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.679 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:30:39.863 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.711 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:30:39.894 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:46:31.740 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:30:39.878 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.454 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:49.592 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.459 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:49.597 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.499 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:49.682 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.507 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:49.691 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.510 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:49.693 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.513 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:49.696 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.668 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:49.806 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.695 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:49.878 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:41.754 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:49.936 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.516 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:51.654 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.522 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:51.660 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.545 INFO:tasks.ceph.mon.b.smithi114.stderr:==00:11:35:51.683 8579== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.670 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:51.853 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.671 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:51.855 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.725 INFO:tasks.ceph.mon.a.smithi182.stderr:==00:11:35:51.907 9026== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.741 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:51.923 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.742 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:51.925 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:51:43.757 INFO:tasks.ceph.mon.c.smithi182.stderr:==00:11:35:51.940 9027== Warning: unimplemented fcntl command: 1036 2019-11-29T22:54:41.873 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-29T22:54:41.877 DEBUG:teuthology.task.console_log:Killing console logger for smithi114 2019-11-29T22:54:41.877 DEBUG:teuthology.task.console_log:Killing console logger for smithi182 2019-11-29T22:54:41.878 DEBUG:teuthology.task.console_log:Killing console logger for smithi114 2019-11-29T22:54:41.878 DEBUG:teuthology.task.console_log:Killing console logger for smithi182 2019-11-29T22:54:41.878 DEBUG:teuthology.exit:Finished running handlers